-- Logs begin at Tue 2022-10-25 12:44:37 UTC, end at Tue 2022-10-25 13:45:51 UTC. -- Oct 25 13:10:43.324544 dv-cinder-862432-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 25 13:10:43.331585 dv-cinder-862432-2-smb devstack@keystone.service[81348]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 25 13:10:43.335931 dv-cinder-862432-2-smb devstack@keystone.service[81348]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 25 13:10:43 2022] *** Oct 25 13:10:43.335931 dv-cinder-862432-2-smb devstack@keystone.service[81348]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 25 13:10:43.335931 dv-cinder-862432-2-smb devstack@keystone.service[81348]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 25 13:10:43.335931 dv-cinder-862432-2-smb devstack@keystone.service[81348]: nodename: dv-cinder-862432-2-smb Oct 25 13:10:43.335931 dv-cinder-862432-2-smb devstack@keystone.service[81348]: machine: x86_64 Oct 25 13:10:43.335931 dv-cinder-862432-2-smb devstack@keystone.service[81348]: clock source: unix Oct 25 13:10:43.335931 dv-cinder-862432-2-smb devstack@keystone.service[81348]: pcre jit disabled Oct 25 13:10:43.335931 dv-cinder-862432-2-smb devstack@keystone.service[81348]: detected number of CPU cores: 4 Oct 25 13:10:43.335931 dv-cinder-862432-2-smb devstack@keystone.service[81348]: current working directory: / Oct 25 13:10:43.335931 dv-cinder-862432-2-smb devstack@keystone.service[81348]: detected binary path: /usr/bin/uwsgi-core Oct 25 13:10:43.335931 dv-cinder-862432-2-smb devstack@keystone.service[81348]: your processes number limit is 47680 Oct 25 13:10:43.335931 dv-cinder-862432-2-smb devstack@keystone.service[81348]: your memory page size is 4096 bytes Oct 25 13:10:43.335931 dv-cinder-862432-2-smb devstack@keystone.service[81348]: detected max file descriptor number: 2048 Oct 25 13:10:43.335931 dv-cinder-862432-2-smb devstack@keystone.service[81348]: lock engine: pthread robust mutexes Oct 25 13:10:43.335931 dv-cinder-862432-2-smb devstack@keystone.service[81348]: thunder lock: enabled Oct 25 13:10:43.335931 dv-cinder-862432-2-smb devstack@keystone.service[81348]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 25 13:10:43.335931 dv-cinder-862432-2-smb devstack@keystone.service[81348]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 25 13:10:43.373631 dv-cinder-862432-2-smb devstack@keystone.service[81348]: Python main interpreter initialized at 0x564cfdc069c0 Oct 25 13:10:43.373631 dv-cinder-862432-2-smb devstack@keystone.service[81348]: python threads support enabled Oct 25 13:10:43.373631 dv-cinder-862432-2-smb devstack@keystone.service[81348]: your server socket listen backlog is limited to 100 connections Oct 25 13:10:43.373631 dv-cinder-862432-2-smb devstack@keystone.service[81348]: your mercy for graceful operations on workers is 90 seconds Oct 25 13:10:43.374005 dv-cinder-862432-2-smb devstack@keystone.service[81348]: mapped 403077 bytes (393 KB) for 2 cores Oct 25 13:10:43.374088 dv-cinder-862432-2-smb devstack@keystone.service[81348]: *** Operational MODE: preforking *** Oct 25 13:10:43.374320 dv-cinder-862432-2-smb devstack@keystone.service[81348]: *** uWSGI is running in multiple interpreter mode *** Oct 25 13:10:43.374320 dv-cinder-862432-2-smb devstack@keystone.service[81348]: spawned uWSGI master process (pid: 81348) Oct 25 13:10:43.374529 dv-cinder-862432-2-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 25 13:10:43.375619 dv-cinder-862432-2-smb devstack@keystone.service[81348]: spawned uWSGI worker 1 (pid: 81362, cores: 1) Oct 25 13:10:43.375619 dv-cinder-862432-2-smb devstack@keystone.service[81348]: spawned uWSGI worker 2 (pid: 81363, cores: 1) Oct 25 13:10:43.375619 dv-cinder-862432-2-smb devstack@keystone.service[81348]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 25 13:10:47.648273 dv-cinder-862432-2-smb devstack@keystone.service[81363]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 25 13:10:47.648273 dv-cinder-862432-2-smb devstack@keystone.service[81363]: from cryptography.utils import int_from_bytes Oct 25 13:10:47.649068 dv-cinder-862432-2-smb devstack@keystone.service[81363]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 25 13:10:47.649068 dv-cinder-862432-2-smb devstack@keystone.service[81363]: from cryptography.utils import int_from_bytes Oct 25 13:10:47.649207 dv-cinder-862432-2-smb devstack@keystone.service[81362]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 25 13:10:47.649207 dv-cinder-862432-2-smb devstack@keystone.service[81362]: from cryptography.utils import int_from_bytes Oct 25 13:10:47.649632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 25 13:10:47.649632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: from cryptography.utils import int_from_bytes Oct 25 13:10:47.698720 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 25 13:10:47.698915 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 25 13:10:47.699104 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] command line args: [] {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 25 13:10:47.699369 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 25 13:10:47.699453 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 25 13:10:47.699527 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ================================================================================ {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 25 13:10:47.699603 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 25 13:10:47.699768 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] command line args: [] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 25 13:10:47.699852 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] admin_token = **** {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.700030 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] config_dir = [] {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.700118 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 25 13:10:47.700217 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.700304 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ================================================================================ {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 25 13:10:47.700398 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] config_source = [] {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.700480 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] admin_token = **** {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.700579 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] debug = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.700712 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] config_dir = [] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.700794 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.701089 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.701089 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] config_source = [] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.701280 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.701381 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] debug = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.701478 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.701581 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.701708 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.701805 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.701898 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.701992 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.702102 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] list_limit = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.702199 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.702294 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] log_config_append = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.702394 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.702494 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.702494 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] log_dir = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.702687 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] list_limit = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.702789 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] log_file = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.702890 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] log_config_append = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.702991 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.703086 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.703086 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] log_dir = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.703268 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.703347 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] log_file = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.703469 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.703549 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.703624 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.703748 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.703833 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.703833 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.704027 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.704106 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.704187 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.704291 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.704370 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.704471 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.704618 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.704818 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.704949 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.705033 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.705226 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.705435 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.705579 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.705693 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.705821 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.705913 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.705992 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.706144 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.706245 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.706396 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.706643 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.706731 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.706849 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] publish_errors = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.706976 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.707113 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.707281 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.707392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.707472 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.707587 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] publish_errors = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.707669 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.707802 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.707970 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.708048 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.708136 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] standard_threads = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.708218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.708340 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.708473 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.708583 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.708707 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.708793 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.708921 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] use_journal = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.709005 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] standard_threads = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.709096 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] use_json = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.709174 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.709270 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] use_stderr = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.709469 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.709553 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] use_syslog = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.709626 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.709698 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.709767 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] use_journal = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.709888 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] use_json = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.709984 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.710057 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] use_stderr = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.710127 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.710237 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] use_syslog = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.710360 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.710469 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 13:10:47.710597 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.710730 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.710841 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.710974 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.711077 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.711239 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.711324 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.711483 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.711560 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.711738 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.711827 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.712018 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.712110 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.712265 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.712342 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.712498 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.712581 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.712741 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.712833 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.712975 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.713052 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.713217 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.713299 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.713454 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.713541 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.713693 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.713771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.713934 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.714010 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.714182 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.714265 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.714425 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.714516 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.714659 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.714771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.714908 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.715088 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.715193 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.715289 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.715406 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.715516 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.715649 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.715768 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.715866 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.716012 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.716120 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.716217 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.716320 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.716417 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.716555 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.716657 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.716800 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.716903 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.717046 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.717149 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.717256 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.717352 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.717537 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.717679 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.717801 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.717899 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.718000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.718096 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.718190 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.718290 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.718392 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.718488 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.718625 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.718770 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.718872 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.718966 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.719069 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.719165 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.719296 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.719406 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.719526 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.719629 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.719756 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.719838 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.720009 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.720170 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.720421 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.720571 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.720571 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.720896 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.721025 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.721155 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.721290 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.721418 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.721555 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.721684 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.721813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.721947 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.722077 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.722211 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.722348 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.722489 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.722618 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.722746 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.722881 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.723011 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.723150 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.723280 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.723408 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.723536 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.723663 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.723797 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.723988 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.724124 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.724363 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.724529 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.724667 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.724806 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.724942 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.725072 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.725200 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.725337 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.725468 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.725733 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.725858 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.725989 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.726111 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.726243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.726375 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.726494 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.726628 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.726745 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.726874 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.727001 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.727124 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.727245 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.727378 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.727500 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.727621 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.727743 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.727876 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.728014 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.728103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.728177 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.728293 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.728376 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.728449 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.728523 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.728603 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.728675 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.728810 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.728892 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.729009 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.729084 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.729211 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.729289 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.729404 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.729479 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.729593 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.729675 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.729755 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.729872 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.729947 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.730018 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.730018 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.730145 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.730224 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.730297 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.730368 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.730438 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.730508 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.730578 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.730655 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.730727 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.730797 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.730867 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.730943 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.731015 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.731096 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.731169 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.731240 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.731310 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.731380 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.731495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.731645 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.731720 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.731790 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.731860 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.732000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.732093 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.732231 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.732318 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.732460 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.732538 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.732694 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.732771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.732921 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.733010 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.733161 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.733240 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.733395 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.733474 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.733645 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.733732 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.733876 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.733953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.734123 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.734202 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.734363 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.734449 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.734601 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.734678 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.734830 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] auth.external = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.734908 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.735059 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.735167 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.735338 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.735421 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.735572 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.735656 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.736368 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] auth.password = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.736457 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] auth.external = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.736648 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.736908 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] auth.token = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.736993 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.737117 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.737194 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.737320 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.737398 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] auth.password = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.737478 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.737608 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] auth.token = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.737688 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.737852 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.737931 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.738091 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.738178 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.738319 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.738405 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.738555 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] credential.caching = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.738642 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.738800 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.738889 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.739048 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.739130 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.739280 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.739357 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.739519 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] credential.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.739609 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.739760 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.739839 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.740016 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.740097 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.740262 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.740354 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.740512 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.740597 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.740746 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.740825 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.740982 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.741069 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.741232 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.741311 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.741488 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.741567 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.741728 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.741815 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.741975 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.742053 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.742231 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.742310 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.742464 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] federation.caching = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.742550 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.742698 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.742777 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.742941 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.743027 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.743187 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.743274 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.743416 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.743496 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] federation.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.743660 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.743739 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.743904 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.743997 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.744165 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.744244 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.744398 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.744476 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.744648 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.744727 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.744883 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.744964 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.745127 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.745206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.745358 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] identity.caching = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.745437 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.745602 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.745680 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.745839 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.745917 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.746060 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.746134 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.746289 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.746369 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.746535 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.746614 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.746765 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.746845 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.746999 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.747078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.747233 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.747312 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.747479 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.747559 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.747710 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.747789 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.747961 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.748044 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.748192 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.748281 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.748432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.748512 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.748678 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.748756 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.748908 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.748987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.749142 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.749223 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.749389 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.749468 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.749639 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.749719 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.749877 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.749955 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.750111 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.750190 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.750340 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.750420 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.750574 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.750653 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.750800 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.750879 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.751033 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.751113 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.751270 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.751348 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.752178 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.752412 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.752504 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.752579 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.752651 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.752722 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.752844 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.752974 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.753088 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.753221 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.753321 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.753475 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.753554 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.753710 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.753798 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.753963 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.754042 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.754215 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.754294 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.754448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.754535 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.754682 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.754764 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.754912 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.754991 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.755153 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.755266 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.755395 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.755504 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.755627 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.755743 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.755866 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.756027 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.756133 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.756253 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.756375 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.756483 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.756614 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.756715 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.756962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.757040 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.757208 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.757287 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.757442 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.757522 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.757674 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.757753 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.757909 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.757986 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.758135 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.user = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.758213 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.758371 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.758450 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.758626 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.758705 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.758856 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.758936 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.759094 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.759178 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.759329 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.759408 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.759571 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.759651 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.759802 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.759880 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.760055 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.760136 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.760289 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.760370 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.760521 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.760606 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.760756 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.760834 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.760984 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.761064 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.761230 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.761315 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.761467 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.761545 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.761706 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.761786 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.761946 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.762025 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.762180 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.762258 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.762406 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.762491 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.762650 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.762729 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.762886 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.762965 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.763119 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.763200 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.763354 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.763433 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.763587 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.763665 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.763829 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.763928 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.764097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.764177 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.764335 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.764412 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.764575 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.764655 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.764804 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.764882 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.765044 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.765123 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.765279 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.765359 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.765511 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.765590 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.765746 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.765824 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.765986 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.766066 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.766224 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.766302 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.766454 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.766532 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.766687 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.766767 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.766925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.767012 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] resource.caching = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.767225 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.767304 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.767473 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.767626 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.767705 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.767967 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.768050 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.768218 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.768310 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.768452 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.768532 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] resource.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.768695 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.768782 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.768949 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.769039 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.769165 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.769245 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.769396 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] role.caching = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.769475 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.769638 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] role.driver = sql {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.769791 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.769867 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.769939 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.770097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.770181 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.770343 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.770432 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.770601 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.770681 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.770828 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.770907 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] role.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.771072 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.771217 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] role.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.771293 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.771363 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.771540 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.771678 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.771783 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.771863 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.772036 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.772117 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.772281 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.772369 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.772523 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.772605 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.772766 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.772845 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.773007 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.773086 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.773255 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.773417 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.773498 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.773656 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.773736 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.773905 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.773992 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.774154 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.774234 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.774407 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.774486 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.774654 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.774826 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.774906 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.775066 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.775144 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.775317 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.775396 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.775569 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.775649 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.775799 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.775877 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.776052 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.776146 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.776280 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.776361 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.776529 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.776607 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.776781 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.776869 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.777025 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.777104 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.777256 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.777334 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.777487 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.777573 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.777715 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.777794 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.777949 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] token.caching = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.778028 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.778184 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.778274 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.778429 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.778508 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.778662 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.778741 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.778900 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.778985 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.779135 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.779214 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.779366 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.779444 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] token.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.779604 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.779690 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.779841 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.779967 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.780110 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.780187 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.780342 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.780432 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.780576 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.780656 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.780805 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.780884 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.781047 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.781134 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.781301 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.781379 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.781533 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.781619 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.781772 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.781852 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.782010 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.782089 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.782246 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.782324 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] database.connection = **** {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.782493 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.782571 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.782788 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.782911 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.783025 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.783238 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.783325 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.783480 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.783559 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.783714 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.783802 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.783967 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.784050 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.connection = **** {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.784207 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.784286 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.784449 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.784540 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.784681 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.784761 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.784920 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.784999 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.785152 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.785240 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.785396 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.785480 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.785627 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.785706 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.785864 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.785951 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.786088 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.786167 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.786323 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.786474 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.786577 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.786666 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.786741 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 25 13:10:47.786813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.787026 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.787264 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.787511 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.787744 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.788016 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.788255 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 13:10:47.788428 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 25 13:10:47.816886 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:47.817104 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:47.817326 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:47.817475 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:47.817710 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:47.817938 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:47.825595 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:47.826297 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:47.855869 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:47.856115 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:47.856617 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:47.856855 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:47.908498 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:47.910918 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:47.957268 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:47.957497 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:47.958147 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:47.958387 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.113983 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.114208 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.114307 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.114438 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.114545 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.114665 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.114749 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.114889 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.114971 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.115104 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.115198 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.115320 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.138610 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.138805 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.138897 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.139060 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.139144 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.139282 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.139363 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.139501 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.139590 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.139718 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.139799 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.139961 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.140043 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.140178 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.151563 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.152050 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.164927 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.165109 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.165334 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.165427 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.165556 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.165637 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.165774 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.165855 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.165990 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.166072 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.166204 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.166285 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.166427 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.166891 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 25 13:10:48.183260 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.183472 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 25 13:10:48.183582 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.183793 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 25 13:10:48.183874 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.184135 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 25 13:10:48.184215 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.184320 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.184402 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 25 13:10:48.184591 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.184680 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.184848 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.185112 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.185356 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.185435 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.185619 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.195454 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.195552 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.195731 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.195813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.196027 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.196124 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.196312 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.196394 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.203232 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 13:10:48.203313 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 13:10:48.206807 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 13:10:48.206931 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 13:10:48.207092 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.207177 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.207371 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.207453 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.207651 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.207735 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.207951 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.208035 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.208214 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.208310 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.208483 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.208565 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.208754 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.208835 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.209136 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.209218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.209411 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.209492 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.209680 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.209762 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.232298 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.232440 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.233742 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 13:10:48.233907 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 13:10:48.234026 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.234194 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.240433 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 13:10:48.240715 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.240801 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 13:10:48.240996 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.241092 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.241329 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.247386 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 13:10:48.247671 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.247751 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 13:10:48.248051 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.252373 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 13:10:48.252662 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.252943 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.253025 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 13:10:48.253224 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.253318 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.253494 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.253576 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.253776 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.253866 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.254052 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.254133 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.254331 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.254410 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.254627 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.254914 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.270517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.270794 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.271123 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.271404 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.274632 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 13:10:48.275297 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 13:10:48.277828 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.278124 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.278552 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.278853 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.282328 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 13:10:48.283110 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 13:10:48.285653 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 13:10:48.286302 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 13:10:48.288866 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.289165 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.289454 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.289535 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.289747 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.289829 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.290031 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.290112 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.290386 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.290467 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.290687 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.290974 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.306869 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 13:10:48.307154 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.307420 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.307683 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.307763 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 13:10:48.308036 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.308312 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.308581 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.314573 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.315830 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.316126 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.317401 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.317658 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.318024 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.318950 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.319245 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.320708 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 13:10:48.320977 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.321367 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.321656 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.321917 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 13:10:48.322011 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.322207 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.322606 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.322906 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.323200 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.333700 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 13:10:48.333984 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.334369 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.334652 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.334950 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.335131 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 13:10:48.335238 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.335427 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.335509 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.335812 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.336133 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.336443 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.336729 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.337012 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.351110 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 13:10:48.352815 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 13:10:48.354108 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 13:10:48.355731 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 13:10:48.357057 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.358503 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.358686 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.360128 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 13:10:48.360214 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.360422 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.360704 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.362273 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 13:10:48.362558 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.362847 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.367519 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.369016 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 13:10:48.369258 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.370731 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 13:10:48.371996 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.372288 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.372572 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.372850 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.373771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.374068 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.374359 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.374642 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.381234 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 13:10:48.381524 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.381805 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.383377 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 13:10:48.383675 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.383987 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.389551 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 13:10:48.389835 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.390114 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.390386 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.390657 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.390928 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.391200 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.391482 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.391815 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 25 13:10:48.391918 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.392162 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.392244 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.392435 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.392542 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.392831 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.392913 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.393101 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.393181 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.393361 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.393442 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.393646 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.393940 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.394228 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.394526 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.394842 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.395154 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.395427 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.395693 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 25 13:10:48.426924 dv-cinder-862432-2-smb devstack@keystone.service[81363]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564cfdc069c0 pid: 81363 (default app) Oct 25 13:10:48.429451 dv-cinder-862432-2-smb devstack@keystone.service[81362]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564cfdc069c0 pid: 81362 (default app) Oct 25 13:10:48.430128 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df2bc9-74ed-444e-904f-fa23500e96f1 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:10:48.430415 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df2bc9-74ed-444e-904f-fa23500e96f1 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:10:48.430689 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df2bc9-74ed-444e-904f-fa23500e96f1 None None] PATH_INFO: `/v3` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:10:48.434819 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 791 bytes} [Tue Oct 25 13:10:48 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:10:55.242780 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d120f-3f33-4f25-9598-4ad7f0ade923 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:10:55.243290 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d120f-3f33-4f25-9598-4ad7f0ade923 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:10:55.243393 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d120f-3f33-4f25-9598-4ad7f0ade923 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:10:55.247555 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1/2] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:10:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 13:10:55.253751 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d5697-ad0d-41d2-aa3d-dfda5f0cecea None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:10:55.254186 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d5697-ad0d-41d2-aa3d-dfda5f0cecea None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:10:55.254327 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d5697-ad0d-41d2-aa3d-dfda5f0cecea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:10:55.325647 dv-cinder-862432-2-smb devstack@keystone.service[81363]: INFO dbcounter [None req-e75d5697-ad0d-41d2-aa3d-dfda5f0cecea None None] Registered counter for database keystone Oct 25 13:10:55.345943 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG oslo_db.sqlalchemy.engines [None req-e75d5697-ad0d-41d2-aa3d-dfda5f0cecea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81363) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 25 13:10:55.352193 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writer thread running {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 25 13:10:55.530498 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG passlib.handlers.bcrypt [None req-e75d5697-ad0d-41d2-aa3d-dfda5f0cecea None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81363) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 25 13:10:55.530807 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG passlib.handlers.bcrypt [None req-e75d5697-ad0d-41d2-aa3d-dfda5f0cecea None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81363) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 25 13:10:55.588670 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-e75d5697-ad0d-41d2-aa3d-dfda5f0cecea None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:10:55.590264 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-e75d5697-ad0d-41d2-aa3d-dfda5f0cecea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:10:55.719096 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 2/3] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:10:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 25 13:10:56.182587 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d120f-3f33-4f25-9598-4ad7f0ade923 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:10:56.251767 dv-cinder-862432-2-smb devstack@keystone.service[81362]: INFO dbcounter [None req-a17d120f-3f33-4f25-9598-4ad7f0ade923 None None] Registered counter for database keystone Oct 25 13:10:56.273572 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG oslo_db.sqlalchemy.engines [None req-a17d120f-3f33-4f25-9598-4ad7f0ade923 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81362) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 25 13:10:56.279782 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writer thread running {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 25 13:10:56.398162 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d120f-3f33-4f25-9598-4ad7f0ade923 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:10:56.402626 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a3755-f3cb-4ec1-8de5-fa3aa90b866e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:10:56.403246 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a3755-f3cb-4ec1-8de5-fa3aa90b866e admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:10:56.403530 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a3755-f3cb-4ec1-8de5-fa3aa90b866e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:10:56.403803 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a3755-f3cb-4ec1-8de5-fa3aa90b866e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:10:56.412739 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a3755-f3cb-4ec1-8de5-fa3aa90b866e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:10:56.464497 dv-cinder-862432-2-smb devstack@keystone.service[81362]: WARNING keystone.common.rbac_enforcer.enforcer [None req-011a3755-f3cb-4ec1-8de5-fa3aa90b866e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 25 13:10:56.464783 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a3755-f3cb-4ec1-8de5-fa3aa90b866e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:10:56.474558 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 2/4] 10.222.0.25 () {58 vars in 1324 bytes} [Tue Oct 25 13:10:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 25 13:10:56.480541 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d5697-ad0d-41d2-aa3d-dfda5f0cecea None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:10:56.497979 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d5697-ad0d-41d2-aa3d-dfda5f0cecea None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:10:56.503493 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6601d7-0b15-40ec-acd2-899894f26f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:10:56.504624 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6601d7-0b15-40ec-acd2-899894f26f2a admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:10:56.504906 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6601d7-0b15-40ec-acd2-899894f26f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:10:56.505176 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6601d7-0b15-40ec-acd2-899894f26f2a admin admin] PATH_INFO: `/v3/projects/9835e5a39eb74917a1e872356cdbdeb5` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:10:56.508959 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6601d7-0b15-40ec-acd2-899894f26f2a admin admin] RBAC: Authorizing `identity:get_project(project_id=9835e5a39eb74917a1e872356cdbdeb5)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:10:56.560606 dv-cinder-862432-2-smb devstack@keystone.service[81363]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ec6601d7-0b15-40ec-acd2-899894f26f2a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 25 13:10:56.560950 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6601d7-0b15-40ec-acd2-899894f26f2a admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:10:56.566437 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 3/5] 10.222.0.25 () {56 vars in 1207 bytes} [Tue Oct 25 13:10:56 2022] GET /identity/v3/projects/9835e5a39eb74917a1e872356cdbdeb5 => generated 344 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:10:58.683119 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818118c4-27e5-495d-97ab-80fcd3ac493c None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:10:58.683632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818118c4-27e5-495d-97ab-80fcd3ac493c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:10:58.683717 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818118c4-27e5-495d-97ab-80fcd3ac493c None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:10:58.687708 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 3/6] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:10:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:10:58.693555 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a7b89-3920-4907-809c-b7e6177a3fab None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:10:58.693968 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a7b89-3920-4907-809c-b7e6177a3fab None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:10:58.694096 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a7b89-3920-4907-809c-b7e6177a3fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:10:58.715094 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-944a7b89-3920-4907-809c-b7e6177a3fab None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:10:58.716681 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-944a7b89-3920-4907-809c-b7e6177a3fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:10:58.724492 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 4/7] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:10:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 25 13:10:58.994067 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818118c4-27e5-495d-97ab-80fcd3ac493c None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:10:59.006782 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818118c4-27e5-495d-97ab-80fcd3ac493c None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:10:59.010909 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440df7e-e162-48df-90c9-8bf17eb938ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:10:59.011504 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440df7e-e162-48df-90c9-8bf17eb938ed admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:10:59.011782 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440df7e-e162-48df-90c9-8bf17eb938ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:10:59.012097 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440df7e-e162-48df-90c9-8bf17eb938ed admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:10:59.020591 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f440df7e-e162-48df-90c9-8bf17eb938ed admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:10:59.022344 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f440df7e-e162-48df-90c9-8bf17eb938ed admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:10:59.030793 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 4/8] 10.222.0.25 () {58 vars in 1324 bytes} [Tue Oct 25 13:10:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 25 13:10:59.036322 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a7b89-3920-4907-809c-b7e6177a3fab None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:10:59.045594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a7b89-3920-4907-809c-b7e6177a3fab None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:10:59.049969 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d0a34-92c7-447e-aae9-77f88cbe0d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:10:59.050591 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d0a34-92c7-447e-aae9-77f88cbe0d88 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:10:59.050872 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d0a34-92c7-447e-aae9-77f88cbe0d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:10:59.051150 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d0a34-92c7-447e-aae9-77f88cbe0d88 admin admin] PATH_INFO: `/v3/users/297f37c6bdb6496db9bb50ba9e5abd95` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:10:59.052492 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d0a34-92c7-447e-aae9-77f88cbe0d88 admin admin] RBAC: Authorizing `identity:get_user(user_id=297f37c6bdb6496db9bb50ba9e5abd95)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:10:59.054344 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d0a34-92c7-447e-aae9-77f88cbe0d88 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:10:59.055849 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 5/9] 10.222.0.25 () {56 vars in 1198 bytes} [Tue Oct 25 13:10:59 2022] GET /identity/v3/users/297f37c6bdb6496db9bb50ba9e5abd95 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:01.288758 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83fc236-1f1f-4c75-912c-5b7b93e421ab None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:01.289327 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83fc236-1f1f-4c75-912c-5b7b93e421ab None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:01.289327 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83fc236-1f1f-4c75-912c-5b7b93e421ab None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:01.290636 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 5/10] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:01.296207 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad3ef4-fc75-4959-b3fd-1512e29adddf None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:01.296638 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad3ef4-fc75-4959-b3fd-1512e29adddf None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:01.296763 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad3ef4-fc75-4959-b3fd-1512e29adddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:01.308147 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389f799-94fc-4cac-80b7-fca412e8d03a None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:01.308429 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389f799-94fc-4cac-80b7-fca412e8d03a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:01.308701 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389f799-94fc-4cac-80b7-fca412e8d03a None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:01.309986 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 6/11] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 13:11:01.315472 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa904c-eb9d-490f-be68-f6074bec4858 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:01.315758 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa904c-eb9d-490f-be68-f6074bec4858 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:01.316069 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa904c-eb9d-490f-be68-f6074bec4858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:01.316167 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-8fad3ef4-fc75-4959-b3fd-1512e29adddf None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:01.317267 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-8fad3ef4-fc75-4959-b3fd-1512e29adddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:01.357926 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG passlib.handlers.bcrypt [None req-87aa904c-eb9d-490f-be68-f6074bec4858 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81362) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 25 13:11:01.358318 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG passlib.handlers.bcrypt [None req-87aa904c-eb9d-490f-be68-f6074bec4858 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81362) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 25 13:11:01.398928 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 6/12] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 25 13:11:01.409430 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-87aa904c-eb9d-490f-be68-f6074bec4858 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:01.411023 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-87aa904c-eb9d-490f-be68-f6074bec4858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:01.511387 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 7/13] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 25 13:11:01.673515 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad3ef4-fc75-4959-b3fd-1512e29adddf None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:01.697108 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:01.779455 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad3ef4-fc75-4959-b3fd-1512e29adddf None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:01.785238 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa904c-eb9d-490f-be68-f6074bec4858 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:01.814337 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b24f9d-8a13-4e37-a322-16fb20612de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:01.814967 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b24f9d-8a13-4e37-a322-16fb20612de4 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:01.815249 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b24f9d-8a13-4e37-a322-16fb20612de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:01.815528 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b24f9d-8a13-4e37-a322-16fb20612de4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:01.826540 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b24f9d-8a13-4e37-a322-16fb20612de4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:11:01.835517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-32b24f9d-8a13-4e37-a322-16fb20612de4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 13:11:01.835517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:11:01.835517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:11:01.835517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:11:01.835517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:11:01.835517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:11:01.835517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:11:01.835517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:11:01.835517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:11:01.835517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:11:01.835517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:11:01.835517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:11:01.835517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:11:01.835517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:11:01.835517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:11:01.835517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:11:01.836594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:11:01.836594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:11:01.836594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:11:01.836594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:11:01.836594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:11:01.836594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:11:01.836594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:11:01.836594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:11:01.836594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:11:01.836594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:11:01.836594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:11:01.836594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:11:01.836594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:11:01.836594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:11:01.836594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:11:01.836594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:11:01.837815 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:11:01.837815 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:11:01.837815 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:11:01.837815 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:11:01.837815 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:11:01.837815 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:11:01.837815 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:11:01.837815 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:11:01.837815 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:11:01.837815 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:11:01.837815 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 13:11:01.837815 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:11:01.837815 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 7/14] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 25 13:11:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:11:01.842392 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b24f9d-8a13-4e37-a322-16fb20612de4 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:01.887288 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa904c-eb9d-490f-be68-f6074bec4858 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:01.889563 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:01.923470 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:01.926730 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee8394-61ba-417a-86ac-685cc59e950c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:01.927550 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee8394-61ba-417a-86ac-685cc59e950c None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:01.927833 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee8394-61ba-417a-86ac-685cc59e950c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:01.928132 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee8394-61ba-417a-86ac-685cc59e950c None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:01.929099 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ee8394-61ba-417a-86ac-685cc59e950c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:01.930531 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ee8394-61ba-417a-86ac-685cc59e950c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:01.942460 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.sql.core [None req-c3ee8394-61ba-417a-86ac-685cc59e950c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 25 13:11:01.942460 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 25 13:11:01.942460 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [parameters: {'id': '5145bd7ab58b4f4ba7f8c7be2b289b88', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 25 13:11:01.942460 dv-cinder-862432-2-smb devstack@keystone.service[81362]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81362) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 25 13:11:01.942821 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b24f9d-8a13-4e37-a322-16fb20612de4 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:01.961816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-c3ee8394-61ba-417a-86ac-685cc59e950c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 25 13:11:01.961816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:11:01.961816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 25 13:11:01.961816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 25 13:11:01.961816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 25 13:11:01.961816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 25 13:11:01.961816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 25 13:11:01.961816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application result = self._query(query) Oct 25 13:11:01.961816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 25 13:11:01.961816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application conn.query(q) Oct 25 13:11:01.961816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 25 13:11:01.961816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 25 13:11:01.961816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 25 13:11:01.961816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application result.read() Oct 25 13:11:01.962784 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 25 13:11:01.962784 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 25 13:11:01.962784 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 25 13:11:01.962784 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 25 13:11:01.962784 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 25 13:11:01.962784 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 25 13:11:01.962784 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 25 13:11:01.962784 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 25 13:11:01.962784 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 25 13:11:01.962784 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:11:01.962784 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 25 13:11:01.962784 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:11:01.962784 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:11:01.962784 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 25 13:11:01.962784 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 25 13:11:01.962784 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 25 13:11:01.962784 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 25 13:11:01.962784 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 25 13:11:01.963739 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application next(self.gen) Oct 25 13:11:01.963739 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 25 13:11:01.963739 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application yield resource Oct 25 13:11:01.963739 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 25 13:11:01.963739 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application next(self.gen) Oct 25 13:11:01.963739 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 25 13:11:01.963739 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self.session.rollback() Oct 25 13:11:01.963739 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 13:11:01.963739 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self.force_reraise() Oct 25 13:11:01.963739 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 13:11:01.963739 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise self.value Oct 25 13:11:01.963739 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 25 13:11:01.963739 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 25 13:11:01.963739 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 25 13:11:01.963739 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application session.commit() Oct 25 13:11:01.963739 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 25 13:11:01.963739 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 25 13:11:01.964659 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 25 13:11:01.964659 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._prepare_impl() Oct 25 13:11:01.964659 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 25 13:11:01.964659 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self.session.flush() Oct 25 13:11:01.964659 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 25 13:11:01.964659 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._flush(objects) Oct 25 13:11:01.964659 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 25 13:11:01.964659 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 25 13:11:01.964659 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 25 13:11:01.964659 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application compat.raise_( Oct 25 13:11:01.964659 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 25 13:11:01.964659 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception Oct 25 13:11:01.964659 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 25 13:11:01.964659 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application flush_context.execute() Oct 25 13:11:01.964659 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 25 13:11:01.964659 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rec.execute(self) Oct 25 13:11:01.964659 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 25 13:11:01.965593 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 25 13:11:01.965593 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 25 13:11:01.965593 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 25 13:11:01.965593 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 25 13:11:01.965593 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 25 13:11:01.965593 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 25 13:11:01.965593 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 25 13:11:01.965593 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 25 13:11:01.965593 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 25 13:11:01.965593 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 25 13:11:01.965593 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 25 13:11:01.965593 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 25 13:11:01.965593 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 25 13:11:01.965593 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 25 13:11:01.965593 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 25 13:11:01.966357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 25 13:11:01.966357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception Oct 25 13:11:01.966357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 25 13:11:01.966357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 25 13:11:01.966357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 25 13:11:01.966357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 25 13:11:01.966357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 25 13:11:01.966357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application result = self._query(query) Oct 25 13:11:01.966357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 25 13:11:01.966357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application conn.query(q) Oct 25 13:11:01.966357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 25 13:11:01.966357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 25 13:11:01.966357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 25 13:11:01.966357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application result.read() Oct 25 13:11:01.966357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 25 13:11:01.966357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 25 13:11:01.966357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 25 13:11:01.967162 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 25 13:11:01.967162 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 25 13:11:01.967162 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 25 13:11:01.967162 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 25 13:11:01.967162 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 25 13:11:01.967162 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 25 13:11:01.967162 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 25 13:11:01.967162 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [parameters: {'id': '5145bd7ab58b4f4ba7f8c7be2b289b88', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 25 13:11:01.967162 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 25 13:11:01.967162 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:11:01.967162 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 13:11:01.967162 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:11:01.967162 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:11:01.967162 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 25 13:11:01.967162 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 25 13:11:01.968379 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 25 13:11:01.968379 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 25 13:11:01.968379 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 25 13:11:01.968379 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:11:01.968379 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 13:11:01.968379 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:11:01.968379 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:11:01.968379 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:11:01.968379 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:11:01.968379 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:11:01.968379 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:11:01.968379 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:11:01.968379 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:11:01.968379 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:11:01.968379 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:11:01.968379 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:11:01.968379 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:11:01.969212 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 25 13:11:01.969212 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 25 13:11:01.969212 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:11:01.969212 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:11:01.969212 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 25 13:11:01.969212 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 25 13:11:01.969212 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:11:01.969212 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:11:01.969212 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 25 13:11:01.969212 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 25 13:11:01.969212 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 25 13:11:01.969212 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:11:01.969212 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 8/15] 10.222.0.25 () {60 vars in 1137 bytes} [Tue Oct 25 13:11:01 2022] POST /identity/v3/domains => generated 190 bytes in 178 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 25 13:11:01.969212 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee8394-61ba-417a-86ac-685cc59e950c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:01.977726 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8228fceb-9a1f-49ca-90c6-f13e473f1507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:01.978337 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228fceb-9a1f-49ca-90c6-f13e473f1507 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:01.978617 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228fceb-9a1f-49ca-90c6-f13e473f1507 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:01.978891 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228fceb-9a1f-49ca-90c6-f13e473f1507 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:01.979562 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8228fceb-9a1f-49ca-90c6-f13e473f1507 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:01.979859 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8228fceb-9a1f-49ca-90c6-f13e473f1507 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:01.981292 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8228fceb-9a1f-49ca-90c6-f13e473f1507 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:01.992954 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 8/16] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 25 13:11:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:11:01.998394 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8228fceb-9a1f-49ca-90c6-f13e473f1507 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:02.069620 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee8394-61ba-417a-86ac-685cc59e950c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:02.095972 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8228fceb-9a1f-49ca-90c6-f13e473f1507 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:02.102828 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9e00b-4818-4749-b405-b79b2c5ef678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:02.103671 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9e00b-4818-4749-b405-b79b2c5ef678 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:02.103980 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9e00b-4818-4749-b405-b79b2c5ef678 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:02.104378 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9e00b-4818-4749-b405-b79b2c5ef678 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:02.122194 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff9e00b-4818-4749-b405-b79b2c5ef678 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:02.123657 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff9e00b-4818-4749-b405-b79b2c5ef678 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:02.129870 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc0b562-4128-48a1-933a-cbbef7d523a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:02.130493 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0b562-4128-48a1-933a-cbbef7d523a4 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:02.130776 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0b562-4128-48a1-933a-cbbef7d523a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:02.131053 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0b562-4128-48a1-933a-cbbef7d523a4 None admin] PATH_INFO: `/v3/users/297f37c6bdb6496db9bb50ba9e5abd95` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:02.132228 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc0b562-4128-48a1-933a-cbbef7d523a4 None admin] RBAC: Authorizing `identity:get_user(user_id=297f37c6bdb6496db9bb50ba9e5abd95)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:02.133699 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc0b562-4128-48a1-933a-cbbef7d523a4 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:02.135255 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 9/17] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 25 13:11:01 2022] GET /identity/v3/users/297f37c6bdb6496db9bb50ba9e5abd95 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:11:02.140447 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-7ff9e00b-4818-4749-b405-b79b2c5ef678 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:11:02.140447 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:11:02.140447 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:11:02.140447 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:11:02.140447 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:11:02.140447 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:11:02.140447 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:11:02.140447 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:11:02.140447 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:11:02.140447 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:11:02.140447 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:11:02.140447 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:11:02.140447 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:11:02.140447 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:11:02.140447 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:11:02.140447 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:11:02.141284 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:11:02.141284 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:11:02.141284 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:11:02.141284 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:11:02.141284 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:11:02.141284 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:11:02.141284 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:11:02.141284 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:11:02.141284 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:11:02.141284 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:11:02.141284 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:11:02.141284 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:11:02.141284 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:11:02.141284 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:11:02.141284 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:11:02.141284 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:11:02.141284 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:11:02.142889 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:11:02.142889 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:11:02.142889 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:11:02.143091 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc0b562-4128-48a1-933a-cbbef7d523a4 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:02.143175 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 9/18] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:11:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 13:11:02.147396 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9e00b-4818-4749-b405-b79b2c5ef678 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:02.159346 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:02.175296 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:02.246748 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc0b562-4128-48a1-933a-cbbef7d523a4 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:02.252510 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9e00b-4818-4749-b405-b79b2c5ef678 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:02.280303 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d399a8-2c82-47a7-8033-1ba62d1fb871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:02.280930 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d399a8-2c82-47a7-8033-1ba62d1fb871 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:02.281203 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d399a8-2c82-47a7-8033-1ba62d1fb871 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:02.281471 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d399a8-2c82-47a7-8033-1ba62d1fb871 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:02.283182 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d399a8-2c82-47a7-8033-1ba62d1fb871 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:02.284649 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d399a8-2c82-47a7-8033-1ba62d1fb871 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:02.286168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 10/19] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:11:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:11:02.286714 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed88f4-d2e5-44cc-b0ea-13a2afaeec1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:02.287324 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed88f4-d2e5-44cc-b0ea-13a2afaeec1a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:02.287608 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed88f4-d2e5-44cc-b0ea-13a2afaeec1a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:02.287884 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed88f4-d2e5-44cc-b0ea-13a2afaeec1a None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:02.288551 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed88f4-d2e5-44cc-b0ea-13a2afaeec1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:02.288857 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed88f4-d2e5-44cc-b0ea-13a2afaeec1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:02.290227 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed88f4-d2e5-44cc-b0ea-13a2afaeec1a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:02.292193 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d399a8-2c82-47a7-8033-1ba62d1fb871 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:02.309273 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 10/20] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:11:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:11:02.380896 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:02.402290 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d399a8-2c82-47a7-8033-1ba62d1fb871 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:02.441770 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24619df9-f08e-407c-a9aa-dd200a83523b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:02.442448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24619df9-f08e-407c-a9aa-dd200a83523b None admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:02.442728 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24619df9-f08e-407c-a9aa-dd200a83523b None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:02.443004 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24619df9-f08e-407c-a9aa-dd200a83523b None admin] PATH_INFO: `/v3/domains/default/users/297f37c6bdb6496db9bb50ba9e5abd95/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:02.445055 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24619df9-f08e-407c-a9aa-dd200a83523b None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=297f37c6bdb6496db9bb50ba9e5abd95, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:02.446517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24619df9-f08e-407c-a9aa-dd200a83523b None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:02.562787 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 11/21] 10.222.0.25 () {58 vars in 1361 bytes} [Tue Oct 25 13:11:02 2022] PUT /identity/v3/domains/default/users/297f37c6bdb6496db9bb50ba9e5abd95/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:11:04.877437 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f201ee-39c3-4fed-9bc3-6fbd5a57371a None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:04.878464 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f201ee-39c3-4fed-9bc3-6fbd5a57371a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:04.878974 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f201ee-39c3-4fed-9bc3-6fbd5a57371a None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:04.880858 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 11/22] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:04.886606 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65695b7-039d-4ea8-b27c-b61c3845c305 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:04.887455 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65695b7-039d-4ea8-b27c-b61c3845c305 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:04.888000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65695b7-039d-4ea8-b27c-b61c3845c305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:04.913327 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-c65695b7-039d-4ea8-b27c-b61c3845c305 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:04.915222 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c65695b7-039d-4ea8-b27c-b61c3845c305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:05.009605 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 12/23] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 25 13:11:05.143314 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672cbd9-0966-4295-8319-dd392c5f35d3 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:05.143971 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672cbd9-0966-4295-8319-dd392c5f35d3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:05.144474 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672cbd9-0966-4295-8319-dd392c5f35d3 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:05.146328 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 12/24] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:05.151656 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1e688-e176-403e-90e2-b3167084571a None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:05.152258 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1e688-e176-403e-90e2-b3167084571a None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:05.152737 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1e688-e176-403e-90e2-b3167084571a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:05.174298 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-3df1e688-e176-403e-90e2-b3167084571a None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:05.175837 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-3df1e688-e176-403e-90e2-b3167084571a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:05.263643 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:05.269977 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 13/25] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:11:05.437565 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672cbd9-0966-4295-8319-dd392c5f35d3 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:05.540754 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:05.572379 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672cbd9-0966-4295-8319-dd392c5f35d3 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:05.619868 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f20d5-6519-4239-88de-0f22a61b57e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:05.620895 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f20d5-6519-4239-88de-0f22a61b57e5 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:05.621414 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f20d5-6519-4239-88de-0f22a61b57e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:05.621890 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f20d5-6519-4239-88de-0f22a61b57e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:05.624324 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1e688-e176-403e-90e2-b3167084571a None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:05.659301 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f20d5-6519-4239-88de-0f22a61b57e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:05.661173 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f20d5-6519-4239-88de-0f22a61b57e5 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:05.689658 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-c47f20d5-6519-4239-88de-0f22a61b57e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:11:05.689658 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:11:05.689658 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:11:05.689658 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:11:05.689658 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:11:05.689658 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:11:05.689658 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:11:05.689658 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:11:05.689658 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:11:05.689658 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:11:05.689658 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:11:05.689658 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:11:05.689658 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:11:05.689658 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:11:05.689658 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:11:05.689658 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:11:05.690562 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:11:05.690562 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:11:05.690562 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:11:05.690562 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:11:05.690562 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:11:05.690562 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:11:05.690562 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:11:05.690562 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:11:05.690562 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:11:05.690562 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:11:05.690562 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:11:05.690562 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:11:05.690562 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:11:05.690562 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:11:05.690562 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:11:05.690562 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:11:05.690562 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:11:05.691360 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:11:05.691360 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:11:05.691360 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:11:05.693175 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 13/26] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:11:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:11:05.699918 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ccbf8-95e7-4877-b300-3172990a9607 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:05.699918 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ccbf8-95e7-4877-b300-3172990a9607 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:05.699918 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ccbf8-95e7-4877-b300-3172990a9607 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:05.699918 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 14/27] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:05.701759 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ccbf8-95e7-4877-b300-3172990a9607 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:05.796476 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1e688-e176-403e-90e2-b3167084571a None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:05.840946 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ccbf8-95e7-4877-b300-3172990a9607 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:05.842087 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebb898-a806-42db-b9ff-51ccc0dae1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:05.843076 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebb898-a806-42db-b9ff-51ccc0dae1b4 None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:05.844305 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebb898-a806-42db-b9ff-51ccc0dae1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:05.844567 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebb898-a806-42db-b9ff-51ccc0dae1b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:05.848689 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abebb898-a806-42db-b9ff-51ccc0dae1b4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:05.850975 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abebb898-a806-42db-b9ff-51ccc0dae1b4 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:05.877228 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 14/28] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Oct 25 13:11:05 2022] POST /identity/v3/roles => generated 219 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:11:05.878862 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac74b9-a146-421b-8172-834bcd14904c None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:05.879369 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac74b9-a146-421b-8172-834bcd14904c None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:05.879869 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac74b9-a146-421b-8172-834bcd14904c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:05.884187 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:05.892329 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc70d72-45a6-4e0d-8f49-fe0016a1ef27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:05.893403 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc70d72-45a6-4e0d-8f49-fe0016a1ef27 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:05.894100 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc70d72-45a6-4e0d-8f49-fe0016a1ef27 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:05.894395 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc70d72-45a6-4e0d-8f49-fe0016a1ef27 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:05.895051 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc70d72-45a6-4e0d-8f49-fe0016a1ef27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:05.895411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc70d72-45a6-4e0d-8f49-fe0016a1ef27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:05.896917 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc70d72-45a6-4e0d-8f49-fe0016a1ef27 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:05.904292 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-feac74b9-a146-421b-8172-834bcd14904c None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:05.907088 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-feac74b9-a146-421b-8172-834bcd14904c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:05.924407 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 15/29] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:05.926114 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131cdeb-5184-4905-8142-50982d807646 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:05.928245 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131cdeb-5184-4905-8142-50982d807646 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:05.929098 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131cdeb-5184-4905-8142-50982d807646 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:05.933992 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 16/30] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:05.935283 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131cdeb-5184-4905-8142-50982d807646 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:06.024649 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:06.038859 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 15/31] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:11:06.040847 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a670b08-a603-41bc-8c38-1052f96cee19 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:06.041523 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a670b08-a603-41bc-8c38-1052f96cee19 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:06.042253 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a670b08-a603-41bc-8c38-1052f96cee19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:06.064120 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-6a670b08-a603-41bc-8c38-1052f96cee19 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:06.066310 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-6a670b08-a603-41bc-8c38-1052f96cee19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:06.151924 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 16/32] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:11:06.163222 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131cdeb-5184-4905-8142-50982d807646 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:06.210951 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071d183-eda0-4968-b0a0-c636741ef75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:06.211924 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071d183-eda0-4968-b0a0-c636741ef75c None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:06.212433 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071d183-eda0-4968-b0a0-c636741ef75c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:06.212906 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071d183-eda0-4968-b0a0-c636741ef75c None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:06.213764 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071d183-eda0-4968-b0a0-c636741ef75c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:06.215441 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071d183-eda0-4968-b0a0-c636741ef75c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:06.362180 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 17/33] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Oct 25 13:11:05 2022] POST /identity/v3/projects => generated 301 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:11:06.515542 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a670b08-a603-41bc-8c38-1052f96cee19 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:06.526286 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071d183-eda0-4968-b0a0-c636741ef75c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:06.603426 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:06.662472 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a670b08-a603-41bc-8c38-1052f96cee19 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:06.677025 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071d183-eda0-4968-b0a0-c636741ef75c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:06.693856 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:06.709011 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455aefc5-9f03-44ed-b0fb-fab0f8015154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:06.709624 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455aefc5-9f03-44ed-b0fb-fab0f8015154 None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:06.709905 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455aefc5-9f03-44ed-b0fb-fab0f8015154 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:06.710184 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455aefc5-9f03-44ed-b0fb-fab0f8015154 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:06.710861 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455aefc5-9f03-44ed-b0fb-fab0f8015154 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:06.712285 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455aefc5-9f03-44ed-b0fb-fab0f8015154 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:06.714760 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5b116-a524-4947-9852-df5db1edd6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:06.715409 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5b116-a524-4947-9852-df5db1edd6d2 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:06.715701 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5b116-a524-4947-9852-df5db1edd6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:06.716010 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5b116-a524-4947-9852-df5db1edd6d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:06.728454 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 17/34] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Oct 25 13:11:06 2022] POST /identity/v3/roles => generated 225 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:11:06.729697 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39aeda4-c70b-4c35-8a55-a32c771f2685 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:06.729986 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39aeda4-c70b-4c35-8a55-a32c771f2685 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:06.730277 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39aeda4-c70b-4c35-8a55-a32c771f2685 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:06.730442 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb5b116-a524-4947-9852-df5db1edd6d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:11:06.731477 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 18/35] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:06.732571 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b213150-7369-422a-aa20-15831a527bac None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:06.732857 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b213150-7369-422a-aa20-15831a527bac None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:06.733133 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b213150-7369-422a-aa20-15831a527bac None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:06.734405 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 19/36] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:06.737160 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0f081-04f2-4e0e-aaf1-041c9fb4dca8 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:06.737488 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0f081-04f2-4e0e-aaf1-041c9fb4dca8 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:06.737771 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0f081-04f2-4e0e-aaf1-041c9fb4dca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:06.739587 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-bbb5b116-a524-4947-9852-df5db1edd6d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 13:11:06.739587 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:11:06.739587 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:11:06.739587 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:11:06.739587 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:11:06.739587 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:11:06.739587 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:11:06.739587 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:11:06.739587 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:11:06.739587 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:11:06.739587 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:11:06.739587 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:11:06.739587 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:11:06.739587 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:11:06.739587 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:11:06.739587 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:11:06.740457 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:11:06.740457 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:11:06.740457 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:11:06.740457 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:11:06.740457 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:11:06.740457 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:11:06.740457 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:11:06.740457 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:11:06.740457 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:11:06.740457 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:11:06.740457 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:11:06.740457 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:11:06.740457 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:11:06.740457 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:11:06.740457 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:11:06.740457 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:11:06.741233 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:11:06.741233 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:11:06.741233 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:11:06.741233 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:11:06.741233 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:11:06.741233 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:11:06.741233 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:11:06.741233 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:11:06.741233 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:11:06.741233 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:11:06.741233 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 13:11:06.741233 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:11:06.743176 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 18/37] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 25 13:11:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:11:06.744804 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38dee62-bc3c-4a33-925e-1b488094741d None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:06.745235 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38dee62-bc3c-4a33-925e-1b488094741d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:06.745647 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38dee62-bc3c-4a33-925e-1b488094741d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:06.758285 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-e1f0f081-04f2-4e0e-aaf1-041c9fb4dca8 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:06.759533 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-e1f0f081-04f2-4e0e-aaf1-041c9fb4dca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:06.765547 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-b38dee62-bc3c-4a33-925e-1b488094741d None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:06.768343 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b38dee62-bc3c-4a33-925e-1b488094741d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:06.839198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 20/38] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 25 13:11:06.840608 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0f081-04f2-4e0e-aaf1-041c9fb4dca8 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:06.860154 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 19/39] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:11:06.974433 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0f081-04f2-4e0e-aaf1-041c9fb4dca8 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:06.987284 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:07.013337 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729919ca-06b7-4482-8e08-08d577aa8bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:07.013975 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729919ca-06b7-4482-8e08-08d577aa8bc5 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:07.014258 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729919ca-06b7-4482-8e08-08d577aa8bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:07.014535 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729919ca-06b7-4482-8e08-08d577aa8bc5 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:07.015202 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729919ca-06b7-4482-8e08-08d577aa8bc5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:07.015506 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729919ca-06b7-4482-8e08-08d577aa8bc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:07.017504 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729919ca-06b7-4482-8e08-08d577aa8bc5 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:07.025911 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 21/40] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 25 13:11:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:07.031676 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38dee62-bc3c-4a33-925e-1b488094741d None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:07.068565 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:07.128383 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729919ca-06b7-4482-8e08-08d577aa8bc5 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:07.139870 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38dee62-bc3c-4a33-925e-1b488094741d None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:07.178621 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d64730-4c5c-4d1d-8ddd-eb1f09b0b1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:07.179249 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d64730-4c5c-4d1d-8ddd-eb1f09b0b1e0 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:07.179531 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d64730-4c5c-4d1d-8ddd-eb1f09b0b1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:07.179868 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d64730-4c5c-4d1d-8ddd-eb1f09b0b1e0 None admin] PATH_INFO: `/v3/users/297f37c6bdb6496db9bb50ba9e5abd95` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:07.181164 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d64730-4c5c-4d1d-8ddd-eb1f09b0b1e0 None admin] RBAC: Authorizing `identity:get_user(user_id=297f37c6bdb6496db9bb50ba9e5abd95)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:07.182725 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d64730-4c5c-4d1d-8ddd-eb1f09b0b1e0 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:07.184326 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 20/41] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 25 13:11:07 2022] GET /identity/v3/users/297f37c6bdb6496db9bb50ba9e5abd95 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:11:07.185079 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d64730-4c5c-4d1d-8ddd-eb1f09b0b1e0 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:07.290214 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d64730-4c5c-4d1d-8ddd-eb1f09b0b1e0 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:07.292124 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:07.327289 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e49b54b-582d-48e4-b047-1aa9c3280c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:07.327951 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49b54b-582d-48e4-b047-1aa9c3280c62 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:07.328243 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49b54b-582d-48e4-b047-1aa9c3280c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:07.328525 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49b54b-582d-48e4-b047-1aa9c3280c62 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:07.330313 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e49b54b-582d-48e4-b047-1aa9c3280c62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:07.331764 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e49b54b-582d-48e4-b047-1aa9c3280c62 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:07.333365 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 21/42] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:11:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:07.334133 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e49b54b-582d-48e4-b047-1aa9c3280c62 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:07.344462 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729919ca-06b7-4482-8e08-08d577aa8bc5 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:07.378611 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4eed4-ed9f-4359-a0f0-f887d67ffa86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:07.379214 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4eed4-ed9f-4359-a0f0-f887d67ffa86 None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:07.379494 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4eed4-ed9f-4359-a0f0-f887d67ffa86 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:07.379771 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4eed4-ed9f-4359-a0f0-f887d67ffa86 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:07.380464 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4eed4-ed9f-4359-a0f0-f887d67ffa86 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:07.381831 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4eed4-ed9f-4359-a0f0-f887d67ffa86 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:07.395807 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 22/43] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Oct 25 13:11:07 2022] POST /identity/v3/roles => generated 223 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:11:07.404961 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4eed4-ed9f-4359-a0f0-f887d67ffa86 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:07.442385 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e49b54b-582d-48e4-b047-1aa9c3280c62 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:07.446813 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:07.483026 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304ae53-fae6-4867-9251-63566844fad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:07.483996 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304ae53-fae6-4867-9251-63566844fad7 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:07.484282 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304ae53-fae6-4867-9251-63566844fad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:07.484559 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304ae53-fae6-4867-9251-63566844fad7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:07.486441 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3304ae53-fae6-4867-9251-63566844fad7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:07.487973 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3304ae53-fae6-4867-9251-63566844fad7 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:07.494519 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 22/44] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:11:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:07.495665 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304ae53-fae6-4867-9251-63566844fad7 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:07.532755 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4eed4-ed9f-4359-a0f0-f887d67ffa86 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:07.544778 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:07.577658 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e819e5-3011-49c6-96b9-e3ab0781b4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:07.579558 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e819e5-3011-49c6-96b9-e3ab0781b4dc None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:07.579558 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e819e5-3011-49c6-96b9-e3ab0781b4dc None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:07.579558 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e819e5-3011-49c6-96b9-e3ab0781b4dc None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:07.580037 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e819e5-3011-49c6-96b9-e3ab0781b4dc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:07.582191 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e819e5-3011-49c6-96b9-e3ab0781b4dc None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:07.615370 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 23/45] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Oct 25 13:11:07 2022] POST /identity/v3/projects => generated 312 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:11:07.618518 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304ae53-fae6-4867-9251-63566844fad7 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:07.659996 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9510b-0536-4e75-b73a-03d55d5f6f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:07.660619 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9510b-0536-4e75-b73a-03d55d5f6f17 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:07.660903 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9510b-0536-4e75-b73a-03d55d5f6f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:07.661187 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9510b-0536-4e75-b73a-03d55d5f6f17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:07.661923 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f9510b-0536-4e75-b73a-03d55d5f6f17 None admin] RBAC: Adding query filter params (role.id=4c7114fda3ec4652abed55516b5f4315, scope.domain.id=default, user.id=297f37c6bdb6496db9bb50ba9e5abd95) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:07.662233 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f9510b-0536-4e75-b73a-03d55d5f6f17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:07.663704 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f9510b-0536-4e75-b73a-03d55d5f6f17 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:07.674955 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 23/46] 10.222.0.25 () {56 vars in 1322 bytes} [Tue Oct 25 13:11:07 2022] GET /identity/v3/role_assignments?user.id=297f37c6bdb6496db9bb50ba9e5abd95&scope.domain.id=default&role.id=4c7114fda3ec4652abed55516b5f4315 => generated 530 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:11:09.778057 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf57c2-618f-4a62-8246-ccfbc381af61 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:09.778497 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf57c2-618f-4a62-8246-ccfbc381af61 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:09.778600 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf57c2-618f-4a62-8246-ccfbc381af61 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:09.779984 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 24/47] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:09.785195 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305fc3f-3c36-46e8-808e-28dc4d53be17 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:09.785602 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305fc3f-3c36-46e8-808e-28dc4d53be17 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:09.785761 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305fc3f-3c36-46e8-808e-28dc4d53be17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:09.804666 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-7305fc3f-3c36-46e8-808e-28dc4d53be17 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:09.805902 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7305fc3f-3c36-46e8-808e-28dc4d53be17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:09.871522 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 24/48] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:11:10.144199 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf57c2-618f-4a62-8246-ccfbc381af61 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:10.229033 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:10.246760 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf57c2-618f-4a62-8246-ccfbc381af61 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:10.278815 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d3d8b-20a6-40cf-94c4-217e7fc2da27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:10.279435 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d3d8b-20a6-40cf-94c4-217e7fc2da27 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:10.279718 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d3d8b-20a6-40cf-94c4-217e7fc2da27 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:10.280024 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d3d8b-20a6-40cf-94c4-217e7fc2da27 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:10.281137 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d3d8b-20a6-40cf-94c4-217e7fc2da27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:10.283105 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d3d8b-20a6-40cf-94c4-217e7fc2da27 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:10.284683 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 25/49] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:11:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:10.290417 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305fc3f-3c36-46e8-808e-28dc4d53be17 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:10.323284 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:10.389484 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305fc3f-3c36-46e8-808e-28dc4d53be17 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:10.422545 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadac09f-6ab1-4d38-9aed-43e67e8ad71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:10.423790 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadac09f-6ab1-4d38-9aed-43e67e8ad71f None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:10.424170 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadac09f-6ab1-4d38-9aed-43e67e8ad71f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:10.424451 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadac09f-6ab1-4d38-9aed-43e67e8ad71f None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:10.425109 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadac09f-6ab1-4d38-9aed-43e67e8ad71f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:10.426556 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadac09f-6ab1-4d38-9aed-43e67e8ad71f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:10.453390 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 25/50] 10.222.0.25 () {60 vars in 1140 bytes} [Tue Oct 25 13:11:10 2022] POST /identity/v3/projects => generated 298 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:11:12.612011 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7549e-1d61-45c6-851c-04bbf1167c05 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:12.612525 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7549e-1d61-45c6-851c-04bbf1167c05 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:12.612608 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7549e-1d61-45c6-851c-04bbf1167c05 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:12.613912 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 26/51] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:12.619197 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd8575-1bf8-4c30-931c-32881f498fb9 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:12.619550 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd8575-1bf8-4c30-931c-32881f498fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:12.619759 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd8575-1bf8-4c30-931c-32881f498fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:12.638335 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-22cd8575-1bf8-4c30-931c-32881f498fb9 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:12.639504 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-22cd8575-1bf8-4c30-931c-32881f498fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:12.809646 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 26/52] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:11:13.081870 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7549e-1d61-45c6-851c-04bbf1167c05 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:13.181222 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7549e-1d61-45c6-851c-04bbf1167c05 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:13.213036 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41964f-addf-436c-bc5b-ba78a03945f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:13.213651 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41964f-addf-436c-bc5b-ba78a03945f7 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:13.213935 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41964f-addf-436c-bc5b-ba78a03945f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:13.214208 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41964f-addf-436c-bc5b-ba78a03945f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:13.215305 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41964f-addf-436c-bc5b-ba78a03945f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:13.216760 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41964f-addf-436c-bc5b-ba78a03945f7 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:13.218314 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 27/53] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:11:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:13.224241 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd8575-1bf8-4c30-931c-32881f498fb9 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:13.239648 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:13.322525 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd8575-1bf8-4c30-931c-32881f498fb9 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:13.355073 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8526ab7-6478-477f-b714-2deb593feb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:13.355618 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8526ab7-6478-477f-b714-2deb593feb28 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:13.355931 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8526ab7-6478-477f-b714-2deb593feb28 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:13.356211 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8526ab7-6478-477f-b714-2deb593feb28 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:13.356854 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8526ab7-6478-477f-b714-2deb593feb28 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:13.358295 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8526ab7-6478-477f-b714-2deb593feb28 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:13.384198 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 27/54] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 25 13:11:13 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:11:16.796480 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b73b3-7023-42d1-aa04-f2fb5e288332 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:16.796980 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b73b3-7023-42d1-aa04-f2fb5e288332 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:16.797053 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b73b3-7023-42d1-aa04-f2fb5e288332 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:16.798918 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 28/55] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:16.805275 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca6647-f834-454c-b883-27b6e3091c60 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:16.806143 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca6647-f834-454c-b883-27b6e3091c60 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:16.806620 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca6647-f834-454c-b883-27b6e3091c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:16.832933 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d4ca6647-f834-454c-b883-27b6e3091c60 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:16.834497 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d4ca6647-f834-454c-b883-27b6e3091c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:16.849670 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17457c66-5b10-434e-a8f1-9935cdf5599e None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:16.850288 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17457c66-5b10-434e-a8f1-9935cdf5599e None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:16.850772 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17457c66-5b10-434e-a8f1-9935cdf5599e None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:16.852385 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 29/56] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:16.865169 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4096417-ef48-4580-9d8a-917eba2f1997 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:16.865792 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4096417-ef48-4580-9d8a-917eba2f1997 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:16.866292 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4096417-ef48-4580-9d8a-917eba2f1997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:16.895123 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-f4096417-ef48-4580-9d8a-917eba2f1997 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:16.896833 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-f4096417-ef48-4580-9d8a-917eba2f1997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:16.926965 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:16.935039 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:16.948236 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 28/57] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:11:17.004572 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 30/58] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 25 13:11:17.084589 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe3f5c-a7f9-43e0-88a3-50564bac9e1f None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:17.084920 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe3f5c-a7f9-43e0-88a3-50564bac9e1f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:17.085167 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe3f5c-a7f9-43e0-88a3-50564bac9e1f None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:17.086793 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 29/59] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:17.091648 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aaa786-5ea5-4392-ba34-8ac72ce9469b None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:17.092195 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aaa786-5ea5-4392-ba34-8ac72ce9469b None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:17.092671 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aaa786-5ea5-4392-ba34-8ac72ce9469b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:17.116883 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-d8aaa786-5ea5-4392-ba34-8ac72ce9469b None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:17.118392 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-d8aaa786-5ea5-4392-ba34-8ac72ce9469b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:17.202363 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 31/60] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:11:17.271747 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368697a-ded5-4213-846c-eec0ef9ee9bc None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:17.271986 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368697a-ded5-4213-846c-eec0ef9ee9bc None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:17.272536 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368697a-ded5-4213-846c-eec0ef9ee9bc None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:17.274071 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 30/61] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:17.279344 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958f78c-e544-435e-8ca4-9ad543b834de None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:17.279703 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958f78c-e544-435e-8ca4-9ad543b834de None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:17.280014 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958f78c-e544-435e-8ca4-9ad543b834de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:17.304648 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-6958f78c-e544-435e-8ca4-9ad543b834de None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:17.305829 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-6958f78c-e544-435e-8ca4-9ad543b834de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:17.387856 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 32/62] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:11:17.390745 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368697a-ded5-4213-846c-eec0ef9ee9bc None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:17.406160 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958f78c-e544-435e-8ca4-9ad543b834de None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:17.421297 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:17.534104 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958f78c-e544-435e-8ca4-9ad543b834de None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:17.572531 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892f38f-87b3-400e-96d2-023697f0668a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:17.573168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892f38f-87b3-400e-96d2-023697f0668a None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:17.573454 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892f38f-87b3-400e-96d2-023697f0668a None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:17.573732 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892f38f-87b3-400e-96d2-023697f0668a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:17.577469 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368697a-ded5-4213-846c-eec0ef9ee9bc None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:17.584981 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8892f38f-87b3-400e-96d2-023697f0668a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:11:17.590130 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-8892f38f-87b3-400e-96d2-023697f0668a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 25 13:11:17.590130 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:11:17.590130 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:11:17.590130 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:11:17.590130 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:11:17.590130 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:11:17.590130 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:11:17.590130 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:11:17.590130 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:11:17.590130 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:11:17.590130 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:11:17.590130 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:11:17.590130 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:11:17.590130 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:11:17.590130 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:11:17.590130 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:11:17.590961 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:11:17.590961 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:11:17.590961 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:11:17.590961 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:11:17.590961 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:11:17.590961 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:11:17.590961 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:11:17.590961 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:11:17.590961 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:11:17.590961 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:11:17.590961 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:11:17.590961 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:11:17.590961 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:11:17.590961 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:11:17.590961 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:11:17.590961 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:11:17.591729 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:11:17.591729 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:11:17.591729 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:11:17.591729 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:11:17.591729 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:11:17.591729 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:11:17.591729 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:11:17.591729 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:11:17.591729 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:11:17.591729 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:11:17.591729 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 25 13:11:17.591729 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:11:17.591729 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 33/63] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 25 13:11:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 13:11:17.592791 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892f38f-87b3-400e-96d2-023697f0668a None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:17.618843 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6875662-0a1d-4860-a38e-ec1f57d6e75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:17.619483 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6875662-0a1d-4860-a38e-ec1f57d6e75b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:17.619767 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6875662-0a1d-4860-a38e-ec1f57d6e75b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:17.620072 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6875662-0a1d-4860-a38e-ec1f57d6e75b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:17.631000 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6875662-0a1d-4860-a38e-ec1f57d6e75b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:11:17.635864 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-c6875662-0a1d-4860-a38e-ec1f57d6e75b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 13:11:17.635864 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:11:17.635864 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:11:17.635864 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:11:17.635864 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:11:17.635864 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:11:17.635864 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:11:17.635864 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:11:17.635864 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:11:17.635864 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:11:17.635864 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:11:17.635864 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:11:17.635864 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:11:17.635864 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:11:17.635864 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:11:17.635864 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:11:17.636724 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:11:17.636724 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:11:17.636724 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:11:17.636724 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:11:17.636724 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:11:17.636724 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:11:17.636724 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:11:17.636724 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:11:17.636724 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:11:17.636724 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:11:17.636724 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:11:17.636724 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:11:17.636724 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:11:17.636724 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:11:17.636724 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:11:17.636724 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:11:17.637510 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:11:17.637510 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:11:17.637510 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:11:17.637510 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:11:17.637510 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:11:17.637510 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:11:17.637510 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:11:17.637510 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:11:17.637510 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:11:17.637510 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:11:17.637510 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 13:11:17.637510 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:11:17.637510 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 31/64] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 25 13:11:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:11:17.638677 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5a816-86d1-45e2-8fa1-68adc2cb54f1 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:17.638967 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5a816-86d1-45e2-8fa1-68adc2cb54f1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:17.639243 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5a816-86d1-45e2-8fa1-68adc2cb54f1 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:17.640814 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 32/65] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:17.642351 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5a816-86d1-45e2-8fa1-68adc2cb54f1 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:17.679879 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:17.712813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:17.713149 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892f38f-87b3-400e-96d2-023697f0668a None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:17.750201 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309437c-3fb5-4d0b-907c-c057e20b775f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:17.751368 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309437c-3fb5-4d0b-907c-c057e20b775f None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:17.751761 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309437c-3fb5-4d0b-907c-c057e20b775f None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:17.752236 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309437c-3fb5-4d0b-907c-c057e20b775f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:17.762310 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0309437c-3fb5-4d0b-907c-c057e20b775f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:11:17.767291 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-0309437c-3fb5-4d0b-907c-c057e20b775f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 13:11:17.767291 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:11:17.767291 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:11:17.767291 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:11:17.767291 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:11:17.767291 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:11:17.767291 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:11:17.767291 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:11:17.767291 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:11:17.767291 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:11:17.767291 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:11:17.767291 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:11:17.767291 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:11:17.767291 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:11:17.767291 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:11:17.767291 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:11:17.768344 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:11:17.768344 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:11:17.768344 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:11:17.768344 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:11:17.768344 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:11:17.768344 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:11:17.768344 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:11:17.768344 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:11:17.768344 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:11:17.768344 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:11:17.768344 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:11:17.768344 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:11:17.768344 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:11:17.768344 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:11:17.768344 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:11:17.768344 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:11:17.769285 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:11:17.769285 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:11:17.769285 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:11:17.769285 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:11:17.769285 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:11:17.769285 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:11:17.769285 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:11:17.769285 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:11:17.769285 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:11:17.769285 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:11:17.769285 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 13:11:17.769285 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:11:17.769910 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5a816-86d1-45e2-8fa1-68adc2cb54f1 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:17.769987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 34/66] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 25 13:11:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:11:17.769987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309437c-3fb5-4d0b-907c-c057e20b775f None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:17.809257 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f898b1e-2474-4d97-a415-b015661b2b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:17.809784 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f898b1e-2474-4d97-a415-b015661b2b5c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:17.810074 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f898b1e-2474-4d97-a415-b015661b2b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:17.810358 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f898b1e-2474-4d97-a415-b015661b2b5c None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:17.811022 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f898b1e-2474-4d97-a415-b015661b2b5c None admin] RBAC: Adding query filter params (name=member) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:17.811330 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f898b1e-2474-4d97-a415-b015661b2b5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:17.812754 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f898b1e-2474-4d97-a415-b015661b2b5c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:17.824220 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 33/67] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 25 13:11:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:17.825459 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef054ff-cefa-4e30-9785-b77c37b617b5 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:17.825750 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef054ff-cefa-4e30-9785-b77c37b617b5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:17.826032 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef054ff-cefa-4e30-9785-b77c37b617b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:17.843471 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-9ef054ff-cefa-4e30-9785-b77c37b617b5 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:17.845244 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9ef054ff-cefa-4e30-9785-b77c37b617b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:17.871764 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309437c-3fb5-4d0b-907c-c057e20b775f None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:17.901196 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:17.907710 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617aa07-95f6-4bda-ba78-e2d444851140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:17.910626 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617aa07-95f6-4bda-ba78-e2d444851140 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:17.910626 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617aa07-95f6-4bda-ba78-e2d444851140 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:17.910626 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617aa07-95f6-4bda-ba78-e2d444851140 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:17.910626 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5617aa07-95f6-4bda-ba78-e2d444851140 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:17.910626 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5617aa07-95f6-4bda-ba78-e2d444851140 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:17.911812 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 34/68] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:11:17.912010 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5617aa07-95f6-4bda-ba78-e2d444851140 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:17.912154 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef054ff-cefa-4e30-9785-b77c37b617b5 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:17.927272 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 35/69] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 25 13:11:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:17.928095 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617aa07-95f6-4bda-ba78-e2d444851140 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:17.973538 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:18.024908 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef054ff-cefa-4e30-9785-b77c37b617b5 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:18.033747 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617aa07-95f6-4bda-ba78-e2d444851140 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:18.065115 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef143da-02ec-4e8c-8d57-3c8d6acd4f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:18.065791 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef143da-02ec-4e8c-8d57-3c8d6acd4f60 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:18.066074 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef143da-02ec-4e8c-8d57-3c8d6acd4f60 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:18.066345 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef143da-02ec-4e8c-8d57-3c8d6acd4f60 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:18.068902 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa0481-6e15-469a-82c7-557ba1870b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:18.069510 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa0481-6e15-469a-82c7-557ba1870b52 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:18.069793 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa0481-6e15-469a-82c7-557ba1870b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:18.070068 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa0481-6e15-469a-82c7-557ba1870b52 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:18.070732 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fa0481-6e15-469a-82c7-557ba1870b52 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:18.071039 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fa0481-6e15-469a-82c7-557ba1870b52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:18.072477 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fa0481-6e15-469a-82c7-557ba1870b52 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:18.076959 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef143da-02ec-4e8c-8d57-3c8d6acd4f60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:11:18.085484 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 36/70] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 25 13:11:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:18.085484 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa0481-6e15-469a-82c7-557ba1870b52 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:18.085723 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-cef143da-02ec-4e8c-8d57-3c8d6acd4f60 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 25 13:11:18.085723 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:11:18.085723 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:11:18.085723 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:11:18.085723 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:11:18.085723 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:11:18.085723 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:11:18.085723 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:11:18.085723 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:11:18.085723 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:11:18.085723 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:11:18.085723 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:11:18.085723 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:11:18.085723 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:11:18.085723 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:11:18.085723 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:11:18.086672 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:11:18.086672 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:11:18.086672 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:11:18.086672 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:11:18.086672 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:11:18.086672 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:11:18.086672 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:11:18.086672 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:11:18.086672 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:11:18.086672 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:11:18.086672 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:11:18.086672 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:11:18.086672 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:11:18.086672 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:11:18.086672 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:11:18.086672 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:11:18.087614 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:11:18.087614 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:11:18.087614 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:11:18.087614 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:11:18.087614 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:11:18.087614 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:11:18.087614 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:11:18.087614 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:11:18.087614 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:11:18.087614 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:11:18.087614 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 25 13:11:18.087614 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:11:18.087614 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 35/71] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 25 13:11:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:11:18.087614 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef143da-02ec-4e8c-8d57-3c8d6acd4f60 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:18.145972 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:18.197228 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa0481-6e15-469a-82c7-557ba1870b52 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:18.204417 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef143da-02ec-4e8c-8d57-3c8d6acd4f60 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:18.217001 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:18.230364 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d938320-9435-40c6-9d52-a061ebd4690a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:18.230998 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d938320-9435-40c6-9d52-a061ebd4690a None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:18.231278 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d938320-9435-40c6-9d52-a061ebd4690a None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:18.231554 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d938320-9435-40c6-9d52-a061ebd4690a None admin] PATH_INFO: `/v3/users/6a911634c03e45ff8c7a4949e74b4c0c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:18.239054 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ebbe5-9788-4f6f-9f92-d57e39c41f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:18.239680 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ebbe5-9788-4f6f-9f92-d57e39c41f1c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:18.239994 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ebbe5-9788-4f6f-9f92-d57e39c41f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:18.240267 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ebbe5-9788-4f6f-9f92-d57e39c41f1c None admin] PATH_INFO: `/v3/users/297f37c6bdb6496db9bb50ba9e5abd95` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:18.241400 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ebbe5-9788-4f6f-9f92-d57e39c41f1c None admin] RBAC: Authorizing `identity:get_user(user_id=297f37c6bdb6496db9bb50ba9e5abd95)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:18.242844 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ebbe5-9788-4f6f-9f92-d57e39c41f1c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:18.244609 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 36/72] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 25 13:11:18 2022] GET /identity/v3/users/297f37c6bdb6496db9bb50ba9e5abd95 => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:18.245210 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ebbe5-9788-4f6f-9f92-d57e39c41f1c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:18.245679 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d938320-9435-40c6-9d52-a061ebd4690a None admin] RBAC: Authorizing `identity:get_user(user_id=6a911634c03e45ff8c7a4949e74b4c0c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:18.247117 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d938320-9435-40c6-9d52-a061ebd4690a None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:18.249956 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 37/73] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 25 13:11:18 2022] GET /identity/v3/users/6a911634c03e45ff8c7a4949e74b4c0c => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:18.250750 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d938320-9435-40c6-9d52-a061ebd4690a None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:18.345261 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ebbe5-9788-4f6f-9f92-d57e39c41f1c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:18.349520 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d938320-9435-40c6-9d52-a061ebd4690a None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:18.362991 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:18.380773 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2bc6fe-7c1a-4174-b8f9-6ed1439c8917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:18.381416 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bc6fe-7c1a-4174-b8f9-6ed1439c8917 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:18.381703 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bc6fe-7c1a-4174-b8f9-6ed1439c8917 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:18.381984 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bc6fe-7c1a-4174-b8f9-6ed1439c8917 None admin] PATH_INFO: `/v3/users/6a911634c03e45ff8c7a4949e74b4c0c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:18.383187 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2bc6fe-7c1a-4174-b8f9-6ed1439c8917 None admin] RBAC: Authorizing `identity:get_user(user_id=6a911634c03e45ff8c7a4949e74b4c0c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:18.384679 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2bc6fe-7c1a-4174-b8f9-6ed1439c8917 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:18.384974 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e2e5d-5918-4494-8063-c39961411290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:18.385577 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e2e5d-5918-4494-8063-c39961411290 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:18.385861 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e2e5d-5918-4494-8063-c39961411290 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:18.386138 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e2e5d-5918-4494-8063-c39961411290 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:18.386340 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 37/74] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 25 13:11:18 2022] GET /identity/v3/users/6a911634c03e45ff8c7a4949e74b4c0c => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:18.386799 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e2e5d-5918-4494-8063-c39961411290 None admin] RBAC: Adding query filter params (name=member) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:18.387102 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e2e5d-5918-4494-8063-c39961411290 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:18.387184 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2bc6fe-7c1a-4174-b8f9-6ed1439c8917 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:18.388590 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e2e5d-5918-4494-8063-c39961411290 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:18.397102 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 38/75] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 25 13:11:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:18.397897 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e2e5d-5918-4494-8063-c39961411290 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:18.441747 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:18.493526 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2bc6fe-7c1a-4174-b8f9-6ed1439c8917 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:18.496311 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e2e5d-5918-4494-8063-c39961411290 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:18.526253 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a29621-68d5-4272-8c94-cd2e5c0d9256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:18.526887 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a29621-68d5-4272-8c94-cd2e5c0d9256 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:18.527200 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a29621-68d5-4272-8c94-cd2e5c0d9256 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:18.527483 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a29621-68d5-4272-8c94-cd2e5c0d9256 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:18.528637 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a29621-68d5-4272-8c94-cd2e5c0d9256 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:18.529089 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5f28d-ebe3-4322-a559-80cd26c7a446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:18.529716 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5f28d-ebe3-4322-a559-80cd26c7a446 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:18.530000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5f28d-ebe3-4322-a559-80cd26c7a446 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:18.530085 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a29621-68d5-4272-8c94-cd2e5c0d9256 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:18.530279 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5f28d-ebe3-4322-a559-80cd26c7a446 None admin] PATH_INFO: `/v3/projects/f1b2d2ce464841cdb520ee093e9fc8d5` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:18.531406 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b5f28d-ebe3-4322-a559-80cd26c7a446 None admin] RBAC: Authorizing `identity:get_project(project_id=f1b2d2ce464841cdb520ee093e9fc8d5)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:18.531831 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 38/76] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:11:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:18.533006 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a29621-68d5-4272-8c94-cd2e5c0d9256 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:18.533522 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b5f28d-ebe3-4322-a559-80cd26c7a446 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:18.535156 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 39/77] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 25 13:11:18 2022] GET /identity/v3/projects/f1b2d2ce464841cdb520ee093e9fc8d5 => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:18.535928 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5f28d-ebe3-4322-a559-80cd26c7a446 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:18.578647 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:18.635183 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5f28d-ebe3-4322-a559-80cd26c7a446 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:18.636285 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a29621-68d5-4272-8c94-cd2e5c0d9256 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:18.652014 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:18.668665 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455468f8-cb03-4f03-82ea-b8df9592da89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:18.669323 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455468f8-cb03-4f03-82ea-b8df9592da89 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:18.669606 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455468f8-cb03-4f03-82ea-b8df9592da89 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:18.669879 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455468f8-cb03-4f03-82ea-b8df9592da89 None admin] PATH_INFO: `/v3/projects/f1b2d2ce464841cdb520ee093e9fc8d5` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:18.670860 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df033405-db73-4a25-be50-6b30cb910a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:18.670967 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455468f8-cb03-4f03-82ea-b8df9592da89 None admin] RBAC: Authorizing `identity:get_project(project_id=f1b2d2ce464841cdb520ee093e9fc8d5)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:18.671491 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df033405-db73-4a25-be50-6b30cb910a76 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:18.671775 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df033405-db73-4a25-be50-6b30cb910a76 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:18.672089 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df033405-db73-4a25-be50-6b30cb910a76 None admin] PATH_INFO: `/v3/projects/f1b2d2ce464841cdb520ee093e9fc8d5` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:18.672440 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455468f8-cb03-4f03-82ea-b8df9592da89 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:18.673791 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df033405-db73-4a25-be50-6b30cb910a76 None admin] RBAC: Authorizing `identity:get_project(project_id=f1b2d2ce464841cdb520ee093e9fc8d5)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:18.675148 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 40/78] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 25 13:11:18 2022] GET /identity/v3/projects/f1b2d2ce464841cdb520ee093e9fc8d5 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:18.675270 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df033405-db73-4a25-be50-6b30cb910a76 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:18.675924 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455468f8-cb03-4f03-82ea-b8df9592da89 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:18.681627 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 39/79] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 25 13:11:18 2022] GET /identity/v3/projects/f1b2d2ce464841cdb520ee093e9fc8d5 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:18.681627 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df033405-db73-4a25-be50-6b30cb910a76 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:18.776285 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455468f8-cb03-4f03-82ea-b8df9592da89 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:18.783886 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df033405-db73-4a25-be50-6b30cb910a76 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:18.786379 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:18.810517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d72ee-44d7-4959-9395-999c6347c392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:18.811138 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d72ee-44d7-4959-9395-999c6347c392 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:18.811419 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d72ee-44d7-4959-9395-999c6347c392 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:18.811692 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d72ee-44d7-4959-9395-999c6347c392 None admin] PATH_INFO: `/v3/users/6a911634c03e45ff8c7a4949e74b4c0c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:18.812855 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d72ee-44d7-4959-9395-999c6347c392 None admin] RBAC: Authorizing `identity:get_user(user_id=6a911634c03e45ff8c7a4949e74b4c0c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:18.815000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d72ee-44d7-4959-9395-999c6347c392 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:18.816617 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 41/80] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 25 13:11:18 2022] GET /identity/v3/users/6a911634c03e45ff8c7a4949e74b4c0c => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:18.817355 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d72ee-44d7-4959-9395-999c6347c392 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:18.818335 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216e1f3-03d3-42d1-8fb0-3de76f7a766b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:18.818972 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216e1f3-03d3-42d1-8fb0-3de76f7a766b None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:18.819261 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216e1f3-03d3-42d1-8fb0-3de76f7a766b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:18.819545 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216e1f3-03d3-42d1-8fb0-3de76f7a766b None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:18.820236 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216e1f3-03d3-42d1-8fb0-3de76f7a766b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:18.821828 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216e1f3-03d3-42d1-8fb0-3de76f7a766b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:18.843076 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 40/81] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 25 13:11:18 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:11:18.843875 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216e1f3-03d3-42d1-8fb0-3de76f7a766b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:18.890719 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:18.958984 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d72ee-44d7-4959-9395-999c6347c392 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:18.964596 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216e1f3-03d3-42d1-8fb0-3de76f7a766b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:19.000074 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e8177-1709-4c6f-bc6d-35a6361f5535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:19.001492 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e8177-1709-4c6f-bc6d-35a6361f5535 None admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:19.001875 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e8177-1709-4c6f-bc6d-35a6361f5535 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:19.002254 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e8177-1709-4c6f-bc6d-35a6361f5535 None admin] PATH_INFO: `/v3/projects/f1b2d2ce464841cdb520ee093e9fc8d5/users/297f37c6bdb6496db9bb50ba9e5abd95/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:19.004325 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2e8177-1709-4c6f-bc6d-35a6361f5535 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1b2d2ce464841cdb520ee093e9fc8d5, user_id=297f37c6bdb6496db9bb50ba9e5abd95, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:19.004598 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa163a-7990-4e8b-b2bb-1a77e74ac148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:19.005294 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa163a-7990-4e8b-b2bb-1a77e74ac148 None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:19.005565 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa163a-7990-4e8b-b2bb-1a77e74ac148 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:19.005842 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa163a-7990-4e8b-b2bb-1a77e74ac148 None admin] PATH_INFO: `/v3/projects/f1b2d2ce464841cdb520ee093e9fc8d5/users/6a911634c03e45ff8c7a4949e74b4c0c/roles/955523e4392d4c278c29f6ce715a5ae6` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:19.006311 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2e8177-1709-4c6f-bc6d-35a6361f5535 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:19.008163 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa163a-7990-4e8b-b2bb-1a77e74ac148 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1b2d2ce464841cdb520ee093e9fc8d5, user_id=6a911634c03e45ff8c7a4949e74b4c0c, role_id=955523e4392d4c278c29f6ce715a5ae6)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:19.010301 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa163a-7990-4e8b-b2bb-1a77e74ac148 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:19.023866 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 42/82] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 25 13:11:18 2022] PUT /identity/v3/projects/f1b2d2ce464841cdb520ee093e9fc8d5/users/297f37c6bdb6496db9bb50ba9e5abd95/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:11:19.024964 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e8177-1709-4c6f-bc6d-35a6361f5535 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:19.027207 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 41/83] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 25 13:11:18 2022] PUT /identity/v3/projects/f1b2d2ce464841cdb520ee093e9fc8d5/users/6a911634c03e45ff8c7a4949e74b4c0c/roles/955523e4392d4c278c29f6ce715a5ae6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:11:19.028112 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa163a-7990-4e8b-b2bb-1a77e74ac148 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:19.105159 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:19.187995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:19.193244 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa163a-7990-4e8b-b2bb-1a77e74ac148 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:19.201869 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e8177-1709-4c6f-bc6d-35a6361f5535 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:19.244391 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea13fc-b47a-47f7-a225-536b3c30977b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:19.245533 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea13fc-b47a-47f7-a225-536b3c30977b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:19.245956 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea13fc-b47a-47f7-a225-536b3c30977b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:19.246444 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea13fc-b47a-47f7-a225-536b3c30977b None admin] PATH_INFO: `/v3/projects/f89344b3a0394b33a64319c7d3bb596d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:19.247882 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea13fc-b47a-47f7-a225-536b3c30977b None admin] RBAC: Authorizing `identity:get_project(project_id=f89344b3a0394b33a64319c7d3bb596d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:19.249635 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea13fc-b47a-47f7-a225-536b3c30977b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:19.252462 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 42/84] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 25 13:11:19 2022] GET /identity/v3/projects/f89344b3a0394b33a64319c7d3bb596d => generated 312 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:19.255383 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989fac65-c80d-46f1-9536-11c01b9c0f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:19.256199 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fac65-c80d-46f1-9536-11c01b9c0f8f None admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:19.256520 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fac65-c80d-46f1-9536-11c01b9c0f8f None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:19.256870 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fac65-c80d-46f1-9536-11c01b9c0f8f None admin] PATH_INFO: `/v3/projects/f1b2d2ce464841cdb520ee093e9fc8d5/users/6a911634c03e45ff8c7a4949e74b4c0c/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:19.258900 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea13fc-b47a-47f7-a225-536b3c30977b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:19.259014 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989fac65-c80d-46f1-9536-11c01b9c0f8f None admin] RBAC: Authorizing `identity:create_grant(project_id=f1b2d2ce464841cdb520ee093e9fc8d5, user_id=6a911634c03e45ff8c7a4949e74b4c0c, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:19.260553 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989fac65-c80d-46f1-9536-11c01b9c0f8f None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:19.282735 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 43/85] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 25 13:11:19 2022] PUT /identity/v3/projects/f1b2d2ce464841cdb520ee093e9fc8d5/users/6a911634c03e45ff8c7a4949e74b4c0c/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:11:19.390453 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea13fc-b47a-47f7-a225-536b3c30977b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:19.435573 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68003878-4ce0-4c5c-8dcb-2b141abe9cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:19.436511 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68003878-4ce0-4c5c-8dcb-2b141abe9cc1 None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:19.436959 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68003878-4ce0-4c5c-8dcb-2b141abe9cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:19.437374 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68003878-4ce0-4c5c-8dcb-2b141abe9cc1 None admin] PATH_INFO: `/v3/projects/f89344b3a0394b33a64319c7d3bb596d/users/6a911634c03e45ff8c7a4949e74b4c0c/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:19.439745 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68003878-4ce0-4c5c-8dcb-2b141abe9cc1 None admin] RBAC: Authorizing `identity:create_grant(project_id=f89344b3a0394b33a64319c7d3bb596d, user_id=6a911634c03e45ff8c7a4949e74b4c0c, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:19.441398 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68003878-4ce0-4c5c-8dcb-2b141abe9cc1 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:19.464756 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 43/86] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 25 13:11:19 2022] PUT /identity/v3/projects/f89344b3a0394b33a64319c7d3bb596d/users/6a911634c03e45ff8c7a4949e74b4c0c/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:11:22.080491 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e31e2-c1dd-4690-bba3-35af5545627e None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:22.081469 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e31e2-c1dd-4690-bba3-35af5545627e None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:22.081946 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e31e2-c1dd-4690-bba3-35af5545627e None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:22.083516 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 44/87] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:22.089002 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b0ac3-a5d5-4091-a8de-a6b5e0708840 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:22.089852 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b0ac3-a5d5-4091-a8de-a6b5e0708840 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:22.090323 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b0ac3-a5d5-4091-a8de-a6b5e0708840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:22.109633 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a31b0ac3-a5d5-4091-a8de-a6b5e0708840 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:22.111293 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a31b0ac3-a5d5-4091-a8de-a6b5e0708840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:22.136068 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:22.187375 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 44/88] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:11:22.231943 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14a426-ced8-404b-b86d-1b01f99306bf None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:22.232459 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14a426-ced8-404b-b86d-1b01f99306bf None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:22.232850 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14a426-ced8-404b-b86d-1b01f99306bf None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:22.234266 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 45/89] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 13:11:22.240272 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4cb65-783c-4cb4-b9e4-93480218445b None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:22.240801 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4cb65-783c-4cb4-b9e4-93480218445b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:22.241269 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4cb65-783c-4cb4-b9e4-93480218445b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:22.260814 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-b2f4cb65-783c-4cb4-b9e4-93480218445b None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:22.262320 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b2f4cb65-783c-4cb4-b9e4-93480218445b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:22.335040 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 45/90] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:11:22.400558 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b7039-af77-4483-a4f6-2657d3f8ad25 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:22.400864 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b7039-af77-4483-a4f6-2657d3f8ad25 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:22.401103 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b7039-af77-4483-a4f6-2657d3f8ad25 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:22.402716 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 46/91] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:22.411513 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ef094-9c52-4d76-a9be-39fe970b2dbd None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:22.412084 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ef094-9c52-4d76-a9be-39fe970b2dbd None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:22.412562 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ef094-9c52-4d76-a9be-39fe970b2dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:22.436847 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-3b0ef094-9c52-4d76-a9be-39fe970b2dbd None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:22.438478 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3b0ef094-9c52-4d76-a9be-39fe970b2dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:22.533644 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 46/92] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:11:22.596478 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfaff5-b833-4349-8002-14435acc6294 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:22.596756 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfaff5-b833-4349-8002-14435acc6294 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:22.596953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfaff5-b833-4349-8002-14435acc6294 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:22.598572 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 47/93] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:22.603708 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4d347-aa2c-4342-95a4-75f728bc81c3 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:22.604263 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4d347-aa2c-4342-95a4-75f728bc81c3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:22.604746 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4d347-aa2c-4342-95a4-75f728bc81c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:22.628882 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-54d4d347-aa2c-4342-95a4-75f728bc81c3 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:22.630380 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-54d4d347-aa2c-4342-95a4-75f728bc81c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:22.651586 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:22.653490 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d90412-b681-4521-b046-6005bcafe72f None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:22.653832 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d90412-b681-4521-b046-6005bcafe72f None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:22.654137 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d90412-b681-4521-b046-6005bcafe72f None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:22.655615 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 48/94] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 13:11:22.665987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce5002-f6b6-4770-9e8c-2d51bda3cfb0 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:22.666274 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce5002-f6b6-4770-9e8c-2d51bda3cfb0 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:22.666988 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce5002-f6b6-4770-9e8c-2d51bda3cfb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:22.697516 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-1bce5002-f6b6-4770-9e8c-2d51bda3cfb0 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:22.698737 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-1bce5002-f6b6-4770-9e8c-2d51bda3cfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:22.766763 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 47/95] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:11:22.767987 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4d347-aa2c-4342-95a4-75f728bc81c3 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:22.805607 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 49/96] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 25 13:11:22.806468 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce5002-f6b6-4770-9e8c-2d51bda3cfb0 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:22.855036 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:22.978108 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4d347-aa2c-4342-95a4-75f728bc81c3 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:22.991789 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce5002-f6b6-4770-9e8c-2d51bda3cfb0 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:23.045524 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24bb45-9f0b-408b-9ee6-4372db2853ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:23.047099 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24bb45-9f0b-408b-9ee6-4372db2853ca None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:23.047855 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24bb45-9f0b-408b-9ee6-4372db2853ca None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:23.049466 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24bb45-9f0b-408b-9ee6-4372db2853ca None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:23.056801 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd6684e-59a9-4a4b-ae18-5f542c5cc38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:23.057546 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6684e-59a9-4a4b-ae18-5f542c5cc38f None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:23.057832 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6684e-59a9-4a4b-ae18-5f542c5cc38f None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:23.058116 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6684e-59a9-4a4b-ae18-5f542c5cc38f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:23.062634 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24bb45-9f0b-408b-9ee6-4372db2853ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:11:23.068527 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-ec24bb45-9f0b-408b-9ee6-4372db2853ca None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 25 13:11:23.068527 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:11:23.068527 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:11:23.068527 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:11:23.068527 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:11:23.068527 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:11:23.068527 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:11:23.068527 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:11:23.068527 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:11:23.068527 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:11:23.068527 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:11:23.068527 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:11:23.068527 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:11:23.068527 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:11:23.068527 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:11:23.068527 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:11:23.069341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:11:23.069341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:11:23.069341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:11:23.069341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:11:23.069341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:11:23.069341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:11:23.069341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:11:23.069341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:11:23.069341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:11:23.069341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:11:23.069341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:11:23.069341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:11:23.069341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:11:23.069341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:11:23.069341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:11:23.069341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:11:23.070127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:11:23.070127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:11:23.070127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:11:23.070127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:11:23.070127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:11:23.070127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:11:23.070127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:11:23.070127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:11:23.070127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:11:23.070127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:11:23.070127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 25 13:11:23.070127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:11:23.070699 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd6684e-59a9-4a4b-ae18-5f542c5cc38f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:11:23.072719 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 48/97] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 25 13:11:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:11:23.073697 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24bb45-9f0b-408b-9ee6-4372db2853ca None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:23.074287 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-8dd6684e-59a9-4a4b-ae18-5f542c5cc38f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 25 13:11:23.074287 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:11:23.074287 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:11:23.074287 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:11:23.074287 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:11:23.074287 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:11:23.074287 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:11:23.074287 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:11:23.074287 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:11:23.074287 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:11:23.074287 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:11:23.074287 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:11:23.074287 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:11:23.074287 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:11:23.074287 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:11:23.074287 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:11:23.075098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:11:23.075098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:11:23.075098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:11:23.075098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:11:23.075098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:11:23.075098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:11:23.075098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:11:23.075098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:11:23.075098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:11:23.075098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:11:23.075098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:11:23.075098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:11:23.075098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:11:23.075098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:11:23.075098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:11:23.075098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:11:23.075837 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:11:23.075837 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:11:23.075837 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:11:23.075837 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:11:23.075837 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:11:23.075837 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:11:23.075837 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:11:23.075837 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:11:23.075837 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:11:23.075837 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:11:23.075837 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 25 13:11:23.075837 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:11:23.075837 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 50/98] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 25 13:11:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:11:23.077309 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ea9cf-cd3b-4ccc-962c-78a8b7a6b7f4 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:23.077309 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ea9cf-cd3b-4ccc-962c-78a8b7a6b7f4 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:23.077309 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ea9cf-cd3b-4ccc-962c-78a8b7a6b7f4 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:23.078970 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 51/99] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:23.088653 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ea9cf-cd3b-4ccc-962c-78a8b7a6b7f4 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:23.090443 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:23.185582 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:23.186748 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24bb45-9f0b-408b-9ee6-4372db2853ca None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:23.198930 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ea9cf-cd3b-4ccc-962c-78a8b7a6b7f4 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:23.222133 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12702fb2-53c6-4631-ba70-1ce26d87d181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:23.222754 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12702fb2-53c6-4631-ba70-1ce26d87d181 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:23.223033 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12702fb2-53c6-4631-ba70-1ce26d87d181 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:23.223308 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12702fb2-53c6-4631-ba70-1ce26d87d181 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:23.233217 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12702fb2-53c6-4631-ba70-1ce26d87d181 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:11:23.233359 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f17b7-dc0b-4044-8d2b-7b977a645e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:23.233962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f17b7-dc0b-4044-8d2b-7b977a645e3d None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:23.234248 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f17b7-dc0b-4044-8d2b-7b977a645e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:23.234528 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f17b7-dc0b-4044-8d2b-7b977a645e3d None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:23.235216 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f17b7-dc0b-4044-8d2b-7b977a645e3d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:23.235532 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f17b7-dc0b-4044-8d2b-7b977a645e3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:23.236965 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f17b7-dc0b-4044-8d2b-7b977a645e3d None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:23.238138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-12702fb2-53c6-4631-ba70-1ce26d87d181 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 13:11:23.238138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:11:23.238138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:11:23.238138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:11:23.238138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:11:23.238138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:11:23.238138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:11:23.238138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:11:23.238138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:11:23.238138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:11:23.238138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:11:23.238138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:11:23.238138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:11:23.238138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:11:23.238138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:11:23.238138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:11:23.238945 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:11:23.238945 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:11:23.238945 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:11:23.238945 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:11:23.238945 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:11:23.238945 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:11:23.238945 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:11:23.238945 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:11:23.238945 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:11:23.238945 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:11:23.238945 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:11:23.238945 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:11:23.238945 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:11:23.238945 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:11:23.238945 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:11:23.238945 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:11:23.239789 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:11:23.239789 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:11:23.239789 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:11:23.239789 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:11:23.239789 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:11:23.239789 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:11:23.239789 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:11:23.239789 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:11:23.239789 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:11:23.239789 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:11:23.239789 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 13:11:23.239789 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:11:23.239789 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 49/100] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 25 13:11:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:11:23.240908 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12702fb2-53c6-4631-ba70-1ce26d87d181 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:23.251833 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 52/101] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 25 13:11:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:23.251833 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3eb44-8648-4a05-bd60-50e8c82b5cfb None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:23.251833 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3eb44-8648-4a05-bd60-50e8c82b5cfb None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:23.251833 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3eb44-8648-4a05-bd60-50e8c82b5cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:23.267456 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-c3b3eb44-8648-4a05-bd60-50e8c82b5cfb None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:23.268684 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c3b3eb44-8648-4a05-bd60-50e8c82b5cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:23.315789 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:23.335946 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 53/102] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:11:23.336628 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3eb44-8648-4a05-bd60-50e8c82b5cfb None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:23.353920 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12702fb2-53c6-4631-ba70-1ce26d87d181 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:23.392747 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9ab95-369e-4d20-9eb7-8f1eff03dbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:23.393355 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9ab95-369e-4d20-9eb7-8f1eff03dbf4 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:23.393645 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9ab95-369e-4d20-9eb7-8f1eff03dbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:23.393938 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9ab95-369e-4d20-9eb7-8f1eff03dbf4 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:23.394607 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f9ab95-369e-4d20-9eb7-8f1eff03dbf4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:23.394911 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f9ab95-369e-4d20-9eb7-8f1eff03dbf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:23.396328 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f9ab95-369e-4d20-9eb7-8f1eff03dbf4 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:23.409485 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 50/103] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 25 13:11:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:23.409485 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9ab95-369e-4d20-9eb7-8f1eff03dbf4 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:23.420641 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:23.441947 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3eb44-8648-4a05-bd60-50e8c82b5cfb None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:23.478920 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f89f2-c1b5-422b-8d3c-3d411c573110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:23.479557 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f89f2-c1b5-422b-8d3c-3d411c573110 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:23.479842 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f89f2-c1b5-422b-8d3c-3d411c573110 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:23.480146 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f89f2-c1b5-422b-8d3c-3d411c573110 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:23.481250 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f89f2-c1b5-422b-8d3c-3d411c573110 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:23.482684 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f89f2-c1b5-422b-8d3c-3d411c573110 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:23.484296 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 54/104] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:11:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:23.485205 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f89f2-c1b5-422b-8d3c-3d411c573110 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:23.536019 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9ab95-369e-4d20-9eb7-8f1eff03dbf4 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:23.569753 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:23.577745 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa4a3dd-735a-48f2-ad58-833a7b188ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:23.578380 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4a3dd-735a-48f2-ad58-833a7b188ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:23.578682 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4a3dd-735a-48f2-ad58-833a7b188ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:23.578971 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4a3dd-735a-48f2-ad58-833a7b188ff0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:23.585770 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f89f2-c1b5-422b-8d3c-3d411c573110 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:23.590113 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa4a3dd-735a-48f2-ad58-833a7b188ff0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:11:23.596200 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-3aa4a3dd-735a-48f2-ad58-833a7b188ff0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 13:11:23.596200 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:11:23.596200 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:11:23.596200 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:11:23.596200 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:11:23.596200 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:11:23.596200 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:11:23.596200 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:11:23.596200 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:11:23.596200 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:11:23.596200 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:11:23.596200 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:11:23.596200 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:11:23.596200 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:11:23.596200 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:11:23.596200 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:11:23.597055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:11:23.597055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:11:23.597055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:11:23.597055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:11:23.597055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:11:23.597055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:11:23.597055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:11:23.597055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:11:23.597055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:11:23.597055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:11:23.597055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:11:23.597055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:11:23.597055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:11:23.597055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:11:23.597055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:11:23.597055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:11:23.597813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:11:23.597813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:11:23.597813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:11:23.597813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:11:23.597813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:11:23.597813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:11:23.597813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:11:23.597813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:11:23.597813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:11:23.597813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:11:23.597813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 13:11:23.597813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:11:23.597813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 51/105] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 25 13:11:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:11:23.599070 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa4a3dd-735a-48f2-ad58-833a7b188ff0 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:23.626143 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea78731-ad85-49b5-abf6-d2c836049f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:23.626753 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea78731-ad85-49b5-abf6-d2c836049f7b None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:23.627037 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea78731-ad85-49b5-abf6-d2c836049f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:23.627314 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea78731-ad85-49b5-abf6-d2c836049f7b None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:23.628010 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea78731-ad85-49b5-abf6-d2c836049f7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:23.628318 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea78731-ad85-49b5-abf6-d2c836049f7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:23.629683 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea78731-ad85-49b5-abf6-d2c836049f7b None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:23.637720 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 55/106] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 25 13:11:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:23.642739 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea78731-ad85-49b5-abf6-d2c836049f7b None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:23.650615 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:23.699305 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa4a3dd-735a-48f2-ad58-833a7b188ff0 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:23.733529 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46f0d6-5f98-47f4-9cf8-a8dfc111b43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:23.734161 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46f0d6-5f98-47f4-9cf8-a8dfc111b43c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:23.734453 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46f0d6-5f98-47f4-9cf8-a8dfc111b43c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:23.734733 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46f0d6-5f98-47f4-9cf8-a8dfc111b43c None admin] PATH_INFO: `/v3/users/8ec6fc9de3dd4346b459188f52b0b571` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:23.741234 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea78731-ad85-49b5-abf6-d2c836049f7b None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:23.750121 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46f0d6-5f98-47f4-9cf8-a8dfc111b43c None admin] RBAC: Authorizing `identity:get_user(user_id=8ec6fc9de3dd4346b459188f52b0b571)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:23.751600 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46f0d6-5f98-47f4-9cf8-a8dfc111b43c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:23.753265 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 52/107] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 25 13:11:23 2022] GET /identity/v3/users/8ec6fc9de3dd4346b459188f52b0b571 => generated 289 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:23.757987 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46f0d6-5f98-47f4-9cf8-a8dfc111b43c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:23.774584 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14db40-2c9b-482a-8528-c1eb6fddabca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:23.775215 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14db40-2c9b-482a-8528-c1eb6fddabca None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:23.775494 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14db40-2c9b-482a-8528-c1eb6fddabca None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:23.775767 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14db40-2c9b-482a-8528-c1eb6fddabca None admin] PATH_INFO: `/v3/users/6a911634c03e45ff8c7a4949e74b4c0c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:23.776924 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c14db40-2c9b-482a-8528-c1eb6fddabca None admin] RBAC: Authorizing `identity:get_user(user_id=6a911634c03e45ff8c7a4949e74b4c0c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:23.778364 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c14db40-2c9b-482a-8528-c1eb6fddabca None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:23.779944 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 56/108] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 25 13:11:23 2022] GET /identity/v3/users/6a911634c03e45ff8c7a4949e74b4c0c => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:23.780700 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14db40-2c9b-482a-8528-c1eb6fddabca None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:23.806481 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:23.857064 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46f0d6-5f98-47f4-9cf8-a8dfc111b43c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:23.857843 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:23.881115 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14db40-2c9b-482a-8528-c1eb6fddabca None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:23.890847 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d8a0ca-359c-4ab7-b5dc-c64e36d8f4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:23.892172 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8a0ca-359c-4ab7-b5dc-c64e36d8f4ac None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:23.892454 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8a0ca-359c-4ab7-b5dc-c64e36d8f4ac None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:23.892732 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8a0ca-359c-4ab7-b5dc-c64e36d8f4ac None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:23.893374 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d8a0ca-359c-4ab7-b5dc-c64e36d8f4ac None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:23.894808 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d8a0ca-359c-4ab7-b5dc-c64e36d8f4ac None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:23.915172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5f919-064c-44c1-9430-a603374cccc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:23.915779 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5f919-064c-44c1-9430-a603374cccc3 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:23.916102 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5f919-064c-44c1-9430-a603374cccc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:23.916385 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5f919-064c-44c1-9430-a603374cccc3 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:23.917298 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e5f919-064c-44c1-9430-a603374cccc3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:23.917606 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e5f919-064c-44c1-9430-a603374cccc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:23.918975 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e5f919-064c-44c1-9430-a603374cccc3 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:23.919996 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 53/109] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Oct 25 13:11:23 2022] POST /identity/v3/projects => generated 302 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:11:23.920798 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d8a0ca-359c-4ab7-b5dc-c64e36d8f4ac None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:23.944300 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 57/110] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 25 13:11:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:23.944300 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5f919-064c-44c1-9430-a603374cccc3 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:24.049180 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:24.053200 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d8a0ca-359c-4ab7-b5dc-c64e36d8f4ac None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:24.057790 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5f919-064c-44c1-9430-a603374cccc3 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:24.096407 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595c8c5-36ae-4b7c-b0b1-4fef81b2c7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:24.097832 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595c8c5-36ae-4b7c-b0b1-4fef81b2c7b7 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:24.097832 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595c8c5-36ae-4b7c-b0b1-4fef81b2c7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:24.097832 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595c8c5-36ae-4b7c-b0b1-4fef81b2c7b7 None admin] PATH_INFO: `/v3/users/297f37c6bdb6496db9bb50ba9e5abd95` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:24.098787 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f1d2c-4d89-44aa-8101-4e109a93a606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:24.099158 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595c8c5-36ae-4b7c-b0b1-4fef81b2c7b7 None admin] RBAC: Authorizing `identity:get_user(user_id=297f37c6bdb6496db9bb50ba9e5abd95)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:24.099228 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f1d2c-4d89-44aa-8101-4e109a93a606 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:24.099396 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f1d2c-4d89-44aa-8101-4e109a93a606 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:24.100361 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f1d2c-4d89-44aa-8101-4e109a93a606 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:24.100579 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595c8c5-36ae-4b7c-b0b1-4fef81b2c7b7 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:24.102072 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 58/111] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 25 13:11:23 2022] GET /identity/v3/users/297f37c6bdb6496db9bb50ba9e5abd95 => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:24.103632 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595c8c5-36ae-4b7c-b0b1-4fef81b2c7b7 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:24.114314 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f1d2c-4d89-44aa-8101-4e109a93a606 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:11:24.115737 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:24.119534 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-4d8f1d2c-4d89-44aa-8101-4e109a93a606 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 25 13:11:24.119534 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:11:24.119534 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:11:24.119534 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:11:24.119534 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:11:24.119534 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:11:24.119534 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:11:24.119534 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:11:24.119534 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:11:24.119534 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:11:24.119534 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:11:24.119534 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:11:24.119534 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:11:24.119534 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:11:24.119534 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:11:24.119534 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:11:24.120458 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:11:24.120458 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:11:24.120458 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:11:24.120458 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:11:24.120458 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:11:24.120458 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:11:24.120458 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:11:24.120458 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:11:24.120458 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:11:24.120458 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:11:24.120458 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:11:24.120458 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:11:24.120458 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:11:24.120458 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:11:24.120458 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:11:24.120458 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:11:24.121197 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:11:24.121197 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:11:24.121197 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:11:24.121197 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:11:24.121197 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:11:24.121197 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:11:24.121197 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:11:24.121197 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:11:24.121197 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:11:24.121197 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:11:24.121197 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 25 13:11:24.121197 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:11:24.121197 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 54/112] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 25 13:11:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:11:24.121898 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f1d2c-4d89-44aa-8101-4e109a93a606 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:24.223494 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595c8c5-36ae-4b7c-b0b1-4fef81b2c7b7 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:24.238664 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f1d2c-4d89-44aa-8101-4e109a93a606 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:24.260145 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f53351-85cc-494b-87f4-b08febc2e5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:24.261145 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f53351-85cc-494b-87f4-b08febc2e5fc None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:24.261434 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f53351-85cc-494b-87f4-b08febc2e5fc None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:24.261709 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f53351-85cc-494b-87f4-b08febc2e5fc None admin] PATH_INFO: `/v3/projects/f1b2d2ce464841cdb520ee093e9fc8d5` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:24.262838 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f53351-85cc-494b-87f4-b08febc2e5fc None admin] RBAC: Authorizing `identity:get_project(project_id=f1b2d2ce464841cdb520ee093e9fc8d5)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:24.264296 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f53351-85cc-494b-87f4-b08febc2e5fc None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:24.265918 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 59/113] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 25 13:11:24 2022] GET /identity/v3/projects/f1b2d2ce464841cdb520ee093e9fc8d5 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:24.267318 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f53351-85cc-494b-87f4-b08febc2e5fc None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:24.281467 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed100d-8d09-406e-95bb-23ae0f8d3e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:24.282404 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed100d-8d09-406e-95bb-23ae0f8d3e06 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:24.282702 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed100d-8d09-406e-95bb-23ae0f8d3e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:24.282965 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed100d-8d09-406e-95bb-23ae0f8d3e06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:24.313908 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:24.351846 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:24.358785 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed100d-8d09-406e-95bb-23ae0f8d3e06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:24.360356 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed100d-8d09-406e-95bb-23ae0f8d3e06 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:24.376570 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f53351-85cc-494b-87f4-b08febc2e5fc None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:24.412652 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed127c3-8e8b-44af-8644-633f9e7e12f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:24.413679 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed127c3-8e8b-44af-8644-633f9e7e12f0 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:24.413970 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed127c3-8e8b-44af-8644-633f9e7e12f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:24.414249 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed127c3-8e8b-44af-8644-633f9e7e12f0 None admin] PATH_INFO: `/v3/users/6a911634c03e45ff8c7a4949e74b4c0c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:24.415398 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed127c3-8e8b-44af-8644-633f9e7e12f0 None admin] RBAC: Authorizing `identity:get_user(user_id=6a911634c03e45ff8c7a4949e74b4c0c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:24.417999 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed127c3-8e8b-44af-8644-633f9e7e12f0 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:24.420500 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 60/114] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 25 13:11:24 2022] GET /identity/v3/users/6a911634c03e45ff8c7a4949e74b4c0c => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:24.424788 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed127c3-8e8b-44af-8644-633f9e7e12f0 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:24.473877 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 55/115] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 25 13:11:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 25 13:11:24.473877 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed100d-8d09-406e-95bb-23ae0f8d3e06 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:24.532598 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:24.540190 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed127c3-8e8b-44af-8644-633f9e7e12f0 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:24.576050 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511265b-fbbc-4270-8af3-89ffb166d3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:24.576642 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511265b-fbbc-4270-8af3-89ffb166d3c9 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:24.576924 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511265b-fbbc-4270-8af3-89ffb166d3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:24.577225 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511265b-fbbc-4270-8af3-89ffb166d3c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:24.577378 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed100d-8d09-406e-95bb-23ae0f8d3e06 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:24.592172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:24.616711 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0087a9-65b8-4b86-8191-bfad16db0d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:24.617325 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0087a9-65b8-4b86-8191-bfad16db0d02 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:24.617608 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0087a9-65b8-4b86-8191-bfad16db0d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:24.617886 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0087a9-65b8-4b86-8191-bfad16db0d02 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:24.618555 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0087a9-65b8-4b86-8191-bfad16db0d02 None admin] RBAC: Adding query filter params (name=member) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:24.619113 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0087a9-65b8-4b86-8191-bfad16db0d02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:24.620399 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0087a9-65b8-4b86-8191-bfad16db0d02 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:24.634833 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 56/116] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 25 13:11:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:24.634833 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0087a9-65b8-4b86-8191-bfad16db0d02 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:24.649631 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511265b-fbbc-4270-8af3-89ffb166d3c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:24.651104 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511265b-fbbc-4270-8af3-89ffb166d3c9 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:24.748932 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0087a9-65b8-4b86-8191-bfad16db0d02 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:24.756300 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 61/117] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 25 13:11:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 25 13:11:24.761241 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511265b-fbbc-4270-8af3-89ffb166d3c9 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:24.773358 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:24.787291 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d012c-3835-4f99-a8a4-1dd913b54954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:24.788014 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d012c-3835-4f99-a8a4-1dd913b54954 None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:24.788306 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d012c-3835-4f99-a8a4-1dd913b54954 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:24.788730 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d012c-3835-4f99-a8a4-1dd913b54954 None admin] PATH_INFO: `/v3/projects/f1b2d2ce464841cdb520ee093e9fc8d5/users/8ec6fc9de3dd4346b459188f52b0b571/roles/cf3c7c662d454e63953da94d2d986171` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:24.790509 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d012c-3835-4f99-a8a4-1dd913b54954 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1b2d2ce464841cdb520ee093e9fc8d5, user_id=8ec6fc9de3dd4346b459188f52b0b571, role_id=cf3c7c662d454e63953da94d2d986171)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:24.793461 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d012c-3835-4f99-a8a4-1dd913b54954 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:24.808628 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 57/118] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 25 13:11:24 2022] PUT /identity/v3/projects/f1b2d2ce464841cdb520ee093e9fc8d5/users/8ec6fc9de3dd4346b459188f52b0b571/roles/cf3c7c662d454e63953da94d2d986171 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:11:24.809456 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d012c-3835-4f99-a8a4-1dd913b54954 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:24.816767 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:24.886881 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511265b-fbbc-4270-8af3-89ffb166d3c9 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:24.936879 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479c734-f2ee-46b7-8827-8f359ef92ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:24.937506 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479c734-f2ee-46b7-8827-8f359ef92ee1 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:24.937788 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479c734-f2ee-46b7-8827-8f359ef92ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:24.938149 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479c734-f2ee-46b7-8827-8f359ef92ee1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:24.955180 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d012c-3835-4f99-a8a4-1dd913b54954 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:24.993407 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f2db6-8546-419b-bdb8-3eab5159c535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:24.994056 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f2db6-8546-419b-bdb8-3eab5159c535 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:24.994343 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f2db6-8546-419b-bdb8-3eab5159c535 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:24.994621 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f2db6-8546-419b-bdb8-3eab5159c535 None admin] PATH_INFO: `/v3/projects/f1b2d2ce464841cdb520ee093e9fc8d5` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:24.995765 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f2db6-8546-419b-bdb8-3eab5159c535 None admin] RBAC: Authorizing `identity:get_project(project_id=f1b2d2ce464841cdb520ee093e9fc8d5)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:24.997313 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f2db6-8546-419b-bdb8-3eab5159c535 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:24.999330 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 58/119] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 25 13:11:24 2022] GET /identity/v3/projects/f1b2d2ce464841cdb520ee093e9fc8d5 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:25.000239 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f2db6-8546-419b-bdb8-3eab5159c535 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:25.015010 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e479c734-f2ee-46b7-8827-8f359ef92ee1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:25.017070 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e479c734-f2ee-46b7-8827-8f359ef92ee1 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:25.066185 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:25.070680 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:25.140237 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f2db6-8546-419b-bdb8-3eab5159c535 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:25.145028 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 62/120] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 25 13:11:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 25 13:11:25.146019 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479c734-f2ee-46b7-8827-8f359ef92ee1 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:25.191652 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a49828-1152-4861-b3a7-6a7c18911f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:25.192361 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a49828-1152-4861-b3a7-6a7c18911f19 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:25.192945 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a49828-1152-4861-b3a7-6a7c18911f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:25.193246 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a49828-1152-4861-b3a7-6a7c18911f19 None admin] PATH_INFO: `/v3/users/6a911634c03e45ff8c7a4949e74b4c0c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:25.194704 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a49828-1152-4861-b3a7-6a7c18911f19 None admin] RBAC: Authorizing `identity:get_user(user_id=6a911634c03e45ff8c7a4949e74b4c0c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:25.196202 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a49828-1152-4861-b3a7-6a7c18911f19 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:25.197809 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 59/121] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 25 13:11:24 2022] GET /identity/v3/users/6a911634c03e45ff8c7a4949e74b4c0c => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:25.198596 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a49828-1152-4861-b3a7-6a7c18911f19 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:25.263260 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479c734-f2ee-46b7-8827-8f359ef92ee1 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:25.307253 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977be46-a65c-4f5b-a10f-7c4c3f177ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:25.308222 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977be46-a65c-4f5b-a10f-7c4c3f177ba0 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:25.308513 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977be46-a65c-4f5b-a10f-7c4c3f177ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:25.308794 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977be46-a65c-4f5b-a10f-7c4c3f177ba0 None admin] PATH_INFO: `/v3/projects/f1b2d2ce464841cdb520ee093e9fc8d5` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:25.310087 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f977be46-a65c-4f5b-a10f-7c4c3f177ba0 None admin] RBAC: Authorizing `identity:get_project(project_id=f1b2d2ce464841cdb520ee093e9fc8d5)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:25.312168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f977be46-a65c-4f5b-a10f-7c4c3f177ba0 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:25.314428 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 63/122] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 25 13:11:25 2022] GET /identity/v3/projects/f1b2d2ce464841cdb520ee093e9fc8d5 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:25.314653 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a49828-1152-4861-b3a7-6a7c18911f19 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:25.315208 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977be46-a65c-4f5b-a10f-7c4c3f177ba0 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:25.332869 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:25.336099 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:25.357911 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a361cc-22c5-48ec-a38e-59276b351b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:25.359011 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a361cc-22c5-48ec-a38e-59276b351b48 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:25.359495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a361cc-22c5-48ec-a38e-59276b351b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:25.360582 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a361cc-22c5-48ec-a38e-59276b351b48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:25.361723 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a361cc-22c5-48ec-a38e-59276b351b48 None admin] RBAC: Adding query filter params (role.id=9a3705eba27c47daad42ad874948996d, scope.project.id=f1b2d2ce464841cdb520ee093e9fc8d5, user.id=6a911634c03e45ff8c7a4949e74b4c0c) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:25.362241 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a361cc-22c5-48ec-a38e-59276b351b48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:25.364222 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a361cc-22c5-48ec-a38e-59276b351b48 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:25.371310 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 60/123] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 25 13:11:25 2022] GET /identity/v3/role_assignments?user.id=6a911634c03e45ff8c7a4949e74b4c0c&scope.project.id=f1b2d2ce464841cdb520ee093e9fc8d5&role.id=9a3705eba27c47daad42ad874948996d => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:25.372473 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a361cc-22c5-48ec-a38e-59276b351b48 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:25.437426 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977be46-a65c-4f5b-a10f-7c4c3f177ba0 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:25.480427 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be95e35-fbf3-4f6b-aa77-c513dd145083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:25.481225 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be95e35-fbf3-4f6b-aa77-c513dd145083 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:25.481514 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be95e35-fbf3-4f6b-aa77-c513dd145083 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:25.481795 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be95e35-fbf3-4f6b-aa77-c513dd145083 None admin] PATH_INFO: `/v3/projects/f1b2d2ce464841cdb520ee093e9fc8d5` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:25.482978 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be95e35-fbf3-4f6b-aa77-c513dd145083 None admin] RBAC: Authorizing `identity:get_project(project_id=f1b2d2ce464841cdb520ee093e9fc8d5)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:25.484683 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be95e35-fbf3-4f6b-aa77-c513dd145083 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:25.487637 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 64/124] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 25 13:11:25 2022] GET /identity/v3/projects/f1b2d2ce464841cdb520ee093e9fc8d5 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:25.488504 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be95e35-fbf3-4f6b-aa77-c513dd145083 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:25.589880 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:25.597581 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a361cc-22c5-48ec-a38e-59276b351b48 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:25.616652 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be95e35-fbf3-4f6b-aa77-c513dd145083 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:25.637378 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c01de5b-cf8e-440a-aeb4-6a2f3c4aebd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:25.638007 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01de5b-cf8e-440a-aeb4-6a2f3c4aebd3 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:25.638356 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01de5b-cf8e-440a-aeb4-6a2f3c4aebd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:25.638652 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01de5b-cf8e-440a-aeb4-6a2f3c4aebd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:25.654656 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b869f-936f-4da7-be40-8da09f2629c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:25.655268 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b869f-936f-4da7-be40-8da09f2629c0 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:25.655548 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b869f-936f-4da7-be40-8da09f2629c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:25.655815 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b869f-936f-4da7-be40-8da09f2629c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:25.656577 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b869f-936f-4da7-be40-8da09f2629c0 None admin] RBAC: Adding query filter params (role.id=4c7114fda3ec4652abed55516b5f4315, scope.project.id=f1b2d2ce464841cdb520ee093e9fc8d5, user.id=297f37c6bdb6496db9bb50ba9e5abd95) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:25.657013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b869f-936f-4da7-be40-8da09f2629c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:25.658523 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b869f-936f-4da7-be40-8da09f2629c0 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:25.666107 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 65/125] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 25 13:11:25 2022] GET /identity/v3/role_assignments?user.id=297f37c6bdb6496db9bb50ba9e5abd95&scope.project.id=f1b2d2ce464841cdb520ee093e9fc8d5&role.id=4c7114fda3ec4652abed55516b5f4315 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:25.667191 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b869f-936f-4da7-be40-8da09f2629c0 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:25.705690 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:25.735577 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c01de5b-cf8e-440a-aeb4-6a2f3c4aebd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:25.737592 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c01de5b-cf8e-440a-aeb4-6a2f3c4aebd3 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:25.809381 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b869f-936f-4da7-be40-8da09f2629c0 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:25.848618 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3d8b0-3247-49e1-b932-053eb5d879ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:25.849342 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3d8b0-3247-49e1-b932-053eb5d879ad None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:25.849627 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3d8b0-3247-49e1-b932-053eb5d879ad None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:25.849901 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3d8b0-3247-49e1-b932-053eb5d879ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:25.850645 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b3d8b0-3247-49e1-b932-053eb5d879ad None admin] RBAC: Adding query filter params (role.id=955523e4392d4c278c29f6ce715a5ae6, scope.project.id=f1b2d2ce464841cdb520ee093e9fc8d5, user.id=6a911634c03e45ff8c7a4949e74b4c0c) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:25.850953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b3d8b0-3247-49e1-b932-053eb5d879ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:25.852724 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b3d8b0-3247-49e1-b932-053eb5d879ad None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:25.859070 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 61/126] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 25 13:11:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 25 13:11:25.859524 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 66/127] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 25 13:11:25 2022] GET /identity/v3/role_assignments?user.id=6a911634c03e45ff8c7a4949e74b4c0c&scope.project.id=f1b2d2ce464841cdb520ee093e9fc8d5&role.id=955523e4392d4c278c29f6ce715a5ae6 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:25.865687 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c01de5b-cf8e-440a-aeb4-6a2f3c4aebd3 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:25.966855 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:25.991439 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c01de5b-cf8e-440a-aeb4-6a2f3c4aebd3 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:26.036052 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028a5a5-fc39-4522-8630-7ba379b2918d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:26.036714 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028a5a5-fc39-4522-8630-7ba379b2918d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:26.037000 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028a5a5-fc39-4522-8630-7ba379b2918d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:26.037282 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028a5a5-fc39-4522-8630-7ba379b2918d None admin] PATH_INFO: `/v3/projects/f89344b3a0394b33a64319c7d3bb596d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:26.038451 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028a5a5-fc39-4522-8630-7ba379b2918d None admin] RBAC: Authorizing `identity:get_project(project_id=f89344b3a0394b33a64319c7d3bb596d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:26.040036 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028a5a5-fc39-4522-8630-7ba379b2918d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:26.042201 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 62/128] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 25 13:11:25 2022] GET /identity/v3/projects/f89344b3a0394b33a64319c7d3bb596d => generated 312 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:26.048473 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3d8b0-3247-49e1-b932-053eb5d879ad None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:26.066898 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:26.184664 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3d8b0-3247-49e1-b932-053eb5d879ad None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:26.220947 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7a08e-5d2e-487b-9743-b58b549595c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:26.221487 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7a08e-5d2e-487b-9743-b58b549595c6 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:26.221771 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7a08e-5d2e-487b-9743-b58b549595c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:26.222050 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7a08e-5d2e-487b-9743-b58b549595c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:26.222813 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e7a08e-5d2e-487b-9743-b58b549595c6 None admin] RBAC: Adding query filter params (role.id=9a3705eba27c47daad42ad874948996d, scope.project.id=f89344b3a0394b33a64319c7d3bb596d, user.id=6a911634c03e45ff8c7a4949e74b4c0c) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:26.223124 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e7a08e-5d2e-487b-9743-b58b549595c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:26.224675 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e7a08e-5d2e-487b-9743-b58b549595c6 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:26.231668 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 67/129] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 25 13:11:26 2022] GET /identity/v3/role_assignments?user.id=6a911634c03e45ff8c7a4949e74b4c0c&scope.project.id=f89344b3a0394b33a64319c7d3bb596d&role.id=9a3705eba27c47daad42ad874948996d => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:26.355964 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39faab-a233-4dd0-8ce6-5049c56415ab None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:26.356471 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39faab-a233-4dd0-8ce6-5049c56415ab None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:26.356543 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39faab-a233-4dd0-8ce6-5049c56415ab None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:26.357910 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 63/130] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:26.364388 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485fa11-b936-47bd-8da7-f61363eb1bbb None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:26.364707 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485fa11-b936-47bd-8da7-f61363eb1bbb None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:26.364962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485fa11-b936-47bd-8da7-f61363eb1bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:26.385319 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-f485fa11-b936-47bd-8da7-f61363eb1bbb None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:26.386541 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-f485fa11-b936-47bd-8da7-f61363eb1bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:26.458423 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 68/131] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:11:26.737871 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb39faab-a233-4dd0-8ce6-5049c56415ab None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:26.841021 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb39faab-a233-4dd0-8ce6-5049c56415ab None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:26.874595 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b6e53-0a7e-4eb1-bfbc-cd8f4804d256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:26.875225 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b6e53-0a7e-4eb1-bfbc-cd8f4804d256 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:26.876024 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b6e53-0a7e-4eb1-bfbc-cd8f4804d256 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:26.876308 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b6e53-0a7e-4eb1-bfbc-cd8f4804d256 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:26.877403 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b6e53-0a7e-4eb1-bfbc-cd8f4804d256 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:26.878846 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b6e53-0a7e-4eb1-bfbc-cd8f4804d256 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:26.880455 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 64/132] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:11:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:26.885937 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485fa11-b936-47bd-8da7-f61363eb1bbb None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:26.888108 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:26.983012 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485fa11-b936-47bd-8da7-f61363eb1bbb None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:27.016852 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1fad7b-f1b2-406c-8e91-0c3e597c25b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:27.017455 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fad7b-f1b2-406c-8e91-0c3e597c25b2 None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:27.017739 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fad7b-f1b2-406c-8e91-0c3e597c25b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:27.018021 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fad7b-f1b2-406c-8e91-0c3e597c25b2 None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:27.018667 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1fad7b-f1b2-406c-8e91-0c3e597c25b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:27.020137 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1fad7b-f1b2-406c-8e91-0c3e597c25b2 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:27.045838 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 69/133] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 25 13:11:26 2022] POST /identity/v3/users => generated 283 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:11:27.264642 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ecfa56-78ba-4384-ae9f-3e6258efb21d None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:27.264890 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ecfa56-78ba-4384-ae9f-3e6258efb21d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:27.265128 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ecfa56-78ba-4384-ae9f-3e6258efb21d None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:27.267581 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 65/134] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:27.272722 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a04b1-4c5b-4468-9f51-0be10369419f None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:27.273152 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a04b1-4c5b-4468-9f51-0be10369419f None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:27.273293 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a04b1-4c5b-4468-9f51-0be10369419f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:27.292319 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-d98a04b1-4c5b-4468-9f51-0be10369419f None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:27.293517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-d98a04b1-4c5b-4468-9f51-0be10369419f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:27.350730 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:27.366630 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 70/135] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:11:27.639538 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ecfa56-78ba-4384-ae9f-3e6258efb21d None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:27.660908 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:27.749425 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ecfa56-78ba-4384-ae9f-3e6258efb21d None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:27.785228 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655fd780-540e-450f-8990-d6e60c9ca123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:27.785868 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fd780-540e-450f-8990-d6e60c9ca123 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:27.786149 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fd780-540e-450f-8990-d6e60c9ca123 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:27.786420 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fd780-540e-450f-8990-d6e60c9ca123 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:27.797957 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655fd780-540e-450f-8990-d6e60c9ca123 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:11:27.802938 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-655fd780-540e-450f-8990-d6e60c9ca123 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 25 13:11:27.802938 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:11:27.802938 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:11:27.802938 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:11:27.802938 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:11:27.802938 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:11:27.802938 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:11:27.802938 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:11:27.802938 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:11:27.802938 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:11:27.802938 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:11:27.802938 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:11:27.802938 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:11:27.802938 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:11:27.802938 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:11:27.802938 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:11:27.803779 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:11:27.803779 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:11:27.803779 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:11:27.803779 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:11:27.803779 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:11:27.803779 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:11:27.803779 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:11:27.803779 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:11:27.803779 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:11:27.803779 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:11:27.803779 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:11:27.803779 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:11:27.803779 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:11:27.803779 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:11:27.803779 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:11:27.803779 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:11:27.804626 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:11:27.804626 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:11:27.804626 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:11:27.804626 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:11:27.804626 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:11:27.804626 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:11:27.804626 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:11:27.804626 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:11:27.804626 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:11:27.804626 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:11:27.804626 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 25 13:11:27.804626 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:11:27.804626 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 66/136] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 25 13:11:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:11:27.811287 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a04b1-4c5b-4468-9f51-0be10369419f None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:27.916637 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a04b1-4c5b-4468-9f51-0be10369419f None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:27.954320 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682afe86-d20b-4ec4-8f59-7c428e78acf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:27.954973 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682afe86-d20b-4ec4-8f59-7c428e78acf8 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:27.955258 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682afe86-d20b-4ec4-8f59-7c428e78acf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:27.955531 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682afe86-d20b-4ec4-8f59-7c428e78acf8 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:27.956235 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682afe86-d20b-4ec4-8f59-7c428e78acf8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:27.956538 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682afe86-d20b-4ec4-8f59-7c428e78acf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:27.957989 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682afe86-d20b-4ec4-8f59-7c428e78acf8 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:27.966489 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 71/137] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 25 13:11:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:27.972535 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655fd780-540e-450f-8990-d6e60c9ca123 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:28.060073 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:28.082914 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655fd780-540e-450f-8990-d6e60c9ca123 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:28.119548 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814834a-b13d-4dc9-bad7-568e994058c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:28.120271 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814834a-b13d-4dc9-bad7-568e994058c2 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:28.120560 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814834a-b13d-4dc9-bad7-568e994058c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:28.120832 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814834a-b13d-4dc9-bad7-568e994058c2 None admin] PATH_INFO: `/v3/users/8ec6fc9de3dd4346b459188f52b0b571` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:28.121964 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814834a-b13d-4dc9-bad7-568e994058c2 None admin] RBAC: Authorizing `identity:get_user(user_id=8ec6fc9de3dd4346b459188f52b0b571)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:28.123509 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814834a-b13d-4dc9-bad7-568e994058c2 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:28.125270 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 67/138] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 25 13:11:27 2022] GET /identity/v3/users/8ec6fc9de3dd4346b459188f52b0b571 => generated 289 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:28.131184 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682afe86-d20b-4ec4-8f59-7c428e78acf8 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:28.184807 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:28.241944 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682afe86-d20b-4ec4-8f59-7c428e78acf8 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:28.281062 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05482ad3-6d79-4eac-8fd3-7e1301249308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:28.281670 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05482ad3-6d79-4eac-8fd3-7e1301249308 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:28.281989 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05482ad3-6d79-4eac-8fd3-7e1301249308 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:28.282269 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05482ad3-6d79-4eac-8fd3-7e1301249308 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:28.355762 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05482ad3-6d79-4eac-8fd3-7e1301249308 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:28.357286 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05482ad3-6d79-4eac-8fd3-7e1301249308 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:28.424271 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:28.464870 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 72/139] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 25 13:11:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 25 13:11:28.470523 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814834a-b13d-4dc9-bad7-568e994058c2 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:28.574239 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814834a-b13d-4dc9-bad7-568e994058c2 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:28.608822 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377491a8-96d4-4e51-b52b-1a0797d35cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:28.609458 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377491a8-96d4-4e51-b52b-1a0797d35cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:28.609738 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377491a8-96d4-4e51-b52b-1a0797d35cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:28.612138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377491a8-96d4-4e51-b52b-1a0797d35cf1 None admin] PATH_INFO: `/v3/projects/f1b2d2ce464841cdb520ee093e9fc8d5` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:28.613286 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377491a8-96d4-4e51-b52b-1a0797d35cf1 None admin] RBAC: Authorizing `identity:get_project(project_id=f1b2d2ce464841cdb520ee093e9fc8d5)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:28.614812 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377491a8-96d4-4e51-b52b-1a0797d35cf1 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:28.616536 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 68/140] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 25 13:11:28 2022] GET /identity/v3/projects/f1b2d2ce464841cdb520ee093e9fc8d5 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:28.622374 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05482ad3-6d79-4eac-8fd3-7e1301249308 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:28.730798 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05482ad3-6d79-4eac-8fd3-7e1301249308 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:28.767353 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2287be-58af-4213-98c2-78163bd6bdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:28.768221 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2287be-58af-4213-98c2-78163bd6bdd7 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:28.768654 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2287be-58af-4213-98c2-78163bd6bdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:28.769060 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2287be-58af-4213-98c2-78163bd6bdd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:28.769909 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2287be-58af-4213-98c2-78163bd6bdd7 None admin] RBAC: Adding query filter params (role.id=cf3c7c662d454e63953da94d2d986171, scope.project.id=f1b2d2ce464841cdb520ee093e9fc8d5, user.id=8ec6fc9de3dd4346b459188f52b0b571) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:28.770355 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2287be-58af-4213-98c2-78163bd6bdd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:28.771933 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2287be-58af-4213-98c2-78163bd6bdd7 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:28.778035 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 73/141] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 25 13:11:28 2022] GET /identity/v3/role_assignments?user.id=8ec6fc9de3dd4346b459188f52b0b571&scope.project.id=f1b2d2ce464841cdb520ee093e9fc8d5&role.id=cf3c7c662d454e63953da94d2d986171 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:29.342454 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881f730-4f3b-4724-bdd8-bc07cd125e79 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:29.342965 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881f730-4f3b-4724-bdd8-bc07cd125e79 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:29.343039 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881f730-4f3b-4724-bdd8-bc07cd125e79 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:29.344628 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 69/142] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:29.349711 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd3c44-47bd-4add-b507-be4fde87544d None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:29.350106 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd3c44-47bd-4add-b507-be4fde87544d None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:29.350299 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd3c44-47bd-4add-b507-be4fde87544d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:29.368617 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-f9bd3c44-47bd-4add-b507-be4fde87544d None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:29.369801 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-f9bd3c44-47bd-4add-b507-be4fde87544d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:29.380282 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:29.441086 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 74/143] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:11:29.565235 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa649ab-a49a-453a-8507-0c6a336560e4 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:29.565523 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa649ab-a49a-453a-8507-0c6a336560e4 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:29.565970 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa649ab-a49a-453a-8507-0c6a336560e4 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:29.567321 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 70/144] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:29.572742 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07a4d8-8980-4736-91e2-03d760cd5670 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:29.573034 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07a4d8-8980-4736-91e2-03d760cd5670 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:29.573311 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07a4d8-8980-4736-91e2-03d760cd5670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:29.586573 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5954342-139d-4385-aee4-8fe51efe35f6 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:29.586865 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5954342-139d-4385-aee4-8fe51efe35f6 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:29.587148 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5954342-139d-4385-aee4-8fe51efe35f6 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:29.588498 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 71/145] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 13:11:29.591678 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-af07a4d8-8980-4736-91e2-03d760cd5670 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:29.593099 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-af07a4d8-8980-4736-91e2-03d760cd5670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:29.593301 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4360eef-27aa-4410-89d0-efe0fc7ab7e0 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:29.593587 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4360eef-27aa-4410-89d0-efe0fc7ab7e0 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:29.593869 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4360eef-27aa-4410-89d0-efe0fc7ab7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:29.611939 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c4360eef-27aa-4410-89d0-efe0fc7ab7e0 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:29.613128 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c4360eef-27aa-4410-89d0-efe0fc7ab7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:29.622434 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:29.666762 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 75/146] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:11:29.685094 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 72/147] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 25 13:11:29.713942 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07a4d8-8980-4736-91e2-03d760cd5670 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:29.791405 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:29.818990 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07a4d8-8980-4736-91e2-03d760cd5670 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:29.853146 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a7b87c-ab37-4381-ad65-5040960fa93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:29.853698 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7b87c-ab37-4381-ad65-5040960fa93e None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:29.853977 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7b87c-ab37-4381-ad65-5040960fa93e None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:29.854247 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7b87c-ab37-4381-ad65-5040960fa93e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:29.864255 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a7b87c-ab37-4381-ad65-5040960fa93e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:11:29.869038 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-39a7b87c-ab37-4381-ad65-5040960fa93e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 13:11:29.869038 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:11:29.869038 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:11:29.869038 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:11:29.869038 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:11:29.869038 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:11:29.869038 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:11:29.869038 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:11:29.869038 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:11:29.869038 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:11:29.869038 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:11:29.869038 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:11:29.869038 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:11:29.869038 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:11:29.869038 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:11:29.869038 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:11:29.869843 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:11:29.869843 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:11:29.869843 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:11:29.869843 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:11:29.869843 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:11:29.869843 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:11:29.869843 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:11:29.869843 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:11:29.869843 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:11:29.869843 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:11:29.869843 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:11:29.869843 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:11:29.869843 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:11:29.869843 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:11:29.869843 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:11:29.869843 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:11:29.871289 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:11:29.871289 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:11:29.871289 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:11:29.871289 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:11:29.871289 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:11:29.871289 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:11:29.871289 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:11:29.871289 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:11:29.871289 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:11:29.871289 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:11:29.871289 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 13:11:29.871289 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:11:29.871289 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 76/148] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 25 13:11:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:11:29.876424 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4360eef-27aa-4410-89d0-efe0fc7ab7e0 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:29.938229 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a7b87c-ab37-4381-ad65-5040960fa93e None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:29.980983 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4360eef-27aa-4410-89d0-efe0fc7ab7e0 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:30.015969 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd412b4-f2a4-4d91-be68-7bcb8a04839f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:30.016636 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd412b4-f2a4-4d91-be68-7bcb8a04839f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:30.016974 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd412b4-f2a4-4d91-be68-7bcb8a04839f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:30.017264 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd412b4-f2a4-4d91-be68-7bcb8a04839f None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:30.017933 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd412b4-f2a4-4d91-be68-7bcb8a04839f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:30.018236 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd412b4-f2a4-4d91-be68-7bcb8a04839f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:30.019640 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd412b4-f2a4-4d91-be68-7bcb8a04839f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:30.027643 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 73/149] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 25 13:11:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:30.028462 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd412b4-f2a4-4d91-be68-7bcb8a04839f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:30.037975 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:30.040833 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a7b87c-ab37-4381-ad65-5040960fa93e None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:30.075352 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299de8e0-7ce3-4417-b2de-8248655d4eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:30.076004 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299de8e0-7ce3-4417-b2de-8248655d4eb2 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:30.076284 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299de8e0-7ce3-4417-b2de-8248655d4eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:30.076556 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299de8e0-7ce3-4417-b2de-8248655d4eb2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:30.077655 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299de8e0-7ce3-4417-b2de-8248655d4eb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:30.079628 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299de8e0-7ce3-4417-b2de-8248655d4eb2 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:30.081212 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 77/150] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:11:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:30.081972 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299de8e0-7ce3-4417-b2de-8248655d4eb2 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:30.084501 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:30.131517 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd412b4-f2a4-4d91-be68-7bcb8a04839f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:30.164641 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9115423-0f8c-4d01-aa8c-9becd8b318c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:30.165266 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9115423-0f8c-4d01-aa8c-9becd8b318c4 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:30.165542 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9115423-0f8c-4d01-aa8c-9becd8b318c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:30.165808 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9115423-0f8c-4d01-aa8c-9becd8b318c4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:30.176621 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9115423-0f8c-4d01-aa8c-9becd8b318c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:11:30.181804 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-b9115423-0f8c-4d01-aa8c-9becd8b318c4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 13:11:30.181804 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:11:30.181804 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:11:30.181804 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:11:30.181804 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:11:30.181804 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:11:30.181804 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:11:30.181804 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:11:30.181804 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:11:30.181804 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:11:30.181804 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:11:30.181804 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:11:30.181804 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:11:30.181804 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:11:30.181804 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:11:30.181804 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:11:30.183712 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:11:30.183712 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:11:30.183712 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:11:30.183712 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:11:30.183712 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:11:30.183712 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:11:30.183712 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:11:30.183712 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:11:30.183712 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:11:30.183712 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:11:30.183712 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:11:30.183712 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:11:30.183712 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:11:30.183712 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:11:30.183712 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:11:30.183712 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:11:30.185365 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:11:30.185365 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:11:30.185365 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:11:30.185365 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:11:30.185365 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:11:30.185365 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:11:30.185365 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:11:30.185365 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:11:30.185365 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:11:30.185365 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:11:30.185365 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 13:11:30.185365 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:11:30.185365 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 74/151] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 25 13:11:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:11:30.185365 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9115423-0f8c-4d01-aa8c-9becd8b318c4 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:30.186905 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299de8e0-7ce3-4417-b2de-8248655d4eb2 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:30.220130 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c46ba-d31b-46bd-9428-af7cbce4d2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:30.220745 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c46ba-d31b-46bd-9428-af7cbce4d2de None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:30.221018 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c46ba-d31b-46bd-9428-af7cbce4d2de None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:30.221296 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c46ba-d31b-46bd-9428-af7cbce4d2de None admin] PATH_INFO: `/v3/users/9a7a2e576c6e47d79da0950a9e3a9c46` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:30.233754 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c46ba-d31b-46bd-9428-af7cbce4d2de None admin] RBAC: Authorizing `identity:get_user(user_id=9a7a2e576c6e47d79da0950a9e3a9c46)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:30.235708 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c46ba-d31b-46bd-9428-af7cbce4d2de None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:30.237340 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 78/152] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 25 13:11:30 2022] GET /identity/v3/users/9a7a2e576c6e47d79da0950a9e3a9c46 => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:30.238100 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c46ba-d31b-46bd-9428-af7cbce4d2de None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:30.255748 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:30.292302 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9115423-0f8c-4d01-aa8c-9becd8b318c4 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:30.298459 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:30.326907 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db7701-1789-487f-8598-3b34e7b254bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:30.327505 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db7701-1789-487f-8598-3b34e7b254bd None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:30.327780 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db7701-1789-487f-8598-3b34e7b254bd None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:30.328083 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db7701-1789-487f-8598-3b34e7b254bd None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:30.329182 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db7701-1789-487f-8598-3b34e7b254bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:30.330638 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db7701-1789-487f-8598-3b34e7b254bd None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:30.338778 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c46ba-d31b-46bd-9428-af7cbce4d2de None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:30.356361 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 75/153] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 25 13:11:30 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:11:30.357491 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db7701-1789-487f-8598-3b34e7b254bd None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:30.390743 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be49251-78fc-430a-88eb-f94b6d990134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:30.392009 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be49251-78fc-430a-88eb-f94b6d990134 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:30.392293 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be49251-78fc-430a-88eb-f94b6d990134 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:30.392569 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be49251-78fc-430a-88eb-f94b6d990134 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:30.393245 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be49251-78fc-430a-88eb-f94b6d990134 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:30.393700 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be49251-78fc-430a-88eb-f94b6d990134 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:30.395276 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be49251-78fc-430a-88eb-f94b6d990134 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:30.405217 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 79/154] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 25 13:11:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:30.412176 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be49251-78fc-430a-88eb-f94b6d990134 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:30.475674 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db7701-1789-487f-8598-3b34e7b254bd None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:30.505418 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:30.520358 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7bff9-db1e-4625-8fce-35a078bbe274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:30.521004 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7bff9-db1e-4625-8fce-35a078bbe274 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:30.521285 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7bff9-db1e-4625-8fce-35a078bbe274 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:30.521839 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7bff9-db1e-4625-8fce-35a078bbe274 None admin] PATH_INFO: `/v3/projects/9345d01ad6914f64aaa073a1e6a86a02` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:30.522811 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d7bff9-db1e-4625-8fce-35a078bbe274 None admin] RBAC: Authorizing `identity:get_project(project_id=9345d01ad6914f64aaa073a1e6a86a02)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:30.524369 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d7bff9-db1e-4625-8fce-35a078bbe274 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:30.526403 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 76/155] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 25 13:11:30 2022] GET /identity/v3/projects/9345d01ad6914f64aaa073a1e6a86a02 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:30.527986 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be49251-78fc-430a-88eb-f94b6d990134 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:30.532637 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7bff9-db1e-4625-8fce-35a078bbe274 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:30.556591 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:30.571731 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26c26f-83d7-40bd-a58b-6009544343a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:30.572467 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26c26f-83d7-40bd-a58b-6009544343a2 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:30.572775 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26c26f-83d7-40bd-a58b-6009544343a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:30.573050 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26c26f-83d7-40bd-a58b-6009544343a2 None admin] PATH_INFO: `/v3/users/9a7a2e576c6e47d79da0950a9e3a9c46` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:30.574178 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a26c26f-83d7-40bd-a58b-6009544343a2 None admin] RBAC: Authorizing `identity:get_user(user_id=9a7a2e576c6e47d79da0950a9e3a9c46)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:30.575622 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a26c26f-83d7-40bd-a58b-6009544343a2 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:30.577239 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 80/156] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 25 13:11:30 2022] GET /identity/v3/users/9a7a2e576c6e47d79da0950a9e3a9c46 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:30.582876 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26c26f-83d7-40bd-a58b-6009544343a2 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:30.670721 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7bff9-db1e-4625-8fce-35a078bbe274 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:30.715702 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26c26f-83d7-40bd-a58b-6009544343a2 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:30.719995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674b992-a940-47ba-8af4-47c42858bcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:30.720908 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674b992-a940-47ba-8af4-47c42858bcaf None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:30.721367 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674b992-a940-47ba-8af4-47c42858bcaf None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:30.721958 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674b992-a940-47ba-8af4-47c42858bcaf None admin] PATH_INFO: `/v3/projects/9345d01ad6914f64aaa073a1e6a86a02/users/9a7a2e576c6e47d79da0950a9e3a9c46/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:30.724254 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d674b992-a940-47ba-8af4-47c42858bcaf None admin] RBAC: Authorizing `identity:create_grant(project_id=9345d01ad6914f64aaa073a1e6a86a02, user_id=9a7a2e576c6e47d79da0950a9e3a9c46, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:30.726546 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d674b992-a940-47ba-8af4-47c42858bcaf None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:30.742469 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 77/157] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 25 13:11:30 2022] PUT /identity/v3/projects/9345d01ad6914f64aaa073a1e6a86a02/users/9a7a2e576c6e47d79da0950a9e3a9c46/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:11:30.771560 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c2bd1-774a-42f3-b162-d3e0ab7abf53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:30.771560 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c2bd1-774a-42f3-b162-d3e0ab7abf53 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:30.771560 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c2bd1-774a-42f3-b162-d3e0ab7abf53 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:30.771560 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c2bd1-774a-42f3-b162-d3e0ab7abf53 None admin] PATH_INFO: `/v3/projects/9345d01ad6914f64aaa073a1e6a86a02` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:30.776635 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3c2bd1-774a-42f3-b162-d3e0ab7abf53 None admin] RBAC: Authorizing `identity:get_project(project_id=9345d01ad6914f64aaa073a1e6a86a02)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:30.776635 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3c2bd1-774a-42f3-b162-d3e0ab7abf53 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:30.777186 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 81/158] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 25 13:11:30 2022] GET /identity/v3/projects/9345d01ad6914f64aaa073a1e6a86a02 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:11:30.784497 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674b992-a940-47ba-8af4-47c42858bcaf None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:30.841762 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:30.905938 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674b992-a940-47ba-8af4-47c42858bcaf None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:30.945595 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd89a80-855b-4147-bd9d-d44aa1003fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:30.946190 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd89a80-855b-4147-bd9d-d44aa1003fc9 None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:30.946471 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd89a80-855b-4147-bd9d-d44aa1003fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:30.946749 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd89a80-855b-4147-bd9d-d44aa1003fc9 None admin] PATH_INFO: `/v3/projects/9345d01ad6914f64aaa073a1e6a86a02/users/9a7a2e576c6e47d79da0950a9e3a9c46/roles/955523e4392d4c278c29f6ce715a5ae6` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:30.949004 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd89a80-855b-4147-bd9d-d44aa1003fc9 None admin] RBAC: Authorizing `identity:create_grant(project_id=9345d01ad6914f64aaa073a1e6a86a02, user_id=9a7a2e576c6e47d79da0950a9e3a9c46, role_id=955523e4392d4c278c29f6ce715a5ae6)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:30.950476 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd89a80-855b-4147-bd9d-d44aa1003fc9 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:30.969007 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 78/159] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 25 13:11:30 2022] PUT /identity/v3/projects/9345d01ad6914f64aaa073a1e6a86a02/users/9a7a2e576c6e47d79da0950a9e3a9c46/roles/955523e4392d4c278c29f6ce715a5ae6 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:11:32.714218 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c19a6e-9410-4056-bb9c-ece57778bb96 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:32.714742 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c19a6e-9410-4056-bb9c-ece57778bb96 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:32.714742 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c19a6e-9410-4056-bb9c-ece57778bb96 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:32.716193 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 82/160] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:32.723449 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0b718-7067-4036-b236-7427d0e4d382 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:32.723940 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0b718-7067-4036-b236-7427d0e4d382 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:32.724019 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0b718-7067-4036-b236-7427d0e4d382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:32.744884 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-eda0b718-7067-4036-b236-7427d0e4d382 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:32.746081 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-eda0b718-7067-4036-b236-7427d0e4d382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:32.819006 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 79/161] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:11:32.835423 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2074f-bacb-4d31-82bb-f0a1a73c57c0 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:32.836046 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2074f-bacb-4d31-82bb-f0a1a73c57c0 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:32.836559 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2074f-bacb-4d31-82bb-f0a1a73c57c0 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:32.838184 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 83/162] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:32.843572 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fe3a0-45ea-4b4d-adc1-9f69ee2e2377 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:32.844785 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fe3a0-45ea-4b4d-adc1-9f69ee2e2377 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:32.845330 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fe3a0-45ea-4b4d-adc1-9f69ee2e2377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:32.865810 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f06fe3a0-45ea-4b4d-adc1-9f69ee2e2377 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:32.867291 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f06fe3a0-45ea-4b4d-adc1-9f69ee2e2377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:32.907818 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:32.945048 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 80/163] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:11:33.025210 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e05191-88c1-4998-a663-356105696689 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:33.025210 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e05191-88c1-4998-a663-356105696689 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:33.025210 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e05191-88c1-4998-a663-356105696689 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:33.025210 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 84/164] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:33.034527 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbda10d-9e28-4840-b553-81299724ad7e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:33.034818 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbda10d-9e28-4840-b553-81299724ad7e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:33.035091 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbda10d-9e28-4840-b553-81299724ad7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:33.055921 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-bbbda10d-9e28-4840-b553-81299724ad7e None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:33.056606 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-bbbda10d-9e28-4840-b553-81299724ad7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:33.107039 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e05191-88c1-4998-a663-356105696689 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:33.138008 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 81/165] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:11:33.217653 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347dff13-cc4e-4743-951b-1cab095c3362 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:33.218663 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347dff13-cc4e-4743-951b-1cab095c3362 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:33.219767 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347dff13-cc4e-4743-951b-1cab095c3362 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:33.221637 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:33.221767 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 82/166] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:33.229366 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628f743-5e21-435f-b8fb-5b517864b10a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:33.229893 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628f743-5e21-435f-b8fb-5b517864b10a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:33.230187 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628f743-5e21-435f-b8fb-5b517864b10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:33.252368 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a628f743-5e21-435f-b8fb-5b517864b10a None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:33.253562 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a628f743-5e21-435f-b8fb-5b517864b10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:33.319505 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e05191-88c1-4998-a663-356105696689 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:33.341721 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 83/167] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 25 13:11:33.342741 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628f743-5e21-435f-b8fb-5b517864b10a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:33.385331 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c86fff-9920-493f-bc61-be1fd182886f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:33.387612 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c86fff-9920-493f-bc61-be1fd182886f None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:33.388197 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c86fff-9920-493f-bc61-be1fd182886f None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:33.389020 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c86fff-9920-493f-bc61-be1fd182886f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:33.394937 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:33.404852 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c86fff-9920-493f-bc61-be1fd182886f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:11:33.411638 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-b4c86fff-9920-493f-bc61-be1fd182886f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 25 13:11:33.411638 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:11:33.411638 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:11:33.411638 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:11:33.411638 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:11:33.411638 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:11:33.411638 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:11:33.411638 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:11:33.411638 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:11:33.411638 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:11:33.411638 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:11:33.411638 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:11:33.411638 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:11:33.411638 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:11:33.411638 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:11:33.411638 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:11:33.412588 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:11:33.412588 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:11:33.412588 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:11:33.412588 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:11:33.412588 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:11:33.412588 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:11:33.412588 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:11:33.412588 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:11:33.412588 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:11:33.412588 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:11:33.412588 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:11:33.412588 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:11:33.412588 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:11:33.412588 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:11:33.412588 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:11:33.412588 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:11:33.413375 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:11:33.413375 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:11:33.413375 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:11:33.413375 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:11:33.413375 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:11:33.413375 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:11:33.413375 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:11:33.413375 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:11:33.413375 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:11:33.413375 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:11:33.413375 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 25 13:11:33.413375 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:11:33.418405 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 85/168] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 25 13:11:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:11:33.423498 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c86fff-9920-493f-bc61-be1fd182886f None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:33.501829 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628f743-5e21-435f-b8fb-5b517864b10a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:33.545304 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fb78e-b287-4a35-9f76-1143a2e617c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:33.545785 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c86fff-9920-493f-bc61-be1fd182886f None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:33.546522 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fb78e-b287-4a35-9f76-1143a2e617c3 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:33.547111 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fb78e-b287-4a35-9f76-1143a2e617c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:33.547644 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fb78e-b287-4a35-9f76-1143a2e617c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:33.549534 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8fb78e-b287-4a35-9f76-1143a2e617c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:33.551249 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8fb78e-b287-4a35-9f76-1143a2e617c3 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:33.553877 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 84/169] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:11:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:33.554925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fb78e-b287-4a35-9f76-1143a2e617c3 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:33.566707 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:33.585699 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d07fc-e823-410c-a293-fa183fbb80f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:33.586241 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d07fc-e823-410c-a293-fa183fbb80f4 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:33.586521 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d07fc-e823-410c-a293-fa183fbb80f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:33.586795 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d07fc-e823-410c-a293-fa183fbb80f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:33.587453 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1d07fc-e823-410c-a293-fa183fbb80f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:33.587754 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1d07fc-e823-410c-a293-fa183fbb80f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:33.589160 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1d07fc-e823-410c-a293-fa183fbb80f4 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:33.598106 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 86/170] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 25 13:11:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:11:33.598793 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d07fc-e823-410c-a293-fa183fbb80f4 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:33.664451 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:33.668705 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fb78e-b287-4a35-9f76-1143a2e617c3 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:33.701462 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d07fc-e823-410c-a293-fa183fbb80f4 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:33.703351 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3749d804-a143-4260-9eee-28808fe839b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:33.704520 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749d804-a143-4260-9eee-28808fe839b7 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:33.704795 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749d804-a143-4260-9eee-28808fe839b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:33.705067 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749d804-a143-4260-9eee-28808fe839b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:33.715202 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3749d804-a143-4260-9eee-28808fe839b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:11:33.722835 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-3749d804-a143-4260-9eee-28808fe839b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 13:11:33.722835 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:11:33.722835 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:11:33.722835 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:11:33.722835 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:11:33.722835 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:11:33.722835 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:11:33.722835 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:11:33.722835 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:11:33.722835 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:11:33.722835 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:11:33.722835 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:11:33.722835 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:11:33.722835 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:11:33.722835 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:11:33.722835 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:11:33.724423 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:11:33.724423 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:11:33.724423 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:11:33.724423 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:11:33.724423 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:11:33.724423 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:11:33.724423 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:11:33.724423 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:11:33.724423 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:11:33.724423 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:11:33.724423 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:11:33.724423 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:11:33.724423 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:11:33.724423 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:11:33.724423 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:11:33.724423 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:11:33.725244 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:11:33.725244 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:11:33.725244 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:11:33.725244 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:11:33.725244 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:11:33.725244 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:11:33.725244 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:11:33.725244 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:11:33.725244 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:11:33.725244 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:11:33.725244 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 13:11:33.725244 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:11:33.725244 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 85/171] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 25 13:11:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:11:33.725244 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3749d804-a143-4260-9eee-28808fe839b7 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:33.742276 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5619e8-8fde-44e7-9e23-850ceeb4ff9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:33.742890 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5619e8-8fde-44e7-9e23-850ceeb4ff9a None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:33.743170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5619e8-8fde-44e7-9e23-850ceeb4ff9a None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:33.743442 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5619e8-8fde-44e7-9e23-850ceeb4ff9a None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:33.744137 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5619e8-8fde-44e7-9e23-850ceeb4ff9a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:33.745573 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5619e8-8fde-44e7-9e23-850ceeb4ff9a None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:33.767387 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 87/172] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 25 13:11:33 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:11:33.768135 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5619e8-8fde-44e7-9e23-850ceeb4ff9a None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:33.809151 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:33.840778 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3749d804-a143-4260-9eee-28808fe839b7 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:33.880910 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a99eb-3d27-4a8d-b9e8-f4f7e562a24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:33.881671 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a99eb-3d27-4a8d-b9e8-f4f7e562a24d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:33.881954 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a99eb-3d27-4a8d-b9e8-f4f7e562a24d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:33.882339 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a99eb-3d27-4a8d-b9e8-f4f7e562a24d None admin] PATH_INFO: `/v3/users/062e83ae9b8d43368a32e5afc6742c29` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:33.885249 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5619e8-8fde-44e7-9e23-850ceeb4ff9a None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:33.898659 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a99eb-3d27-4a8d-b9e8-f4f7e562a24d None admin] RBAC: Authorizing `identity:get_user(user_id=062e83ae9b8d43368a32e5afc6742c29)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:33.900433 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a99eb-3d27-4a8d-b9e8-f4f7e562a24d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:33.906794 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 86/173] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 25 13:11:33 2022] GET /identity/v3/users/062e83ae9b8d43368a32e5afc6742c29 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:33.906794 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a99eb-3d27-4a8d-b9e8-f4f7e562a24d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:33.926561 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:33.927064 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a223db-a835-4ee0-b8cf-24c39b564f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:33.927787 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a223db-a835-4ee0-b8cf-24c39b564f3b None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:33.928159 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a223db-a835-4ee0-b8cf-24c39b564f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:33.928824 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a223db-a835-4ee0-b8cf-24c39b564f3b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:33.941079 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a223db-a835-4ee0-b8cf-24c39b564f3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:11:33.946507 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-61a223db-a835-4ee0-b8cf-24c39b564f3b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 13:11:33.946507 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:11:33.946507 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:11:33.946507 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:11:33.946507 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:11:33.946507 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:11:33.946507 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:11:33.946507 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:11:33.946507 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:11:33.946507 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:11:33.946507 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:11:33.946507 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:11:33.946507 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:11:33.946507 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:11:33.946507 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:11:33.946507 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:11:33.947397 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:11:33.947397 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:11:33.947397 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:11:33.947397 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:11:33.947397 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:11:33.947397 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:11:33.947397 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:11:33.947397 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:11:33.947397 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:11:33.947397 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:11:33.947397 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:11:33.947397 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:11:33.947397 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:11:33.947397 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:11:33.947397 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:11:33.947397 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:11:33.948222 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:11:33.948222 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:11:33.948222 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:11:33.948222 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:11:33.948222 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:11:33.948222 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:11:33.948222 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:11:33.948222 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:11:33.948222 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:11:33.948222 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:11:33.948222 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 13:11:33.948222 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:11:33.948222 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 88/174] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 25 13:11:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:11:33.948903 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a223db-a835-4ee0-b8cf-24c39b564f3b None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:34.041390 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a99eb-3d27-4a8d-b9e8-f4f7e562a24d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:34.063263 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:34.073957 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a223db-a835-4ee0-b8cf-24c39b564f3b None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:34.087689 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce2e4f-2219-4de9-9843-99729dd45dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:34.088599 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce2e4f-2219-4de9-9843-99729dd45dc5 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:34.089038 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce2e4f-2219-4de9-9843-99729dd45dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:34.089466 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce2e4f-2219-4de9-9843-99729dd45dc5 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:34.090284 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce2e4f-2219-4de9-9843-99729dd45dc5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:34.090851 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce2e4f-2219-4de9-9843-99729dd45dc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:34.092569 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce2e4f-2219-4de9-9843-99729dd45dc5 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:34.103689 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 87/175] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 25 13:11:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:34.104612 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce2e4f-2219-4de9-9843-99729dd45dc5 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:34.121940 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc4d13-f31f-4e47-bf03-af604e1984e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:34.122594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc4d13-f31f-4e47-bf03-af604e1984e0 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:34.122867 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc4d13-f31f-4e47-bf03-af604e1984e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:34.123810 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc4d13-f31f-4e47-bf03-af604e1984e0 None admin] PATH_INFO: `/v3/projects/9345d01ad6914f64aaa073a1e6a86a02` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:34.124814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc4d13-f31f-4e47-bf03-af604e1984e0 None admin] RBAC: Authorizing `identity:get_project(project_id=9345d01ad6914f64aaa073a1e6a86a02)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:34.126966 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc4d13-f31f-4e47-bf03-af604e1984e0 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:34.128790 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 89/176] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 25 13:11:33 2022] GET /identity/v3/projects/9345d01ad6914f64aaa073a1e6a86a02 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:34.129448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc4d13-f31f-4e47-bf03-af604e1984e0 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:34.201460 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:34.226076 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce2e4f-2219-4de9-9843-99729dd45dc5 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:34.259277 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc4d13-f31f-4e47-bf03-af604e1984e0 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:34.262459 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f419eb5-acd6-4885-a65f-1fc533d6bd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:34.263200 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f419eb5-acd6-4885-a65f-1fc533d6bd5a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:34.263581 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f419eb5-acd6-4885-a65f-1fc533d6bd5a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:34.264003 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f419eb5-acd6-4885-a65f-1fc533d6bd5a None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:34.264779 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f419eb5-acd6-4885-a65f-1fc533d6bd5a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:34.265185 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f419eb5-acd6-4885-a65f-1fc533d6bd5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:34.267278 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f419eb5-acd6-4885-a65f-1fc533d6bd5a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:34.275987 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 88/177] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 25 13:11:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:34.282482 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f419eb5-acd6-4885-a65f-1fc533d6bd5a None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:34.303492 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d6dc5-c8a5-4ef2-b6a7-bd348149abca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:34.305028 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d6dc5-c8a5-4ef2-b6a7-bd348149abca None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:34.305857 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d6dc5-c8a5-4ef2-b6a7-bd348149abca None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:34.306552 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d6dc5-c8a5-4ef2-b6a7-bd348149abca None admin] PATH_INFO: `/v3/users/9a7a2e576c6e47d79da0950a9e3a9c46` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:34.308276 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d6dc5-c8a5-4ef2-b6a7-bd348149abca None admin] RBAC: Authorizing `identity:get_user(user_id=9a7a2e576c6e47d79da0950a9e3a9c46)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:34.310835 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d6dc5-c8a5-4ef2-b6a7-bd348149abca None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:34.313754 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 90/178] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 25 13:11:34 2022] GET /identity/v3/users/9a7a2e576c6e47d79da0950a9e3a9c46 => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:34.314794 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d6dc5-c8a5-4ef2-b6a7-bd348149abca None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:34.358452 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:34.401230 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f419eb5-acd6-4885-a65f-1fc533d6bd5a None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:34.439919 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f1042-ec43-4729-96fe-a00e68994f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:34.441014 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f1042-ec43-4729-96fe-a00e68994f7c None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:34.441014 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f1042-ec43-4729-96fe-a00e68994f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:34.441400 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f1042-ec43-4729-96fe-a00e68994f7c None admin] PATH_INFO: `/v3/projects/9345d01ad6914f64aaa073a1e6a86a02/users/062e83ae9b8d43368a32e5afc6742c29/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:34.443500 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90f1042-ec43-4729-96fe-a00e68994f7c None admin] RBAC: Authorizing `identity:create_grant(project_id=9345d01ad6914f64aaa073a1e6a86a02, user_id=062e83ae9b8d43368a32e5afc6742c29, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:34.445080 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90f1042-ec43-4729-96fe-a00e68994f7c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:34.456111 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d6dc5-c8a5-4ef2-b6a7-bd348149abca None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:34.457825 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:34.466195 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 89/179] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 25 13:11:34 2022] PUT /identity/v3/projects/9345d01ad6914f64aaa073a1e6a86a02/users/062e83ae9b8d43368a32e5afc6742c29/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:11:34.467321 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f1042-ec43-4729-96fe-a00e68994f7c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:34.495791 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cec2ad-b9e0-41ba-b301-91d1aebe68e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:34.496738 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cec2ad-b9e0-41ba-b301-91d1aebe68e4 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:34.497179 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cec2ad-b9e0-41ba-b301-91d1aebe68e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:34.497599 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cec2ad-b9e0-41ba-b301-91d1aebe68e4 None admin] PATH_INFO: `/v3/users/9a7a2e576c6e47d79da0950a9e3a9c46` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:34.498910 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cec2ad-b9e0-41ba-b301-91d1aebe68e4 None admin] RBAC: Authorizing `identity:get_user(user_id=9a7a2e576c6e47d79da0950a9e3a9c46)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:34.500903 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cec2ad-b9e0-41ba-b301-91d1aebe68e4 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:34.503107 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 91/180] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 25 13:11:34 2022] GET /identity/v3/users/9a7a2e576c6e47d79da0950a9e3a9c46 => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:34.509218 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cec2ad-b9e0-41ba-b301-91d1aebe68e4 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:34.589826 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f1042-ec43-4729-96fe-a00e68994f7c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:34.636850 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9a4f4-409f-4ab8-8827-f248b819343b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:34.637394 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9a4f4-409f-4ab8-8827-f248b819343b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:34.637677 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9a4f4-409f-4ab8-8827-f248b819343b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:34.637987 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9a4f4-409f-4ab8-8827-f248b819343b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:34.645838 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:34.649256 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cec2ad-b9e0-41ba-b301-91d1aebe68e4 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:34.729991 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:34.733003 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff9a4f4-409f-4ab8-8827-f248b819343b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:34.733905 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a916d-8146-4475-89f7-4ef96ba28075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:34.735400 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a916d-8146-4475-89f7-4ef96ba28075 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:34.735491 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff9a4f4-409f-4ab8-8827-f248b819343b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:34.735581 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a916d-8146-4475-89f7-4ef96ba28075 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:34.736030 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a916d-8146-4475-89f7-4ef96ba28075 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:34.845316 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a916d-8146-4475-89f7-4ef96ba28075 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:34.846796 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a916d-8146-4475-89f7-4ef96ba28075 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:34.871668 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 90/181] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 25 13:11:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 25 13:11:34.879338 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9a4f4-409f-4ab8-8827-f248b819343b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:34.997498 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:35.003354 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:35.004443 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 92/182] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 25 13:11:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 25 13:11:35.006902 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9a4f4-409f-4ab8-8827-f248b819343b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:35.021269 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a916d-8146-4475-89f7-4ef96ba28075 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:35.070258 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90fe601-3310-47aa-a91b-b6820ba984af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:35.070901 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90fe601-3310-47aa-a91b-b6820ba984af None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:35.071180 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90fe601-3310-47aa-a91b-b6820ba984af None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:35.071454 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90fe601-3310-47aa-a91b-b6820ba984af None admin] PATH_INFO: `/v3/projects/9345d01ad6914f64aaa073a1e6a86a02` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:35.076190 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90fe601-3310-47aa-a91b-b6820ba984af None admin] RBAC: Authorizing `identity:get_project(project_id=9345d01ad6914f64aaa073a1e6a86a02)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:35.079729 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90fe601-3310-47aa-a91b-b6820ba984af None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:35.081457 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 91/183] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 25 13:11:34 2022] GET /identity/v3/projects/9345d01ad6914f64aaa073a1e6a86a02 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:35.089684 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90fe601-3310-47aa-a91b-b6820ba984af None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:35.214478 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a916d-8146-4475-89f7-4ef96ba28075 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:35.270465 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90fe601-3310-47aa-a91b-b6820ba984af None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:35.278136 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df5198-cca8-4818-a441-dae52cc3eb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:35.278779 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df5198-cca8-4818-a441-dae52cc3eb0d None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:35.279058 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df5198-cca8-4818-a441-dae52cc3eb0d None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:35.279333 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df5198-cca8-4818-a441-dae52cc3eb0d None admin] PATH_INFO: `/v3/projects/9345d01ad6914f64aaa073a1e6a86a02` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:35.284612 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df5198-cca8-4818-a441-dae52cc3eb0d None admin] RBAC: Authorizing `identity:get_project(project_id=9345d01ad6914f64aaa073a1e6a86a02)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:35.286331 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df5198-cca8-4818-a441-dae52cc3eb0d None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:35.288274 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 93/184] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 25 13:11:35 2022] GET /identity/v3/projects/9345d01ad6914f64aaa073a1e6a86a02 => generated 302 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:11:35.299058 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df5198-cca8-4818-a441-dae52cc3eb0d None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:35.331963 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794e1ba-8f55-42af-9a77-f139dce10e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:35.332954 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794e1ba-8f55-42af-9a77-f139dce10e69 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:35.333433 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794e1ba-8f55-42af-9a77-f139dce10e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:35.333903 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794e1ba-8f55-42af-9a77-f139dce10e69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:35.334847 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e794e1ba-8f55-42af-9a77-f139dce10e69 None admin] RBAC: Adding query filter params (role.id=4c7114fda3ec4652abed55516b5f4315, scope.project.id=9345d01ad6914f64aaa073a1e6a86a02, user.id=9a7a2e576c6e47d79da0950a9e3a9c46) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:35.335350 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e794e1ba-8f55-42af-9a77-f139dce10e69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:35.337011 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e794e1ba-8f55-42af-9a77-f139dce10e69 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:35.358104 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 92/185] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 25 13:11:35 2022] GET /identity/v3/role_assignments?user.id=9a7a2e576c6e47d79da0950a9e3a9c46&scope.project.id=9345d01ad6914f64aaa073a1e6a86a02&role.id=4c7114fda3ec4652abed55516b5f4315 => generated 608 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:11:35.389530 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:35.435392 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df5198-cca8-4818-a441-dae52cc3eb0d None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:35.473097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae63bb-0635-44f8-aece-294f9280e439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:35.473721 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae63bb-0635-44f8-aece-294f9280e439 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:35.474000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae63bb-0635-44f8-aece-294f9280e439 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:35.474345 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae63bb-0635-44f8-aece-294f9280e439 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:35.475093 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae63bb-0635-44f8-aece-294f9280e439 None admin] RBAC: Adding query filter params (role.id=955523e4392d4c278c29f6ce715a5ae6, scope.project.id=9345d01ad6914f64aaa073a1e6a86a02, user.id=9a7a2e576c6e47d79da0950a9e3a9c46) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:35.475403 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae63bb-0635-44f8-aece-294f9280e439 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:35.476887 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae63bb-0635-44f8-aece-294f9280e439 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:35.483585 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 94/186] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 25 13:11:35 2022] GET /identity/v3/role_assignments?user.id=9a7a2e576c6e47d79da0950a9e3a9c46&scope.project.id=9345d01ad6914f64aaa073a1e6a86a02&role.id=955523e4392d4c278c29f6ce715a5ae6 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:11:36.172814 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b0a01-becb-430b-92d5-961c6cf17366 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:36.173364 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b0a01-becb-430b-92d5-961c6cf17366 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:36.173364 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b0a01-becb-430b-92d5-961c6cf17366 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:36.174826 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 93/187] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:36.179853 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2151b26-3cde-479a-8881-fe8e7714b7c0 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:36.180257 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2151b26-3cde-479a-8881-fe8e7714b7c0 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:36.180443 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2151b26-3cde-479a-8881-fe8e7714b7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:36.198760 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-e2151b26-3cde-479a-8881-fe8e7714b7c0 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:36.199966 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-e2151b26-3cde-479a-8881-fe8e7714b7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:36.268476 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 95/188] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:11:36.469713 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfa92e-178d-429d-a2e5-029bdd626507 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:36.470062 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfa92e-178d-429d-a2e5-029bdd626507 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:36.470283 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfa92e-178d-429d-a2e5-029bdd626507 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:36.471765 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 94/189] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:36.476794 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184ad2f-8160-46a5-968f-6635f55e3089 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:36.477084 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184ad2f-8160-46a5-968f-6635f55e3089 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:36.477360 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184ad2f-8160-46a5-968f-6635f55e3089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:36.496033 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-3184ad2f-8160-46a5-968f-6635f55e3089 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:36.497214 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-3184ad2f-8160-46a5-968f-6635f55e3089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:36.541360 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfa92e-178d-429d-a2e5-029bdd626507 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:36.557117 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:36.572116 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 96/190] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:11:36.578007 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:36.655021 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfa92e-178d-429d-a2e5-029bdd626507 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:36.692569 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f52ed-7103-476f-ab80-8981127da0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:36.693212 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f52ed-7103-476f-ab80-8981127da0c7 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:36.693488 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f52ed-7103-476f-ab80-8981127da0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:36.693764 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f52ed-7103-476f-ab80-8981127da0c7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:36.704846 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f52ed-7103-476f-ab80-8981127da0c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:11:36.710073 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-d02f52ed-7103-476f-ab80-8981127da0c7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 25 13:11:36.710073 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:11:36.710073 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:11:36.710073 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:11:36.710073 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:11:36.710073 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:11:36.710073 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:11:36.710073 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:11:36.710073 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:11:36.710073 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:11:36.710073 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:11:36.710073 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:11:36.710073 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:11:36.710073 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:11:36.710073 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:11:36.710073 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:11:36.710943 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:11:36.710943 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:11:36.710943 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:11:36.710943 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:11:36.710943 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:11:36.710943 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:11:36.710943 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:11:36.710943 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:11:36.710943 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:11:36.710943 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:11:36.710943 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:11:36.710943 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:11:36.710943 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:11:36.710943 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:11:36.710943 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:11:36.710943 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:11:36.711735 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:11:36.711735 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:11:36.711735 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:11:36.711735 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:11:36.711735 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:11:36.711735 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:11:36.711735 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:11:36.711735 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:11:36.711735 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:11:36.711735 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:11:36.711735 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 25 13:11:36.711735 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:11:36.711735 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 95/191] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 25 13:11:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 13:11:36.717001 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184ad2f-8160-46a5-968f-6635f55e3089 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:36.820761 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184ad2f-8160-46a5-968f-6635f55e3089 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:36.843972 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f52ed-7103-476f-ab80-8981127da0c7 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:36.855030 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2e499-e7c3-4eff-9104-296aa58dc0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:36.855628 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2e499-e7c3-4eff-9104-296aa58dc0ea None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:36.855917 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2e499-e7c3-4eff-9104-296aa58dc0ea None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:36.856205 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2e499-e7c3-4eff-9104-296aa58dc0ea None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:36.856865 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2e499-e7c3-4eff-9104-296aa58dc0ea None admin] RBAC: Adding query filter params (name=reader) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:36.857163 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2e499-e7c3-4eff-9104-296aa58dc0ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:36.858529 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2e499-e7c3-4eff-9104-296aa58dc0ea None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:36.872084 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 97/192] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 25 13:11:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:36.873144 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2e499-e7c3-4eff-9104-296aa58dc0ea None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:36.934271 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:36.949972 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:36.961296 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f52ed-7103-476f-ab80-8981127da0c7 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:36.990178 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2e499-e7c3-4eff-9104-296aa58dc0ea None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:36.997685 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bab3a5-dc1b-4228-a299-73f44629262d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:36.998317 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bab3a5-dc1b-4228-a299-73f44629262d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:36.998598 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bab3a5-dc1b-4228-a299-73f44629262d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:36.998871 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bab3a5-dc1b-4228-a299-73f44629262d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:37.000021 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bab3a5-dc1b-4228-a299-73f44629262d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:37.001662 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bab3a5-dc1b-4228-a299-73f44629262d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:37.003395 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 96/193] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:11:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:11:37.008712 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bab3a5-dc1b-4228-a299-73f44629262d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:37.025743 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf52f8f-23b4-4a53-9490-46b3d7a6784c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:37.026461 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf52f8f-23b4-4a53-9490-46b3d7a6784c None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:37.026739 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf52f8f-23b4-4a53-9490-46b3d7a6784c None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:37.026926 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf52f8f-23b4-4a53-9490-46b3d7a6784c None admin] PATH_INFO: `/v3/users/819441aa6c654f7cacf05c2e36944cec` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:37.041615 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf52f8f-23b4-4a53-9490-46b3d7a6784c None admin] RBAC: Authorizing `identity:get_user(user_id=819441aa6c654f7cacf05c2e36944cec)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:37.043319 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf52f8f-23b4-4a53-9490-46b3d7a6784c None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:37.049799 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 98/194] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 25 13:11:36 2022] GET /identity/v3/users/819441aa6c654f7cacf05c2e36944cec => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:37.050544 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf52f8f-23b4-4a53-9490-46b3d7a6784c None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:37.122235 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bab3a5-dc1b-4228-a299-73f44629262d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:37.151924 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf52f8f-23b4-4a53-9490-46b3d7a6784c None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:37.156230 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45495e-5a02-4b65-b5c5-79f91f2ee0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:37.156950 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45495e-5a02-4b65-b5c5-79f91f2ee0f5 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:37.157230 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45495e-5a02-4b65-b5c5-79f91f2ee0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:37.157513 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45495e-5a02-4b65-b5c5-79f91f2ee0f5 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:37.158160 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45495e-5a02-4b65-b5c5-79f91f2ee0f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:37.159616 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45495e-5a02-4b65-b5c5-79f91f2ee0f5 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:37.169564 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:37.182834 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 97/195] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 25 13:11:37 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:11:37.184089 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86103b4-1dbe-444f-b45e-b6dd09ce5b38 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:37.184510 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86103b4-1dbe-444f-b45e-b6dd09ce5b38 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:37.184628 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86103b4-1dbe-444f-b45e-b6dd09ce5b38 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:37.190759 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 98/196] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:37.192600 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ef864-0dd9-4295-95ae-c751216c07b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:37.193252 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ef864-0dd9-4295-95ae-c751216c07b8 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:37.193529 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ef864-0dd9-4295-95ae-c751216c07b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:37.193802 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ef864-0dd9-4295-95ae-c751216c07b8 None admin] PATH_INFO: `/v3/projects/9345d01ad6914f64aaa073a1e6a86a02` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:37.194980 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ef864-0dd9-4295-95ae-c751216c07b8 None admin] RBAC: Authorizing `identity:get_project(project_id=9345d01ad6914f64aaa073a1e6a86a02)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:37.196510 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ef864-0dd9-4295-95ae-c751216c07b8 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:37.198229 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 99/197] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 25 13:11:37 2022] GET /identity/v3/projects/9345d01ad6914f64aaa073a1e6a86a02 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:11:37.200080 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8f873-3146-4ce7-b102-30a943d90ebe None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:37.200371 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8f873-3146-4ce7-b102-30a943d90ebe None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:37.200651 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8f873-3146-4ce7-b102-30a943d90ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:37.204577 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ef864-0dd9-4295-95ae-c751216c07b8 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:37.221291 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f4d8f873-3146-4ce7-b102-30a943d90ebe None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:37.222744 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f4d8f873-3146-4ce7-b102-30a943d90ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:37.237890 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:37.312038 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 99/198] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:11:37.330362 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ef864-0dd9-4295-95ae-c751216c07b8 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:37.368254 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebeb311-e2b1-4926-a5fa-c1d162c8b426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:37.368929 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebeb311-e2b1-4926-a5fa-c1d162c8b426 None admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:37.369211 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebeb311-e2b1-4926-a5fa-c1d162c8b426 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:37.369487 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebeb311-e2b1-4926-a5fa-c1d162c8b426 None admin] PATH_INFO: `/v3/projects/9345d01ad6914f64aaa073a1e6a86a02/users/819441aa6c654f7cacf05c2e36944cec/roles/cf3c7c662d454e63953da94d2d986171` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:37.371444 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebeb311-e2b1-4926-a5fa-c1d162c8b426 None admin] RBAC: Authorizing `identity:create_grant(project_id=9345d01ad6914f64aaa073a1e6a86a02, user_id=819441aa6c654f7cacf05c2e36944cec, role_id=cf3c7c662d454e63953da94d2d986171)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:37.372929 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebeb311-e2b1-4926-a5fa-c1d162c8b426 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:37.390283 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 100/199] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 25 13:11:37 2022] PUT /identity/v3/projects/9345d01ad6914f64aaa073a1e6a86a02/users/819441aa6c654f7cacf05c2e36944cec/roles/cf3c7c662d454e63953da94d2d986171 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:11:37.590288 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d8f873-3146-4ce7-b102-30a943d90ebe None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:37.697640 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d8f873-3146-4ce7-b102-30a943d90ebe None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:37.735295 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef212b4-d80b-480d-bd5c-4044205ae2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:37.736096 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef212b4-d80b-480d-bd5c-4044205ae2a8 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:37.736374 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef212b4-d80b-480d-bd5c-4044205ae2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:37.736647 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef212b4-d80b-480d-bd5c-4044205ae2a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:37.747421 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef212b4-d80b-480d-bd5c-4044205ae2a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:11:37.752341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-5ef212b4-d80b-480d-bd5c-4044205ae2a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 25 13:11:37.752341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:11:37.752341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:11:37.752341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:11:37.752341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:11:37.752341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:11:37.752341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:11:37.752341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:11:37.752341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:11:37.752341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:11:37.752341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:11:37.752341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:11:37.752341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:11:37.752341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:11:37.752341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:11:37.752341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:11:37.753218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:11:37.753218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:11:37.753218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:11:37.753218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:11:37.753218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:11:37.753218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:11:37.753218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:11:37.753218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:11:37.753218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:11:37.753218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:11:37.753218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:11:37.753218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:11:37.753218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:11:37.753218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:11:37.753218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:11:37.753218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:11:37.753992 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:11:37.753992 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:11:37.753992 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:11:37.753992 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:11:37.753992 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:11:37.753992 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:11:37.753992 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:11:37.753992 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:11:37.753992 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:11:37.753992 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:11:37.753992 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 25 13:11:37.753992 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:11:37.753992 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 100/200] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 25 13:11:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:11:37.759586 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebeb311-e2b1-4926-a5fa-c1d162c8b426 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:37.804941 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:37.866927 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebeb311-e2b1-4926-a5fa-c1d162c8b426 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:37.906108 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02075f9b-970d-4dc1-9d73-c3b1008a94ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:37.907288 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02075f9b-970d-4dc1-9d73-c3b1008a94ef None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:37.907573 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02075f9b-970d-4dc1-9d73-c3b1008a94ef None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:37.907847 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02075f9b-970d-4dc1-9d73-c3b1008a94ef None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:37.908550 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02075f9b-970d-4dc1-9d73-c3b1008a94ef None admin] RBAC: Adding query filter params (name=member) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:37.908849 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02075f9b-970d-4dc1-9d73-c3b1008a94ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:37.910233 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02075f9b-970d-4dc1-9d73-c3b1008a94ef None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:37.919270 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 101/201] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 25 13:11:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:37.925296 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef212b4-d80b-480d-bd5c-4044205ae2a8 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:37.935543 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:38.030472 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef212b4-d80b-480d-bd5c-4044205ae2a8 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:38.065999 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c2ccd-ddcc-4f93-8b9c-4c1dde646f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:38.066634 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c2ccd-ddcc-4f93-8b9c-4c1dde646f3c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:38.066911 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c2ccd-ddcc-4f93-8b9c-4c1dde646f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:38.067186 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c2ccd-ddcc-4f93-8b9c-4c1dde646f3c None admin] PATH_INFO: `/v3/users/062e83ae9b8d43368a32e5afc6742c29` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:38.068430 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c2ccd-ddcc-4f93-8b9c-4c1dde646f3c None admin] RBAC: Authorizing `identity:get_user(user_id=062e83ae9b8d43368a32e5afc6742c29)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:38.069961 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c2ccd-ddcc-4f93-8b9c-4c1dde646f3c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:38.071633 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 101/202] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 25 13:11:37 2022] GET /identity/v3/users/062e83ae9b8d43368a32e5afc6742c29 => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:38.077346 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02075f9b-970d-4dc1-9d73-c3b1008a94ef None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:38.188304 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02075f9b-970d-4dc1-9d73-c3b1008a94ef None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:38.189964 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:38.224658 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ae343-3741-41bc-bb4d-485ad0390ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:38.225268 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ae343-3741-41bc-bb4d-485ad0390ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:38.225536 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ae343-3741-41bc-bb4d-485ad0390ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:38.225811 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ae343-3741-41bc-bb4d-485ad0390ab6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:38.299120 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ae343-3741-41bc-bb4d-485ad0390ab6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:38.300718 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ae343-3741-41bc-bb4d-485ad0390ab6 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:38.413095 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 102/203] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 25 13:11:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 25 13:11:38.418758 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c2ccd-ddcc-4f93-8b9c-4c1dde646f3c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:38.500477 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:38.523258 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c2ccd-ddcc-4f93-8b9c-4c1dde646f3c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:38.562519 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1eacf-f33b-47f6-a92c-68ebcb0ce409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:38.563708 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1eacf-f33b-47f6-a92c-68ebcb0ce409 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:38.564025 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1eacf-f33b-47f6-a92c-68ebcb0ce409 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:38.564299 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1eacf-f33b-47f6-a92c-68ebcb0ce409 None admin] PATH_INFO: `/v3/projects/9345d01ad6914f64aaa073a1e6a86a02` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:38.565780 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1eacf-f33b-47f6-a92c-68ebcb0ce409 None admin] RBAC: Authorizing `identity:get_project(project_id=9345d01ad6914f64aaa073a1e6a86a02)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:38.567226 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1eacf-f33b-47f6-a92c-68ebcb0ce409 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:38.568988 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 102/204] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 25 13:11:38 2022] GET /identity/v3/projects/9345d01ad6914f64aaa073a1e6a86a02 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:38.574958 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ae343-3741-41bc-bb4d-485ad0390ab6 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:38.577141 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:38.685319 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ae343-3741-41bc-bb4d-485ad0390ab6 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:38.726047 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbacc28-5f7e-4624-9483-43897b04bd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:38.726878 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbacc28-5f7e-4624-9483-43897b04bd81 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:38.726878 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbacc28-5f7e-4624-9483-43897b04bd81 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:38.727160 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbacc28-5f7e-4624-9483-43897b04bd81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:38.731925 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbacc28-5f7e-4624-9483-43897b04bd81 None admin] RBAC: Adding query filter params (role.id=9a3705eba27c47daad42ad874948996d, scope.project.id=9345d01ad6914f64aaa073a1e6a86a02, user.id=062e83ae9b8d43368a32e5afc6742c29) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:38.731925 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbacc28-5f7e-4624-9483-43897b04bd81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:38.731925 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbacc28-5f7e-4624-9483-43897b04bd81 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:38.736538 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 103/205] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 25 13:11:38 2022] GET /identity/v3/role_assignments?user.id=062e83ae9b8d43368a32e5afc6742c29&scope.project.id=9345d01ad6914f64aaa073a1e6a86a02&role.id=9a3705eba27c47daad42ad874948996d => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:39.596195 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec6290-58d8-4012-a20f-5280de8c17e1 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:39.596707 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec6290-58d8-4012-a20f-5280de8c17e1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:39.596781 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec6290-58d8-4012-a20f-5280de8c17e1 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:39.598240 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 103/206] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:39.603273 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90b362-9fc8-4274-8997-559d2bf9e97c None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:39.603655 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90b362-9fc8-4274-8997-559d2bf9e97c None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:39.603836 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90b362-9fc8-4274-8997-559d2bf9e97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:39.622129 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-3c90b362-9fc8-4274-8997-559d2bf9e97c None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:39.623311 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-3c90b362-9fc8-4274-8997-559d2bf9e97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:39.664555 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c1d8b-3870-4573-862d-3369a8d96bf4 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:39.664853 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c1d8b-3870-4573-862d-3369a8d96bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:39.665113 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c1d8b-3870-4573-862d-3369a8d96bf4 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:39.666448 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 104/207] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 13:11:39.667714 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b692c-3a97-478c-90a0-851019051640 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:39.668026 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b692c-3a97-478c-90a0-851019051640 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:39.668306 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b692c-3a97-478c-90a0-851019051640 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:39.669674 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 105/208] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:39.673563 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b2a84-7d59-418e-9248-f20598533662 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:39.673840 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b2a84-7d59-418e-9248-f20598533662 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:39.674114 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b2a84-7d59-418e-9248-f20598533662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:39.687401 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:39.692374 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-820b2a84-7d59-418e-9248-f20598533662 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:39.693582 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-820b2a84-7d59-418e-9248-f20598533662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:39.696079 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 104/209] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:11:39.700438 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41d032-90a1-41ac-a69d-3e29255b15f5 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:39.700438 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41d032-90a1-41ac-a69d-3e29255b15f5 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:39.700438 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41d032-90a1-41ac-a69d-3e29255b15f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:39.716534 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-6e41d032-90a1-41ac-a69d-3e29255b15f5 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:39.717746 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-6e41d032-90a1-41ac-a69d-3e29255b15f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:39.769906 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 106/210] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:11:39.786999 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 105/211] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:11:39.988771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b2a84-7d59-418e-9248-f20598533662 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:40.041421 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41d032-90a1-41ac-a69d-3e29255b15f5 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:40.061761 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:40.092912 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b2a84-7d59-418e-9248-f20598533662 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:40.127410 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f2c68-89e6-42f8-a3ea-3651564095a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:40.128070 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f2c68-89e6-42f8-a3ea-3651564095a0 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:40.128354 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f2c68-89e6-42f8-a3ea-3651564095a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:40.128630 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f2c68-89e6-42f8-a3ea-3651564095a0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:40.138576 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f2c68-89e6-42f8-a3ea-3651564095a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:11:40.141478 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41d032-90a1-41ac-a69d-3e29255b15f5 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:40.143497 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-fb8f2c68-89e6-42f8-a3ea-3651564095a0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 25 13:11:40.143497 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:11:40.143497 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:11:40.143497 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:11:40.143497 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:11:40.143497 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:11:40.143497 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:11:40.143497 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:11:40.143497 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:11:40.143497 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:11:40.143497 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:11:40.143497 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:11:40.143497 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:11:40.143497 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:11:40.143497 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:11:40.143497 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:11:40.144400 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:11:40.144400 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:11:40.144400 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:11:40.144400 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:11:40.144400 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:11:40.144400 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:11:40.144400 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:11:40.144400 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:11:40.144400 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:11:40.144400 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:11:40.144400 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:11:40.144400 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:11:40.144400 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:11:40.144400 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:11:40.144400 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:11:40.144400 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:11:40.145443 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:11:40.145443 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:11:40.145443 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:11:40.145443 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:11:40.145443 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:11:40.145443 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:11:40.145443 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:11:40.145443 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:11:40.145443 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:11:40.145443 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:11:40.145443 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 25 13:11:40.145443 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:11:40.145443 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 107/212] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 25 13:11:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:11:40.146380 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f2c68-89e6-42f8-a3ea-3651564095a0 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:40.169671 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:40.179884 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cefe4a-fbec-43ad-ab92-a2b5de2a6d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:40.180527 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cefe4a-fbec-43ad-ab92-a2b5de2a6d97 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:40.180806 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cefe4a-fbec-43ad-ab92-a2b5de2a6d97 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:40.181069 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cefe4a-fbec-43ad-ab92-a2b5de2a6d97 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:40.191534 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cefe4a-fbec-43ad-ab92-a2b5de2a6d97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:11:40.196382 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-a4cefe4a-fbec-43ad-ab92-a2b5de2a6d97 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 25 13:11:40.196382 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:11:40.196382 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:11:40.196382 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:11:40.196382 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:11:40.196382 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:11:40.196382 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:11:40.196382 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:11:40.196382 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:11:40.196382 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:11:40.196382 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:11:40.196382 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:11:40.196382 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:11:40.196382 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:11:40.196382 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:11:40.196382 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:11:40.197232 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:11:40.197232 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:11:40.197232 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:11:40.197232 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:11:40.197232 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:11:40.197232 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:11:40.197232 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:11:40.197232 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:11:40.197232 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:11:40.197232 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:11:40.197232 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:11:40.197232 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:11:40.197232 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:11:40.197232 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:11:40.197232 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:11:40.197232 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:11:40.198029 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:11:40.198029 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:11:40.198029 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:11:40.198029 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:11:40.198029 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:11:40.198029 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:11:40.198029 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:11:40.198029 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:11:40.198029 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:11:40.198029 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:11:40.198029 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 25 13:11:40.198029 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:11:40.198029 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 106/213] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 25 13:11:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 13:11:40.198691 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cefe4a-fbec-43ad-ab92-a2b5de2a6d97 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:40.251082 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f2c68-89e6-42f8-a3ea-3651564095a0 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:40.279859 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:40.285671 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab121c-0195-4b82-aedb-731ded4b7160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:40.286372 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab121c-0195-4b82-aedb-731ded4b7160 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:40.286656 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab121c-0195-4b82-aedb-731ded4b7160 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:40.286933 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab121c-0195-4b82-aedb-731ded4b7160 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:40.288064 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab121c-0195-4b82-aedb-731ded4b7160 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:40.289492 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab121c-0195-4b82-aedb-731ded4b7160 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:40.291051 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 108/214] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:11:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:40.291807 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab121c-0195-4b82-aedb-731ded4b7160 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:40.298809 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cefe4a-fbec-43ad-ab92-a2b5de2a6d97 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:40.333082 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957be196-048b-4211-8f2b-988e0c5d4ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:40.333677 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957be196-048b-4211-8f2b-988e0c5d4ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:40.333953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957be196-048b-4211-8f2b-988e0c5d4ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:40.334224 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957be196-048b-4211-8f2b-988e0c5d4ba8 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:40.334880 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957be196-048b-4211-8f2b-988e0c5d4ba8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:40.335179 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957be196-048b-4211-8f2b-988e0c5d4ba8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:40.336593 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957be196-048b-4211-8f2b-988e0c5d4ba8 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:40.345013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 107/215] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 25 13:11:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:40.348723 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957be196-048b-4211-8f2b-988e0c5d4ba8 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:40.395922 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab121c-0195-4b82-aedb-731ded4b7160 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:40.397522 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:40.430646 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f921a20-b0d3-439a-b5d4-9f570bb61fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:40.431250 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f921a20-b0d3-439a-b5d4-9f570bb61fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:40.431525 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f921a20-b0d3-439a-b5d4-9f570bb61fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:40.431792 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f921a20-b0d3-439a-b5d4-9f570bb61fa5 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:40.432482 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f921a20-b0d3-439a-b5d4-9f570bb61fa5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:40.432779 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f921a20-b0d3-439a-b5d4-9f570bb61fa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:40.434128 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f921a20-b0d3-439a-b5d4-9f570bb61fa5 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:40.441948 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 109/216] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 25 13:11:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:40.445262 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f921a20-b0d3-439a-b5d4-9f570bb61fa5 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:40.450177 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957be196-048b-4211-8f2b-988e0c5d4ba8 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:40.484140 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707be1a-2e2d-4b2d-8a71-58ca5187c5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:40.484812 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707be1a-2e2d-4b2d-8a71-58ca5187c5f1 None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:40.485084 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707be1a-2e2d-4b2d-8a71-58ca5187c5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:40.485765 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707be1a-2e2d-4b2d-8a71-58ca5187c5f1 None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:40.486421 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1707be1a-2e2d-4b2d-8a71-58ca5187c5f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:40.487849 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1707be1a-2e2d-4b2d-8a71-58ca5187c5f1 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:40.506959 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:40.509744 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 108/217] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 25 13:11:40 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:11:40.510650 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707be1a-2e2d-4b2d-8a71-58ca5187c5f1 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:40.554446 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f921a20-b0d3-439a-b5d4-9f570bb61fa5 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:40.597686 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64289247-c286-4835-b0d0-581979b64008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:40.598337 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64289247-c286-4835-b0d0-581979b64008 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:40.598600 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64289247-c286-4835-b0d0-581979b64008 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:40.598876 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64289247-c286-4835-b0d0-581979b64008 None admin] PATH_INFO: `/v3/users/84772d8a55a24be087fb23386c9539eb` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:40.615083 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64289247-c286-4835-b0d0-581979b64008 None admin] RBAC: Authorizing `identity:get_user(user_id=84772d8a55a24be087fb23386c9539eb)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:40.617068 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64289247-c286-4835-b0d0-581979b64008 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:40.623915 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 110/218] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 25 13:11:40 2022] GET /identity/v3/users/84772d8a55a24be087fb23386c9539eb => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:40.625715 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64289247-c286-4835-b0d0-581979b64008 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:40.646762 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707be1a-2e2d-4b2d-8a71-58ca5187c5f1 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:40.650655 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:40.693604 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37716a7-c588-4d32-8541-7a07198376ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:40.694254 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37716a7-c588-4d32-8541-7a07198376ab None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:40.694530 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37716a7-c588-4d32-8541-7a07198376ab None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:40.695465 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37716a7-c588-4d32-8541-7a07198376ab None admin] PATH_INFO: `/v3/users/819441aa6c654f7cacf05c2e36944cec` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:40.695966 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37716a7-c588-4d32-8541-7a07198376ab None admin] RBAC: Authorizing `identity:get_user(user_id=819441aa6c654f7cacf05c2e36944cec)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:40.697488 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37716a7-c588-4d32-8541-7a07198376ab None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:40.699044 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 109/219] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 25 13:11:40 2022] GET /identity/v3/users/819441aa6c654f7cacf05c2e36944cec => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:40.706075 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37716a7-c588-4d32-8541-7a07198376ab None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:40.748732 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64289247-c286-4835-b0d0-581979b64008 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:40.773544 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:40.798345 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b8c00-9289-42c6-9c0a-e0fe28e12a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:40.799301 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b8c00-9289-42c6-9c0a-e0fe28e12a7d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:40.799584 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b8c00-9289-42c6-9c0a-e0fe28e12a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:40.799859 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b8c00-9289-42c6-9c0a-e0fe28e12a7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:40.800689 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b8c00-9289-42c6-9c0a-e0fe28e12a7d None admin] RBAC: Adding query filter params (role.id=9a3705eba27c47daad42ad874948996d, user.id=84772d8a55a24be087fb23386c9539eb, scope.system=all) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:40.801062 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b8c00-9289-42c6-9c0a-e0fe28e12a7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:40.802588 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b8c00-9289-42c6-9c0a-e0fe28e12a7d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:40.810120 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 111/220] 10.222.0.25 () {56 vars in 1308 bytes} [Tue Oct 25 13:11:40 2022] GET /identity/v3/role_assignments?user.id=84772d8a55a24be087fb23386c9539eb&scope.system=all&role.id=9a3705eba27c47daad42ad874948996d => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:11:40.833854 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37716a7-c588-4d32-8541-7a07198376ab None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:40.879212 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502f7d9-a465-488c-a53c-8729f972a2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:40.879846 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502f7d9-a465-488c-a53c-8729f972a2a8 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:40.880160 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502f7d9-a465-488c-a53c-8729f972a2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:40.880437 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502f7d9-a465-488c-a53c-8729f972a2a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:40.929520 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:40.961325 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d502f7d9-a465-488c-a53c-8729f972a2a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:40.962817 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d502f7d9-a465-488c-a53c-8729f972a2a8 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:41.068523 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 110/221] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 25 13:11:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 25 13:11:41.074064 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b8c00-9289-42c6-9c0a-e0fe28e12a7d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:41.183087 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b8c00-9289-42c6-9c0a-e0fe28e12a7d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:41.218220 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9308b2eb-8f4a-4da7-9511-ac99e691f830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:41.219452 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308b2eb-8f4a-4da7-9511-ac99e691f830 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:41.220028 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308b2eb-8f4a-4da7-9511-ac99e691f830 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:41.220496 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308b2eb-8f4a-4da7-9511-ac99e691f830 None admin] PATH_INFO: `/v3/projects/9345d01ad6914f64aaa073a1e6a86a02` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:41.221844 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9308b2eb-8f4a-4da7-9511-ac99e691f830 None admin] RBAC: Authorizing `identity:get_project(project_id=9345d01ad6914f64aaa073a1e6a86a02)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:41.223543 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9308b2eb-8f4a-4da7-9511-ac99e691f830 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:41.225218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 112/222] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 25 13:11:41 2022] GET /identity/v3/projects/9345d01ad6914f64aaa073a1e6a86a02 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:41.231063 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502f7d9-a465-488c-a53c-8729f972a2a8 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:41.302724 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:41.335056 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502f7d9-a465-488c-a53c-8729f972a2a8 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:41.369301 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530b75b-837d-4551-92f8-35414d29b0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:41.369897 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530b75b-837d-4551-92f8-35414d29b0f7 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:41.370172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530b75b-837d-4551-92f8-35414d29b0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:41.370441 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530b75b-837d-4551-92f8-35414d29b0f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:41.371153 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530b75b-837d-4551-92f8-35414d29b0f7 None admin] RBAC: Adding query filter params (role.id=cf3c7c662d454e63953da94d2d986171, scope.project.id=9345d01ad6914f64aaa073a1e6a86a02, user.id=819441aa6c654f7cacf05c2e36944cec) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:41.371453 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530b75b-837d-4551-92f8-35414d29b0f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:41.372906 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530b75b-837d-4551-92f8-35414d29b0f7 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:41.379991 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 111/223] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 25 13:11:41 2022] GET /identity/v3/role_assignments?user.id=819441aa6c654f7cacf05c2e36944cec&scope.project.id=9345d01ad6914f64aaa073a1e6a86a02&role.id=cf3c7c662d454e63953da94d2d986171 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:42.857305 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87e9fc-aa2a-446a-b238-966ad322ab46 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:42.857818 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87e9fc-aa2a-446a-b238-966ad322ab46 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:42.857891 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87e9fc-aa2a-446a-b238-966ad322ab46 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:42.859225 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 113/224] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:42.865643 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02cafe-5e00-4498-869c-5814c376eef4 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:42.866162 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02cafe-5e00-4498-869c-5814c376eef4 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:42.866237 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02cafe-5e00-4498-869c-5814c376eef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:42.884332 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-cd02cafe-5e00-4498-869c-5814c376eef4 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:42.885825 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-cd02cafe-5e00-4498-869c-5814c376eef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:42.960625 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8cb7a-2b43-40fb-abb7-50b7f453a9b7 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:42.960907 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8cb7a-2b43-40fb-abb7-50b7f453a9b7 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:42.961400 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8cb7a-2b43-40fb-abb7-50b7f453a9b7 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:42.962299 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 112/225] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:11:42.962727 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 114/226] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 13:11:42.968025 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c748b-1ff9-4373-bc19-e89a540b821f None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:42.968328 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c748b-1ff9-4373-bc19-e89a540b821f None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:42.968608 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c748b-1ff9-4373-bc19-e89a540b821f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:42.987106 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-883c748b-1ff9-4373-bc19-e89a540b821f None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:42.988235 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-883c748b-1ff9-4373-bc19-e89a540b821f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:43.047821 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec24f9b-45a9-487b-b1a7-fb6bf6ced54d None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:43.048054 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec24f9b-45a9-487b-b1a7-fb6bf6ced54d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:43.048350 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec24f9b-45a9-487b-b1a7-fb6bf6ced54d None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:43.049260 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:43.050195 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 115/227] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:43.055923 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894412d-43cd-47e0-934b-e8322f94756f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:43.056211 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894412d-43cd-47e0-934b-e8322f94756f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:43.056489 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894412d-43cd-47e0-934b-e8322f94756f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:43.058751 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 113/228] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:11:43.075603 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-0894412d-43cd-47e0-934b-e8322f94756f None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:43.076813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0894412d-43cd-47e0-934b-e8322f94756f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:43.126922 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:43.147501 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 116/229] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 25 13:11:43.233566 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c748b-1ff9-4373-bc19-e89a540b821f None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:43.333967 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894412d-43cd-47e0-934b-e8322f94756f None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:43.337941 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c748b-1ff9-4373-bc19-e89a540b821f None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:43.374682 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e451f398-5b91-4911-857a-8f964f95492c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:43.376193 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451f398-5b91-4911-857a-8f964f95492c None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:43.376495 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451f398-5b91-4911-857a-8f964f95492c None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:43.376778 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451f398-5b91-4911-857a-8f964f95492c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:43.388090 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e451f398-5b91-4911-857a-8f964f95492c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:11:43.393152 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-e451f398-5b91-4911-857a-8f964f95492c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 25 13:11:43.393152 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:11:43.393152 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:11:43.393152 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:11:43.393152 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:11:43.393152 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:11:43.393152 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:11:43.393152 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:11:43.393152 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:11:43.393152 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:11:43.393152 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:11:43.393152 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:11:43.393152 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:11:43.393152 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:11:43.393152 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:11:43.393152 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:11:43.394044 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:11:43.394044 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:11:43.394044 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:11:43.394044 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:11:43.394044 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:11:43.394044 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:11:43.394044 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:11:43.394044 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:11:43.394044 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:11:43.394044 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:11:43.394044 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:11:43.394044 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:11:43.394044 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:11:43.394044 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:11:43.394044 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:11:43.394044 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:11:43.394854 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:11:43.394854 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:11:43.394854 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:11:43.394854 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:11:43.394854 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:11:43.394854 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:11:43.394854 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:11:43.394854 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:11:43.394854 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:11:43.394854 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:11:43.394854 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 25 13:11:43.394854 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:11:43.394854 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 114/230] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 25 13:11:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:11:43.400020 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e451f398-5b91-4911-857a-8f964f95492c None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:43.439446 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894412d-43cd-47e0-934b-e8322f94756f None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:43.460050 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:43.474316 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215b051-57be-44d8-9fe2-12fb4729925b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:43.474944 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215b051-57be-44d8-9fe2-12fb4729925b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:43.475217 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215b051-57be-44d8-9fe2-12fb4729925b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:43.475485 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215b051-57be-44d8-9fe2-12fb4729925b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:43.476639 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a215b051-57be-44d8-9fe2-12fb4729925b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:43.478082 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a215b051-57be-44d8-9fe2-12fb4729925b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:43.479626 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 117/231] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:11:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:43.480548 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215b051-57be-44d8-9fe2-12fb4729925b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:43.506486 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e451f398-5b91-4911-857a-8f964f95492c None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:43.531211 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:43.542278 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2babdac9-49e1-42d1-beba-66effc088104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:43.542874 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babdac9-49e1-42d1-beba-66effc088104 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:43.543152 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babdac9-49e1-42d1-beba-66effc088104 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:43.543426 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babdac9-49e1-42d1-beba-66effc088104 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:43.544111 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2babdac9-49e1-42d1-beba-66effc088104 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:43.544413 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2babdac9-49e1-42d1-beba-66effc088104 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:43.545800 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2babdac9-49e1-42d1-beba-66effc088104 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:43.554343 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 115/232] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 25 13:11:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:43.559186 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2babdac9-49e1-42d1-beba-66effc088104 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:43.583711 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215b051-57be-44d8-9fe2-12fb4729925b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:43.617951 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bca91b-23b2-4810-826a-4bf5a1bc5482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:43.618515 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bca91b-23b2-4810-826a-4bf5a1bc5482 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:43.618794 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bca91b-23b2-4810-826a-4bf5a1bc5482 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:43.619072 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bca91b-23b2-4810-826a-4bf5a1bc5482 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:43.629621 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bca91b-23b2-4810-826a-4bf5a1bc5482 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:11:43.634451 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-15bca91b-23b2-4810-826a-4bf5a1bc5482 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 25 13:11:43.634451 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:11:43.634451 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:11:43.634451 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:11:43.634451 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:11:43.634451 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:11:43.634451 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:11:43.634451 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:11:43.634451 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:11:43.634451 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:11:43.634451 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:11:43.634451 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:11:43.634451 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:11:43.634451 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:11:43.634451 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:11:43.634451 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:11:43.635495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:11:43.635495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:11:43.635495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:11:43.635495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:11:43.635495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:11:43.635495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:11:43.635495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:11:43.635495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:11:43.635495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:11:43.635495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:11:43.635495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:11:43.635495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:11:43.635495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:11:43.635495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:11:43.635495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:11:43.635495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:11:43.641310 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:11:43.641310 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:11:43.641310 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:11:43.641310 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:11:43.641310 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:11:43.641310 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:11:43.641310 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:11:43.641310 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:11:43.641310 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:11:43.641310 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:11:43.641310 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 25 13:11:43.641310 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:11:43.641310 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 118/233] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 25 13:11:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:11:43.641310 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bca91b-23b2-4810-826a-4bf5a1bc5482 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:43.660358 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2babdac9-49e1-42d1-beba-66effc088104 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:43.677620 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:43.694397 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2199dde-b83f-4ddd-ba0c-fee942ab1cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:43.695007 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2199dde-b83f-4ddd-ba0c-fee942ab1cc6 None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:43.695287 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2199dde-b83f-4ddd-ba0c-fee942ab1cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:43.695562 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2199dde-b83f-4ddd-ba0c-fee942ab1cc6 None admin] PATH_INFO: `/v3/groups` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:43.696215 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2199dde-b83f-4ddd-ba0c-fee942ab1cc6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:43.697678 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2199dde-b83f-4ddd-ba0c-fee942ab1cc6 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:43.713631 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 116/234] 10.222.0.25 () {60 vars in 1134 bytes} [Tue Oct 25 13:11:43 2022] POST /identity/v3/groups => generated 229 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:11:43.714437 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2199dde-b83f-4ddd-ba0c-fee942ab1cc6 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:43.754988 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bca91b-23b2-4810-826a-4bf5a1bc5482 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:43.767719 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:43.799379 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc8f2d-a419-47b0-8c04-da1e5842a30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:43.800296 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc8f2d-a419-47b0-8c04-da1e5842a30b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:43.800672 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc8f2d-a419-47b0-8c04-da1e5842a30b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:43.801043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc8f2d-a419-47b0-8c04-da1e5842a30b None admin] PATH_INFO: `/v3/users/532302a95f3f450f823dc9110fe37e0c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:43.818312 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc8f2d-a419-47b0-8c04-da1e5842a30b None admin] RBAC: Authorizing `identity:get_user(user_id=532302a95f3f450f823dc9110fe37e0c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:43.819972 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc8f2d-a419-47b0-8c04-da1e5842a30b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:43.821971 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 119/235] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 25 13:11:43 2022] GET /identity/v3/users/532302a95f3f450f823dc9110fe37e0c => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:43.828173 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc8f2d-a419-47b0-8c04-da1e5842a30b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:43.833758 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2199dde-b83f-4ddd-ba0c-fee942ab1cc6 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:43.871680 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929566be-56e9-4aa4-9b6a-ef04f14fa97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:43.872403 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929566be-56e9-4aa4-9b6a-ef04f14fa97f None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:43.872627 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929566be-56e9-4aa4-9b6a-ef04f14fa97f None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:43.872782 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929566be-56e9-4aa4-9b6a-ef04f14fa97f None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:43.873454 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929566be-56e9-4aa4-9b6a-ef04f14fa97f None admin] RBAC: Adding query filter params (name=member) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:43.873794 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929566be-56e9-4aa4-9b6a-ef04f14fa97f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:43.875738 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929566be-56e9-4aa4-9b6a-ef04f14fa97f None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:43.885823 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 117/236] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 25 13:11:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:43.892229 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929566be-56e9-4aa4-9b6a-ef04f14fa97f None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:43.944670 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:43.947086 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc8f2d-a419-47b0-8c04-da1e5842a30b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:43.985778 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db0aa3-db46-4ade-9388-be7ddb183363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:43.986384 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db0aa3-db46-4ade-9388-be7ddb183363 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:43.986663 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db0aa3-db46-4ade-9388-be7ddb183363 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:43.986936 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db0aa3-db46-4ade-9388-be7ddb183363 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:43.987665 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db0aa3-db46-4ade-9388-be7ddb183363 None admin] RBAC: Adding query filter params (role.id=cf3c7c662d454e63953da94d2d986171, user.id=532302a95f3f450f823dc9110fe37e0c, scope.system=all) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:43.988007 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db0aa3-db46-4ade-9388-be7ddb183363 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:43.989434 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db0aa3-db46-4ade-9388-be7ddb183363 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:43.994660 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 120/237] 10.222.0.25 () {56 vars in 1308 bytes} [Tue Oct 25 13:11:43 2022] GET /identity/v3/role_assignments?user.id=532302a95f3f450f823dc9110fe37e0c&scope.system=all&role.id=cf3c7c662d454e63953da94d2d986171 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:11:44.022940 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929566be-56e9-4aa4-9b6a-ef04f14fa97f None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:44.061936 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92312d-e2f2-4d30-b323-65d90720c127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:44.062588 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92312d-e2f2-4d30-b323-65d90720c127 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:44.063395 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92312d-e2f2-4d30-b323-65d90720c127 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:44.063671 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92312d-e2f2-4d30-b323-65d90720c127 None admin] PATH_INFO: `/v3/users/84772d8a55a24be087fb23386c9539eb` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:44.065089 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92312d-e2f2-4d30-b323-65d90720c127 None admin] RBAC: Authorizing `identity:get_user(user_id=84772d8a55a24be087fb23386c9539eb)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:44.066564 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92312d-e2f2-4d30-b323-65d90720c127 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:44.068489 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 118/238] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 25 13:11:43 2022] GET /identity/v3/users/84772d8a55a24be087fb23386c9539eb => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:11:44.074058 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db0aa3-db46-4ade-9388-be7ddb183363 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:44.108797 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:44.186583 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db0aa3-db46-4ade-9388-be7ddb183363 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:44.222546 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17926adc-008d-4242-b199-fca7432e9504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:44.223202 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17926adc-008d-4242-b199-fca7432e9504 None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:44.223481 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17926adc-008d-4242-b199-fca7432e9504 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:44.223754 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17926adc-008d-4242-b199-fca7432e9504 None admin] PATH_INFO: `/v3/system/users/84772d8a55a24be087fb23386c9539eb/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:44.225194 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17926adc-008d-4242-b199-fca7432e9504 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=84772d8a55a24be087fb23386c9539eb, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:44.226562 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17926adc-008d-4242-b199-fca7432e9504 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:44.237003 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 121/239] 10.222.0.25 () {58 vars in 1334 bytes} [Tue Oct 25 13:11:44 2022] PUT /identity/v3/system/users/84772d8a55a24be087fb23386c9539eb/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:11:45.943696 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7bb2b3-07af-4d19-853b-30bb688c2e3d None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:45.944228 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7bb2b3-07af-4d19-853b-30bb688c2e3d None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:45.944302 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7bb2b3-07af-4d19-853b-30bb688c2e3d None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:45.945646 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 119/240] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:45.950826 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243200d1-727b-4093-88b2-3a07e49b4901 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:45.951201 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243200d1-727b-4093-88b2-3a07e49b4901 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:45.951357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243200d1-727b-4093-88b2-3a07e49b4901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:45.970465 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-243200d1-727b-4093-88b2-3a07e49b4901 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:45.971635 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-243200d1-727b-4093-88b2-3a07e49b4901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:46.041805 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 122/241] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:11:46.164615 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61df7e-9911-4553-8e44-1e2bc8b38178 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:46.164957 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61df7e-9911-4553-8e44-1e2bc8b38178 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:46.165181 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61df7e-9911-4553-8e44-1e2bc8b38178 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:46.166686 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 120/242] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:46.172215 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c32cf-b6fc-4e4a-a2c7-19c01f7bb090 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:46.172685 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c32cf-b6fc-4e4a-a2c7-19c01f7bb090 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:46.172969 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c32cf-b6fc-4e4a-a2c7-19c01f7bb090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:46.191572 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-560c32cf-b6fc-4e4a-a2c7-19c01f7bb090 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:46.192785 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-560c32cf-b6fc-4e4a-a2c7-19c01f7bb090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:46.213259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:46.261683 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 123/243] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:11:46.310894 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61df7e-9911-4553-8e44-1e2bc8b38178 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:46.391812 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edadac-dafd-449d-b168-b6519c3b0188 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:46.392160 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edadac-dafd-449d-b168-b6519c3b0188 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:46.392439 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edadac-dafd-449d-b168-b6519c3b0188 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:46.396083 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 124/244] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 13:11:46.398931 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31af065-0614-4098-9d98-419247a8042d None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:46.399216 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31af065-0614-4098-9d98-419247a8042d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:46.399493 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31af065-0614-4098-9d98-419247a8042d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:46.417443 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61df7e-9911-4553-8e44-1e2bc8b38178 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:46.418867 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e31af065-0614-4098-9d98-419247a8042d None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:46.420066 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e31af065-0614-4098-9d98-419247a8042d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:46.427350 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:46.452472 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391ed0f-9154-4a67-bfc4-454fd268fec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:46.453049 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391ed0f-9154-4a67-bfc4-454fd268fec7 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:46.453856 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391ed0f-9154-4a67-bfc4-454fd268fec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:46.454147 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391ed0f-9154-4a67-bfc4-454fd268fec7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:46.455325 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391ed0f-9154-4a67-bfc4-454fd268fec7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:46.456782 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391ed0f-9154-4a67-bfc4-454fd268fec7 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:46.458474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 121/245] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:11:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:46.463630 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391ed0f-9154-4a67-bfc4-454fd268fec7 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:46.499359 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 125/246] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 25 13:11:46.537049 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31af065-0614-4098-9d98-419247a8042d None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:46.568250 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391ed0f-9154-4a67-bfc4-454fd268fec7 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:46.604909 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7bd6c6-7b4f-4e20-8c3f-4b204fac3586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:46.605583 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bd6c6-7b4f-4e20-8c3f-4b204fac3586 None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:46.605868 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bd6c6-7b4f-4e20-8c3f-4b204fac3586 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:46.606145 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bd6c6-7b4f-4e20-8c3f-4b204fac3586 None admin] PATH_INFO: `/v3/groups` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:46.606780 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7bd6c6-7b4f-4e20-8c3f-4b204fac3586 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:46.608326 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7bd6c6-7b4f-4e20-8c3f-4b204fac3586 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:46.627962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 122/247] 10.222.0.25 () {60 vars in 1134 bytes} [Tue Oct 25 13:11:46 2022] POST /identity/v3/groups => generated 226 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:11:46.629564 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:46.648133 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31af065-0614-4098-9d98-419247a8042d None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:46.687987 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a048aa6-6f8a-4f14-b330-fdd6d899aaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:46.688809 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a048aa6-6f8a-4f14-b330-fdd6d899aaed None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:46.689091 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a048aa6-6f8a-4f14-b330-fdd6d899aaed None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:46.689398 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a048aa6-6f8a-4f14-b330-fdd6d899aaed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:46.700968 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a048aa6-6f8a-4f14-b330-fdd6d899aaed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:11:46.706616 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-7a048aa6-6f8a-4f14-b330-fdd6d899aaed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 25 13:11:46.706616 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:11:46.706616 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:11:46.706616 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:11:46.706616 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:11:46.706616 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:11:46.706616 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:11:46.706616 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:11:46.706616 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:11:46.706616 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:11:46.706616 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:11:46.706616 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:11:46.706616 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:11:46.706616 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:11:46.706616 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:11:46.706616 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:11:46.707556 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:11:46.707556 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:11:46.707556 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:11:46.707556 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:11:46.707556 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:11:46.707556 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:11:46.707556 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:11:46.707556 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:11:46.707556 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:11:46.707556 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:11:46.707556 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:11:46.707556 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:11:46.707556 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:11:46.707556 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:11:46.707556 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:11:46.707556 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:11:46.708410 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:11:46.708410 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:11:46.708410 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:11:46.708410 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:11:46.708410 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:11:46.708410 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:11:46.708410 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:11:46.708410 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:11:46.708410 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:11:46.708410 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:11:46.708410 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 25 13:11:46.708410 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:11:46.708410 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 126/248] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 25 13:11:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 13:11:46.717903 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7bd6c6-7b4f-4e20-8c3f-4b204fac3586 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:46.761141 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:46.777051 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a048aa6-6f8a-4f14-b330-fdd6d899aaed None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:46.844507 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7bd6c6-7b4f-4e20-8c3f-4b204fac3586 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:46.884277 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c231aa5-09bb-44d0-9f2c-5e38dbdae10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:46.884989 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c231aa5-09bb-44d0-9f2c-5e38dbdae10f None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:46.885264 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c231aa5-09bb-44d0-9f2c-5e38dbdae10f None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:46.885533 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c231aa5-09bb-44d0-9f2c-5e38dbdae10f None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:46.886197 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c231aa5-09bb-44d0-9f2c-5e38dbdae10f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:46.886491 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c231aa5-09bb-44d0-9f2c-5e38dbdae10f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:46.888150 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c231aa5-09bb-44d0-9f2c-5e38dbdae10f None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:46.900327 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 123/249] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 25 13:11:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:46.904356 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a048aa6-6f8a-4f14-b330-fdd6d899aaed None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:46.909069 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c231aa5-09bb-44d0-9f2c-5e38dbdae10f None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:46.945897 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52fbc92-fab6-4080-90e6-89da88c246f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:46.946537 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fbc92-fab6-4080-90e6-89da88c246f5 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:46.946822 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fbc92-fab6-4080-90e6-89da88c246f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:46.947273 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fbc92-fab6-4080-90e6-89da88c246f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:46.959790 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52fbc92-fab6-4080-90e6-89da88c246f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:11:46.965538 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-d52fbc92-fab6-4080-90e6-89da88c246f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 25 13:11:46.965538 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:11:46.965538 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:11:46.965538 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:11:46.965538 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:11:46.965538 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:11:46.965538 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:11:46.965538 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:11:46.965538 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:11:46.965538 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:11:46.965538 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:11:46.965538 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:11:46.965538 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:11:46.965538 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:11:46.965538 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:11:46.965538 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:11:46.966395 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:11:46.966395 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:11:46.966395 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:11:46.966395 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:11:46.966395 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:11:46.966395 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:11:46.966395 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:11:46.966395 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:11:46.966395 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:11:46.966395 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:11:46.966395 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:11:46.966395 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:11:46.966395 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:11:46.966395 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:11:46.966395 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:11:46.966395 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:11:46.967185 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:11:46.967185 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:11:46.967185 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:11:46.967185 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:11:46.967185 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:11:46.967185 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:11:46.967185 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:11:46.967185 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:11:46.967185 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:11:46.967185 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:11:46.967185 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 25 13:11:46.967185 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:11:46.967185 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 127/250] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 25 13:11:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 13:11:46.974627 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52fbc92-fab6-4080-90e6-89da88c246f5 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:46.984142 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:47.040894 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:47.045641 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c231aa5-09bb-44d0-9f2c-5e38dbdae10f None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:47.093298 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea5e87-f871-404f-a454-14bb9c321b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:47.095031 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea5e87-f871-404f-a454-14bb9c321b3d None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:47.095495 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea5e87-f871-404f-a454-14bb9c321b3d None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:47.095964 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea5e87-f871-404f-a454-14bb9c321b3d None admin] PATH_INFO: `/v3/users/532302a95f3f450f823dc9110fe37e0c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:47.097416 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea5e87-f871-404f-a454-14bb9c321b3d None admin] RBAC: Authorizing `identity:get_user(user_id=532302a95f3f450f823dc9110fe37e0c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:47.099038 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea5e87-f871-404f-a454-14bb9c321b3d None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:47.101399 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 124/251] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 25 13:11:46 2022] GET /identity/v3/users/532302a95f3f450f823dc9110fe37e0c => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:11:47.107212 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea5e87-f871-404f-a454-14bb9c321b3d None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:47.125668 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52fbc92-fab6-4080-90e6-89da88c246f5 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:47.166692 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54183aaa-e18e-4808-9085-3dc1da0c93cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:47.167927 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54183aaa-e18e-4808-9085-3dc1da0c93cc None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:47.168037 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54183aaa-e18e-4808-9085-3dc1da0c93cc None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:47.168313 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54183aaa-e18e-4808-9085-3dc1da0c93cc None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:47.168986 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54183aaa-e18e-4808-9085-3dc1da0c93cc None admin] RBAC: Adding query filter params (name=member) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:47.169290 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54183aaa-e18e-4808-9085-3dc1da0c93cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:47.170960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54183aaa-e18e-4808-9085-3dc1da0c93cc None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:47.182988 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 128/252] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 25 13:11:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:47.189123 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54183aaa-e18e-4808-9085-3dc1da0c93cc None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:47.253559 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea5e87-f871-404f-a454-14bb9c321b3d None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:47.284527 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:47.295666 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88204e6c-8817-4183-9bea-cc43dc1bbcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:47.296349 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88204e6c-8817-4183-9bea-cc43dc1bbcd7 None admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:47.296634 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88204e6c-8817-4183-9bea-cc43dc1bbcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:47.296908 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88204e6c-8817-4183-9bea-cc43dc1bbcd7 None admin] PATH_INFO: `/v3/system/users/532302a95f3f450f823dc9110fe37e0c/roles/cf3c7c662d454e63953da94d2d986171` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:47.299010 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88204e6c-8817-4183-9bea-cc43dc1bbcd7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=532302a95f3f450f823dc9110fe37e0c, role_id=cf3c7c662d454e63953da94d2d986171)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:47.300433 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88204e6c-8817-4183-9bea-cc43dc1bbcd7 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:47.314650 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 125/253] 10.222.0.25 () {58 vars in 1334 bytes} [Tue Oct 25 13:11:47 2022] PUT /identity/v3/system/users/532302a95f3f450f823dc9110fe37e0c/roles/cf3c7c662d454e63953da94d2d986171 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:11:47.331208 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54183aaa-e18e-4808-9085-3dc1da0c93cc None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:47.371319 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e62e2-be50-4cb9-8c4f-a76ade1f9d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:47.372382 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e62e2-be50-4cb9-8c4f-a76ade1f9d2b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:47.372903 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e62e2-be50-4cb9-8c4f-a76ade1f9d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:47.373390 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e62e2-be50-4cb9-8c4f-a76ade1f9d2b None admin] PATH_INFO: `/v3/users/84772d8a55a24be087fb23386c9539eb` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:47.374849 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e62e2-be50-4cb9-8c4f-a76ade1f9d2b None admin] RBAC: Authorizing `identity:get_user(user_id=84772d8a55a24be087fb23386c9539eb)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:47.376791 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e62e2-be50-4cb9-8c4f-a76ade1f9d2b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:47.379288 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 129/254] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 25 13:11:47 2022] GET /identity/v3/users/84772d8a55a24be087fb23386c9539eb => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:47.385312 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88204e6c-8817-4183-9bea-cc43dc1bbcd7 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:47.430233 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:47.526643 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88204e6c-8817-4183-9bea-cc43dc1bbcd7 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:47.563449 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d260783-ac74-415b-82a7-f17e14d12a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:47.564088 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d260783-ac74-415b-82a7-f17e14d12a2b None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:47.564369 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d260783-ac74-415b-82a7-f17e14d12a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:47.564640 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d260783-ac74-415b-82a7-f17e14d12a2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:47.565428 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d260783-ac74-415b-82a7-f17e14d12a2b None admin] RBAC: Adding query filter params (role.id=9a3705eba27c47daad42ad874948996d, user.id=84772d8a55a24be087fb23386c9539eb, scope.system=all) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:47.565739 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d260783-ac74-415b-82a7-f17e14d12a2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:47.567249 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d260783-ac74-415b-82a7-f17e14d12a2b None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:47.580786 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 126/255] 10.222.0.25 () {56 vars in 1308 bytes} [Tue Oct 25 13:11:47 2022] GET /identity/v3/role_assignments?user.id=84772d8a55a24be087fb23386c9539eb&scope.system=all&role.id=9a3705eba27c47daad42ad874948996d => generated 510 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:49.012367 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6f37b-ab56-4a46-85e6-e93db5df662d None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:49.012935 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6f37b-ab56-4a46-85e6-e93db5df662d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:49.012935 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6f37b-ab56-4a46-85e6-e93db5df662d None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:49.014310 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 130/256] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:49.020751 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c7cd1-0fa9-4a05-90cc-9667ee9aa7af None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:49.021177 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c7cd1-0fa9-4a05-90cc-9667ee9aa7af None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:49.021352 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c7cd1-0fa9-4a05-90cc-9667ee9aa7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:49.045077 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-a35c7cd1-0fa9-4a05-90cc-9667ee9aa7af None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:49.046270 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a35c7cd1-0fa9-4a05-90cc-9667ee9aa7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:49.123251 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 127/257] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 25 13:11:49.311171 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad3e1cc-cc4e-4e59-bc95-adc842efe8be None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:49.311455 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad3e1cc-cc4e-4e59-bc95-adc842efe8be None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:49.311654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad3e1cc-cc4e-4e59-bc95-adc842efe8be None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:49.314402 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 131/258] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 13:11:49.320227 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edf9fb-2509-49d5-886f-438afd094f32 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:49.320520 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edf9fb-2509-49d5-886f-438afd094f32 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:49.320798 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edf9fb-2509-49d5-886f-438afd094f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:49.345536 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-83edf9fb-2509-49d5-886f-438afd094f32 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:49.346736 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-83edf9fb-2509-49d5-886f-438afd094f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:49.357877 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 128/259] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 25 13:11:49.641633 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad3e1cc-cc4e-4e59-bc95-adc842efe8be None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:49.654484 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad3e1cc-cc4e-4e59-bc95-adc842efe8be None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:49.663444 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f5e66-fa6f-4bc6-85b1-cd68fe9acc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:49.664098 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f5e66-fa6f-4bc6-85b1-cd68fe9acc9c admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:49.664379 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f5e66-fa6f-4bc6-85b1-cd68fe9acc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:49.664707 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f5e66-fa6f-4bc6-85b1-cd68fe9acc9c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:49.681012 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64f5e66-fa6f-4bc6-85b1-cd68fe9acc9c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:11:49.685939 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-f64f5e66-fa6f-4bc6-85b1-cd68fe9acc9c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 25 13:11:49.685939 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:11:49.685939 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:11:49.685939 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:11:49.685939 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:11:49.685939 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:11:49.685939 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:11:49.685939 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:11:49.685939 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:11:49.685939 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:11:49.685939 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:11:49.685939 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:11:49.685939 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:11:49.685939 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:11:49.685939 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:11:49.685939 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:11:49.688277 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:11:49.688277 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:11:49.688277 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:11:49.688277 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:11:49.688277 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:11:49.688277 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:11:49.688277 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:11:49.688277 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:11:49.688277 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:11:49.688277 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:11:49.688277 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:11:49.688277 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:11:49.688277 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:11:49.688277 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:11:49.688277 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:11:49.688277 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:11:49.690218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:11:49.690218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:11:49.690218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:11:49.690218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:11:49.690218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:11:49.690218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:11:49.690218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:11:49.690218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:11:49.690218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:11:49.690218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:11:49.690218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 25 13:11:49.690218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:11:49.690218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 132/260] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Oct 25 13:11:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:11:49.697483 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83edf9fb-2509-49d5-886f-438afd094f32 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:49.717741 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f5e66-fa6f-4bc6-85b1-cd68fe9acc9c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:49.718047 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83edf9fb-2509-49d5-886f-438afd094f32 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:49.722807 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5bcb5-d3e1-419b-9506-7921ffce461b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:49.723216 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5bcb5-d3e1-419b-9506-7921ffce461b admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:49.723496 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5bcb5-d3e1-419b-9506-7921ffce461b admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:49.723766 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5bcb5-d3e1-419b-9506-7921ffce461b admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:49.728052 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff5bcb5-d3e1-419b-9506-7921ffce461b admin admin] RBAC: Adding query filter params (name=member) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:49.728052 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff5bcb5-d3e1-419b-9506-7921ffce461b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:49.728052 dv-cinder-862432-2-smb devstack@keystone.service[81363]: WARNING py.warnings [None req-aff5bcb5-d3e1-419b-9506-7921ffce461b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 25 13:11:49.728052 dv-cinder-862432-2-smb devstack@keystone.service[81363]: warnings.warn(msg) Oct 25 13:11:49.728052 dv-cinder-862432-2-smb devstack@keystone.service[81363]: Oct 25 13:11:49.728052 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff5bcb5-d3e1-419b-9506-7921ffce461b admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:49.728865 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f5e66-fa6f-4bc6-85b1-cd68fe9acc9c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:49.733868 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de529250-9912-4a55-b6db-babe4704fd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:49.735101 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de529250-9912-4a55-b6db-babe4704fd19 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:49.735377 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de529250-9912-4a55-b6db-babe4704fd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:49.735655 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de529250-9912-4a55-b6db-babe4704fd19 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:49.747459 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 129/261] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Oct 25 13:11:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:49.749660 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de529250-9912-4a55-b6db-babe4704fd19 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:11:49.753834 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5bcb5-d3e1-419b-9506-7921ffce461b admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:49.754714 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-de529250-9912-4a55-b6db-babe4704fd19 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 13:11:49.754714 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:11:49.754714 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:11:49.754714 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:11:49.754714 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:11:49.754714 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:11:49.754714 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:11:49.754714 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:11:49.754714 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:11:49.754714 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:11:49.754714 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:11:49.754714 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:11:49.754714 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:11:49.754714 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:11:49.754714 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:11:49.754714 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:11:49.756896 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:11:49.756896 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:11:49.756896 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:11:49.756896 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:11:49.756896 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:11:49.756896 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:11:49.756896 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:11:49.756896 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:11:49.756896 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:11:49.756896 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:11:49.756896 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:11:49.756896 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:11:49.756896 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:11:49.756896 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:11:49.756896 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:11:49.756896 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:11:49.758845 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:11:49.758845 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:11:49.758845 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:11:49.758845 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:11:49.758845 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:11:49.758845 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:11:49.758845 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:11:49.758845 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:11:49.758845 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:11:49.758845 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:11:49.758845 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 13:11:49.758845 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:11:49.758845 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 133/262] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Oct 25 13:11:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 13:11:49.765268 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de529250-9912-4a55-b6db-babe4704fd19 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:49.770442 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5bcb5-d3e1-419b-9506-7921ffce461b admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:49.778162 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de529250-9912-4a55-b6db-babe4704fd19 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:49.782441 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17557eac-e8e1-42d0-b2f6-bc9a752f486c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:49.783082 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17557eac-e8e1-42d0-b2f6-bc9a752f486c admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:49.783361 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17557eac-e8e1-42d0-b2f6-bc9a752f486c admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:49.783686 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17557eac-e8e1-42d0-b2f6-bc9a752f486c admin admin] PATH_INFO: `/v3/groups/23a70719192744bea823930ba165eab7` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:49.789778 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a39e9e-b1f5-405b-b437-35523658aada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:49.790465 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a39e9e-b1f5-405b-b437-35523658aada admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:49.790634 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17557eac-e8e1-42d0-b2f6-bc9a752f486c admin admin] RBAC: Authorizing `identity:get_group(group_id=23a70719192744bea823930ba165eab7)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:49.790785 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a39e9e-b1f5-405b-b437-35523658aada admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:49.791015 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a39e9e-b1f5-405b-b437-35523658aada admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:49.791690 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a39e9e-b1f5-405b-b437-35523658aada admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:49.791848 dv-cinder-862432-2-smb devstack@keystone.service[81363]: WARNING py.warnings [None req-17557eac-e8e1-42d0-b2f6-bc9a752f486c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 13:11:49.791848 dv-cinder-862432-2-smb devstack@keystone.service[81363]: warnings.warn(msg) Oct 25 13:11:49.791848 dv-cinder-862432-2-smb devstack@keystone.service[81363]: Oct 25 13:11:49.792505 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a39e9e-b1f5-405b-b437-35523658aada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:49.793290 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17557eac-e8e1-42d0-b2f6-bc9a752f486c admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:49.794010 dv-cinder-862432-2-smb devstack@keystone.service[81362]: WARNING py.warnings [None req-12a39e9e-b1f5-405b-b437-35523658aada admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 25 13:11:49.794010 dv-cinder-862432-2-smb devstack@keystone.service[81362]: warnings.warn(msg) Oct 25 13:11:49.794010 dv-cinder-862432-2-smb devstack@keystone.service[81362]: Oct 25 13:11:49.794916 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a39e9e-b1f5-405b-b437-35523658aada admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:49.796662 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 130/263] 10.222.0.25 () {56 vars in 1201 bytes} [Tue Oct 25 13:11:49 2022] GET /identity/v3/groups/23a70719192744bea823930ba165eab7 => generated 226 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:49.806366 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17557eac-e8e1-42d0-b2f6-bc9a752f486c admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:49.817240 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 134/264] 10.222.0.25 () {56 vars in 1132 bytes} [Tue Oct 25 13:11:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:11:49.820434 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17557eac-e8e1-42d0-b2f6-bc9a752f486c admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:49.829044 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2abac1b-35dc-4db4-9f1d-dd288a1702fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:49.829466 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a39e9e-b1f5-405b-b437-35523658aada admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:49.829694 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abac1b-35dc-4db4-9f1d-dd288a1702fe admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:49.829975 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abac1b-35dc-4db4-9f1d-dd288a1702fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:49.830247 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abac1b-35dc-4db4-9f1d-dd288a1702fe admin admin] PATH_INFO: `/v3/projects/f1b2d2ce464841cdb520ee093e9fc8d5` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:49.832675 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2abac1b-35dc-4db4-9f1d-dd288a1702fe admin admin] RBAC: Authorizing `identity:get_project(project_id=f1b2d2ce464841cdb520ee093e9fc8d5)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:49.834826 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2abac1b-35dc-4db4-9f1d-dd288a1702fe admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:49.836997 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 131/265] 10.222.0.25 () {56 vars in 1207 bytes} [Tue Oct 25 13:11:49 2022] GET /identity/v3/projects/f1b2d2ce464841cdb520ee093e9fc8d5 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:49.841763 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a39e9e-b1f5-405b-b437-35523658aada admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:49.843082 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2abac1b-35dc-4db4-9f1d-dd288a1702fe admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:49.862446 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a5e44-e24d-416a-a8ad-a9a5dbb08bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:49.863108 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a5e44-e24d-416a-a8ad-a9a5dbb08bbc admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:49.863387 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a5e44-e24d-416a-a8ad-a9a5dbb08bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:49.863658 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a5e44-e24d-416a-a8ad-a9a5dbb08bbc admin admin] PATH_INFO: `/v3/groups/23a70719192744bea823930ba165eab7` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:49.865618 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2abac1b-35dc-4db4-9f1d-dd288a1702fe admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:49.866837 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a5e44-e24d-416a-a8ad-a9a5dbb08bbc admin admin] RBAC: Authorizing `identity:get_group(group_id=23a70719192744bea823930ba165eab7)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:49.867863 dv-cinder-862432-2-smb devstack@keystone.service[81362]: WARNING py.warnings [None req-3e8a5e44-e24d-416a-a8ad-a9a5dbb08bbc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 13:11:49.867863 dv-cinder-862432-2-smb devstack@keystone.service[81362]: warnings.warn(msg) Oct 25 13:11:49.867863 dv-cinder-862432-2-smb devstack@keystone.service[81362]: Oct 25 13:11:49.869093 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a5e44-e24d-416a-a8ad-a9a5dbb08bbc admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:49.877538 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 135/266] 10.222.0.25 () {56 vars in 1201 bytes} [Tue Oct 25 13:11:49 2022] GET /identity/v3/groups/23a70719192744bea823930ba165eab7 => generated 226 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:11:49.881646 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5a57a-89d3-4f8c-b2b0-ed09a5ff8efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:49.882323 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5a57a-89d3-4f8c-b2b0-ed09a5ff8efd admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:49.882608 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5a57a-89d3-4f8c-b2b0-ed09a5ff8efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:49.882881 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5a57a-89d3-4f8c-b2b0-ed09a5ff8efd admin admin] PATH_INFO: `/v3/projects/f1b2d2ce464841cdb520ee093e9fc8d5/groups/23a70719192744bea823930ba165eab7/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:49.884537 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a5e44-e24d-416a-a8ad-a9a5dbb08bbc admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:49.890593 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a5a57a-89d3-4f8c-b2b0-ed09a5ff8efd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1b2d2ce464841cdb520ee093e9fc8d5, group_id=23a70719192744bea823930ba165eab7, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:49.891805 dv-cinder-862432-2-smb devstack@keystone.service[81363]: WARNING py.warnings [None req-77a5a57a-89d3-4f8c-b2b0-ed09a5ff8efd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 13:11:49.891805 dv-cinder-862432-2-smb devstack@keystone.service[81363]: warnings.warn(msg) Oct 25 13:11:49.891805 dv-cinder-862432-2-smb devstack@keystone.service[81363]: Oct 25 13:11:49.893736 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a5a57a-89d3-4f8c-b2b0-ed09a5ff8efd admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:49.899482 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:49.901568 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a5e44-e24d-416a-a8ad-a9a5dbb08bbc admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:49.913107 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bca295-5d12-4034-8b59-ce495b6395e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:49.919044 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bca295-5d12-4034-8b59-ce495b6395e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:49.919335 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bca295-5d12-4034-8b59-ce495b6395e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:49.919615 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bca295-5d12-4034-8b59-ce495b6395e6 admin admin] PATH_INFO: `/v3/projects/f1b2d2ce464841cdb520ee093e9fc8d5` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:49.922562 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 132/267] 10.222.0.25 () {58 vars in 1463 bytes} [Tue Oct 25 13:11:49 2022] PUT /identity/v3/projects/f1b2d2ce464841cdb520ee093e9fc8d5/groups/23a70719192744bea823930ba165eab7/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:11:49.923352 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bca295-5d12-4034-8b59-ce495b6395e6 admin admin] RBAC: Authorizing `identity:get_project(project_id=f1b2d2ce464841cdb520ee093e9fc8d5)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:49.925496 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bca295-5d12-4034-8b59-ce495b6395e6 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:49.927621 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 136/268] 10.222.0.25 () {56 vars in 1207 bytes} [Tue Oct 25 13:11:49 2022] GET /identity/v3/projects/f1b2d2ce464841cdb520ee093e9fc8d5 => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:49.933561 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5a57a-89d3-4f8c-b2b0-ed09a5ff8efd admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:50.024781 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5a57a-89d3-4f8c-b2b0-ed09a5ff8efd admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:50.032591 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72519184-eb25-42c6-af6d-4ef31bbd1a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:50.033281 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72519184-eb25-42c6-af6d-4ef31bbd1a00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:50.033565 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72519184-eb25-42c6-af6d-4ef31bbd1a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:50.033840 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72519184-eb25-42c6-af6d-4ef31bbd1a00 admin admin] PATH_INFO: `/v3/projects/f1b2d2ce464841cdb520ee093e9fc8d5/groups/23a70719192744bea823930ba165eab7/roles/955523e4392d4c278c29f6ce715a5ae6` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:50.036104 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72519184-eb25-42c6-af6d-4ef31bbd1a00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1b2d2ce464841cdb520ee093e9fc8d5, group_id=23a70719192744bea823930ba165eab7, role_id=955523e4392d4c278c29f6ce715a5ae6)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:50.038888 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72519184-eb25-42c6-af6d-4ef31bbd1a00 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:50.064689 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 133/269] 10.222.0.25 () {58 vars in 1463 bytes} [Tue Oct 25 13:11:49 2022] PUT /identity/v3/projects/f1b2d2ce464841cdb520ee093e9fc8d5/groups/23a70719192744bea823930ba165eab7/roles/955523e4392d4c278c29f6ce715a5ae6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:11:50.555930 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6902fbc-be80-4c59-a43b-4137687e0a60 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:50.556438 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6902fbc-be80-4c59-a43b-4137687e0a60 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:50.556520 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6902fbc-be80-4c59-a43b-4137687e0a60 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:50.557824 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 137/270] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:50.563950 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521b4bb-f15e-4517-90e8-b4bf95f02617 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:50.564251 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521b4bb-f15e-4517-90e8-b4bf95f02617 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:50.564524 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521b4bb-f15e-4517-90e8-b4bf95f02617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:50.590261 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-e521b4bb-f15e-4517-90e8-b4bf95f02617 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:50.591467 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-e521b4bb-f15e-4517-90e8-b4bf95f02617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:50.674363 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 134/271] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 25 13:11:50.866897 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b973a-850d-4c1d-9043-ec2dd02151ba None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:50.867224 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b973a-850d-4c1d-9043-ec2dd02151ba None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:50.867400 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b973a-850d-4c1d-9043-ec2dd02151ba None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:50.868963 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 138/272] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:50.877163 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2aef21-4a53-40d5-b02d-e4e2e65c7436 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:50.877446 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2aef21-4a53-40d5-b02d-e4e2e65c7436 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:50.877724 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2aef21-4a53-40d5-b02d-e4e2e65c7436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:50.904973 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-ce2aef21-4a53-40d5-b02d-e4e2e65c7436 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:50.906177 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ce2aef21-4a53-40d5-b02d-e4e2e65c7436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:50.987337 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 135/273] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:11:51.072471 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b973a-850d-4c1d-9043-ec2dd02151ba None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:51.085828 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b973a-850d-4c1d-9043-ec2dd02151ba None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:51.090201 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f3a7d-f4e9-4933-ace1-f82c411d3fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:51.090831 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f3a7d-f4e9-4933-ace1-f82c411d3fdd admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:51.091110 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f3a7d-f4e9-4933-ace1-f82c411d3fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:51.091384 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f3a7d-f4e9-4933-ace1-f82c411d3fdd admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:51.102612 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f3a7d-f4e9-4933-ace1-f82c411d3fdd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:11:51.107813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-6b7f3a7d-f4e9-4933-ace1-f82c411d3fdd admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 25 13:11:51.107813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:11:51.107813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:11:51.107813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:11:51.107813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:11:51.107813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:11:51.107813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:11:51.107813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:11:51.107813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:11:51.107813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:11:51.107813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:11:51.107813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:11:51.107813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:11:51.107813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:11:51.107813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:11:51.107813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:11:51.108701 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:11:51.108701 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:11:51.108701 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:11:51.108701 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:11:51.108701 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:11:51.108701 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:11:51.108701 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:11:51.108701 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:11:51.108701 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:11:51.108701 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:11:51.108701 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:11:51.108701 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:11:51.108701 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:11:51.108701 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:11:51.108701 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:11:51.108701 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:11:51.110032 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:11:51.110032 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:11:51.110032 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:11:51.110032 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:11:51.110032 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:11:51.110032 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:11:51.110032 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:11:51.110032 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:11:51.110032 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:11:51.110032 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:11:51.110032 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 25 13:11:51.110032 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:11:51.110032 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 139/274] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Oct 25 13:11:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:11:51.116173 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2aef21-4a53-40d5-b02d-e4e2e65c7436 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:51.126990 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2aef21-4a53-40d5-b02d-e4e2e65c7436 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:51.131438 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84128ecc-93a8-4343-abab-f0fc8b8c2eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:51.132083 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84128ecc-93a8-4343-abab-f0fc8b8c2eeb admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:51.132362 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84128ecc-93a8-4343-abab-f0fc8b8c2eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:51.132636 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84128ecc-93a8-4343-abab-f0fc8b8c2eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:51.133310 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84128ecc-93a8-4343-abab-f0fc8b8c2eeb admin admin] RBAC: Adding query filter params (name=member) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:51.133607 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84128ecc-93a8-4343-abab-f0fc8b8c2eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:51.135201 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84128ecc-93a8-4343-abab-f0fc8b8c2eeb admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:51.141933 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:51.145891 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 136/275] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Oct 25 13:11:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:51.151887 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f3a7d-f4e9-4933-ace1-f82c411d3fdd admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:51.162848 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f3a7d-f4e9-4933-ace1-f82c411d3fdd admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:51.167573 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e66ac5-a365-4903-9eef-59abb19a1f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:51.168245 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e66ac5-a365-4903-9eef-59abb19a1f1e admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:51.168523 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e66ac5-a365-4903-9eef-59abb19a1f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:51.168793 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e66ac5-a365-4903-9eef-59abb19a1f1e admin admin] PATH_INFO: `/v3/groups/23a70719192744bea823930ba165eab7` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:51.169896 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e66ac5-a365-4903-9eef-59abb19a1f1e admin admin] RBAC: Authorizing `identity:get_group(group_id=23a70719192744bea823930ba165eab7)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:51.171827 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e66ac5-a365-4903-9eef-59abb19a1f1e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:51.174386 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 140/276] 10.222.0.25 () {56 vars in 1201 bytes} [Tue Oct 25 13:11:51 2022] GET /identity/v3/groups/23a70719192744bea823930ba165eab7 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:51.180182 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84128ecc-93a8-4343-abab-f0fc8b8c2eeb admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:51.190743 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84128ecc-93a8-4343-abab-f0fc8b8c2eeb admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:51.195188 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a240204-2cd3-48a1-a936-a0d4af90f548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:51.195810 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a240204-2cd3-48a1-a936-a0d4af90f548 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:51.196117 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a240204-2cd3-48a1-a936-a0d4af90f548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:51.196391 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a240204-2cd3-48a1-a936-a0d4af90f548 admin admin] PATH_INFO: `/v3/projects/9345d01ad6914f64aaa073a1e6a86a02` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:51.197509 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a240204-2cd3-48a1-a936-a0d4af90f548 admin admin] RBAC: Authorizing `identity:get_project(project_id=9345d01ad6914f64aaa073a1e6a86a02)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:51.199559 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a240204-2cd3-48a1-a936-a0d4af90f548 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:51.201381 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 137/277] 10.222.0.25 () {56 vars in 1207 bytes} [Tue Oct 25 13:11:51 2022] GET /identity/v3/projects/9345d01ad6914f64aaa073a1e6a86a02 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:11:51.207747 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e66ac5-a365-4903-9eef-59abb19a1f1e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:51.217790 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e66ac5-a365-4903-9eef-59abb19a1f1e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:51.223059 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666f25d-ad3d-4a8b-a23e-98c3ca6dfab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:51.223729 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666f25d-ad3d-4a8b-a23e-98c3ca6dfab2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:51.224059 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666f25d-ad3d-4a8b-a23e-98c3ca6dfab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:51.224338 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666f25d-ad3d-4a8b-a23e-98c3ca6dfab2 admin admin] PATH_INFO: `/v3/projects/9345d01ad6914f64aaa073a1e6a86a02/groups/23a70719192744bea823930ba165eab7/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:51.226237 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f666f25d-ad3d-4a8b-a23e-98c3ca6dfab2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9345d01ad6914f64aaa073a1e6a86a02, group_id=23a70719192744bea823930ba165eab7, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:51.227257 dv-cinder-862432-2-smb devstack@keystone.service[81362]: WARNING py.warnings [None req-f666f25d-ad3d-4a8b-a23e-98c3ca6dfab2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 13:11:51.227257 dv-cinder-862432-2-smb devstack@keystone.service[81362]: warnings.warn(msg) Oct 25 13:11:51.227257 dv-cinder-862432-2-smb devstack@keystone.service[81362]: Oct 25 13:11:51.229252 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f666f25d-ad3d-4a8b-a23e-98c3ca6dfab2 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:51.253312 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 141/278] 10.222.0.25 () {58 vars in 1463 bytes} [Tue Oct 25 13:11:51 2022] PUT /identity/v3/projects/9345d01ad6914f64aaa073a1e6a86a02/groups/23a70719192744bea823930ba165eab7/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:11:51.320201 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a240204-2cd3-48a1-a936-a0d4af90f548 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:51.460095 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a240204-2cd3-48a1-a936-a0d4af90f548 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:51.511375 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d670c3-8386-4542-8533-4945cefd13aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:51.512099 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d670c3-8386-4542-8533-4945cefd13aa None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:51.512378 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d670c3-8386-4542-8533-4945cefd13aa None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:51.512702 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d670c3-8386-4542-8533-4945cefd13aa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:51.530512 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d670c3-8386-4542-8533-4945cefd13aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:11:51.537266 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-63d670c3-8386-4542-8533-4945cefd13aa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 25 13:11:51.537266 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:11:51.537266 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:11:51.537266 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:11:51.537266 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:11:51.537266 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:11:51.537266 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:11:51.537266 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:11:51.537266 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:11:51.537266 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:11:51.537266 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:11:51.537266 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:11:51.537266 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:11:51.537266 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:11:51.537266 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:11:51.537266 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:11:51.538189 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:11:51.538189 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:11:51.538189 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:11:51.538189 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:11:51.538189 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:11:51.538189 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:11:51.538189 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:11:51.538189 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:11:51.538189 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:11:51.538189 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:11:51.538189 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:11:51.538189 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:11:51.538189 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:11:51.538189 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:11:51.538189 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:11:51.538189 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:11:51.538978 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:11:51.538978 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:11:51.538978 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:11:51.538978 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:11:51.538978 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:11:51.538978 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:11:51.538978 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:11:51.538978 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:11:51.538978 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:11:51.538978 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:11:51.538978 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 25 13:11:51.538978 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:11:51.538978 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 138/279] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 25 13:11:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 13:11:51.545081 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666f25d-ad3d-4a8b-a23e-98c3ca6dfab2 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:51.582232 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab14eb-a0fb-41a2-a819-af7275580a04 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:51.582592 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab14eb-a0fb-41a2-a819-af7275580a04 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:51.582776 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab14eb-a0fb-41a2-a819-af7275580a04 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:51.584234 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 139/280] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:51.590115 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4ce84-7f20-41d4-8762-d4f8185df8d2 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:51.590388 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4ce84-7f20-41d4-8762-d4f8185df8d2 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:51.590659 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4ce84-7f20-41d4-8762-d4f8185df8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:51.619130 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-3db4ce84-7f20-41d4-8762-d4f8185df8d2 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:51.622489 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-3db4ce84-7f20-41d4-8762-d4f8185df8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:51.688494 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:51.754669 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 140/281] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 25 13:11:51.764224 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666f25d-ad3d-4a8b-a23e-98c3ca6dfab2 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:51.803942 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d581491-2773-40e6-b58a-df6067ea83c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:51.804560 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d581491-2773-40e6-b58a-df6067ea83c4 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:51.804817 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d581491-2773-40e6-b58a-df6067ea83c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:51.805085 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d581491-2773-40e6-b58a-df6067ea83c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:51.805826 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d581491-2773-40e6-b58a-df6067ea83c4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:51.806126 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d581491-2773-40e6-b58a-df6067ea83c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:51.807621 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d581491-2773-40e6-b58a-df6067ea83c4 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:51.817963 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 142/282] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 25 13:11:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:11:51.823842 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4ce84-7f20-41d4-8762-d4f8185df8d2 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:51.828755 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:51.878901 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990331f7-4d66-471a-9a61-c810fda33df5 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:51.879215 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990331f7-4d66-471a-9a61-c810fda33df5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:51.879453 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990331f7-4d66-471a-9a61-c810fda33df5 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:51.881096 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 143/283] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:51.888677 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1f32f-377c-48c3-915c-22dfae6775b5 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:51.888954 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1f32f-377c-48c3-915c-22dfae6775b5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:51.889221 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1f32f-377c-48c3-915c-22dfae6775b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:51.923960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-fde1f32f-377c-48c3-915c-22dfae6775b5 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:51.927724 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fde1f32f-377c-48c3-915c-22dfae6775b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:51.948962 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 144/284] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 25 13:11:51.972225 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4ce84-7f20-41d4-8762-d4f8185df8d2 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:52.014071 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb9e37-f735-4f8f-a69b-d0fe39672910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:52.014636 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb9e37-f735-4f8f-a69b-d0fe39672910 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:52.014912 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb9e37-f735-4f8f-a69b-d0fe39672910 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:52.015183 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb9e37-f735-4f8f-a69b-d0fe39672910 None admin] PATH_INFO: `/v3/users/532302a95f3f450f823dc9110fe37e0c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:52.016926 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb9e37-f735-4f8f-a69b-d0fe39672910 None admin] RBAC: Authorizing `identity:get_user(user_id=532302a95f3f450f823dc9110fe37e0c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:52.018358 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb9e37-f735-4f8f-a69b-d0fe39672910 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:52.020339 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 141/285] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 25 13:11:51 2022] GET /identity/v3/users/532302a95f3f450f823dc9110fe37e0c => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:52.026298 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1f32f-377c-48c3-915c-22dfae6775b5 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:52.137698 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1f32f-377c-48c3-915c-22dfae6775b5 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:52.162241 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:52.175093 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a6b9e3-7594-4edd-8f5b-af13142b73b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:52.175697 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6b9e3-7594-4edd-8f5b-af13142b73b8 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:52.176003 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6b9e3-7594-4edd-8f5b-af13142b73b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:52.176280 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6b9e3-7594-4edd-8f5b-af13142b73b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:52.176995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a6b9e3-7594-4edd-8f5b-af13142b73b8 None admin] RBAC: Adding query filter params (role.id=cf3c7c662d454e63953da94d2d986171, user.id=532302a95f3f450f823dc9110fe37e0c, scope.system=all) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:52.177299 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a6b9e3-7594-4edd-8f5b-af13142b73b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:52.178836 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a6b9e3-7594-4edd-8f5b-af13142b73b8 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:52.191788 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 145/286] 10.222.0.25 () {56 vars in 1308 bytes} [Tue Oct 25 13:11:52 2022] GET /identity/v3/role_assignments?user.id=532302a95f3f450f823dc9110fe37e0c&scope.system=all&role.id=cf3c7c662d454e63953da94d2d986171 => generated 510 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:52.296209 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb9e37-f735-4f8f-a69b-d0fe39672910 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:52.308352 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb9e37-f735-4f8f-a69b-d0fe39672910 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:52.315291 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bd7f0-6b74-4801-bce7-4626f8281d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:52.315938 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bd7f0-6b74-4801-bce7-4626f8281d1e admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:52.316277 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bd7f0-6b74-4801-bce7-4626f8281d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:52.316550 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bd7f0-6b74-4801-bce7-4626f8281d1e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:52.329348 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457bd7f0-6b74-4801-bce7-4626f8281d1e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:11:52.334308 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-457bd7f0-6b74-4801-bce7-4626f8281d1e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 13:11:52.334308 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:11:52.334308 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:11:52.334308 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:11:52.334308 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:11:52.334308 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:11:52.334308 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:11:52.334308 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:11:52.334308 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:11:52.334308 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:11:52.334308 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:11:52.334308 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:11:52.334308 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:11:52.334308 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:11:52.334308 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:11:52.334308 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:11:52.335170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:11:52.335170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:11:52.335170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:11:52.335170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:11:52.335170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:11:52.335170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:11:52.335170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:11:52.335170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:11:52.335170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:11:52.335170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:11:52.335170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:11:52.335170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:11:52.335170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:11:52.335170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:11:52.335170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:11:52.335170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:11:52.337419 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:11:52.337419 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:11:52.337419 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:11:52.337419 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:11:52.337419 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:11:52.337419 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:11:52.337419 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:11:52.337419 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:11:52.337419 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:11:52.337419 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:11:52.337419 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 13:11:52.337419 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:11:52.337419 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 142/287] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Oct 25 13:11:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:11:52.345493 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a6b9e3-7594-4edd-8f5b-af13142b73b8 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:52.358969 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a6b9e3-7594-4edd-8f5b-af13142b73b8 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:52.365299 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4771f6f-b475-409f-9565-ba4ca1bfacf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:52.365972 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4771f6f-b475-409f-9565-ba4ca1bfacf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:52.366249 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4771f6f-b475-409f-9565-ba4ca1bfacf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:52.366517 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4771f6f-b475-409f-9565-ba4ca1bfacf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:52.367225 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4771f6f-b475-409f-9565-ba4ca1bfacf6 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:52.367525 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4771f6f-b475-409f-9565-ba4ca1bfacf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:52.369195 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4771f6f-b475-409f-9565-ba4ca1bfacf6 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:52.379353 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 146/288] 10.222.0.25 () {56 vars in 1132 bytes} [Tue Oct 25 13:11:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:52.385715 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bd7f0-6b74-4801-bce7-4626f8281d1e admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:52.397088 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bd7f0-6b74-4801-bce7-4626f8281d1e admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:52.401710 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18c0f9-c419-46d7-baf7-0a6c507967be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:52.402385 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18c0f9-c419-46d7-baf7-0a6c507967be admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:52.402720 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18c0f9-c419-46d7-baf7-0a6c507967be admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:52.402993 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18c0f9-c419-46d7-baf7-0a6c507967be admin admin] PATH_INFO: `/v3/groups/23a70719192744bea823930ba165eab7` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:52.404391 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc18c0f9-c419-46d7-baf7-0a6c507967be admin admin] RBAC: Authorizing `identity:get_group(group_id=23a70719192744bea823930ba165eab7)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:52.406519 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc18c0f9-c419-46d7-baf7-0a6c507967be admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:52.408182 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 143/289] 10.222.0.25 () {56 vars in 1201 bytes} [Tue Oct 25 13:11:52 2022] GET /identity/v3/groups/23a70719192744bea823930ba165eab7 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:52.414054 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4771f6f-b475-409f-9565-ba4ca1bfacf6 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:52.425299 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4771f6f-b475-409f-9565-ba4ca1bfacf6 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:52.436624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a27da-8ee9-4067-b5ec-84b456252dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:52.437276 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a27da-8ee9-4067-b5ec-84b456252dbc admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:52.437712 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a27da-8ee9-4067-b5ec-84b456252dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:52.437990 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a27da-8ee9-4067-b5ec-84b456252dbc admin admin] PATH_INFO: `/v3/projects/9345d01ad6914f64aaa073a1e6a86a02` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:52.439384 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a27da-8ee9-4067-b5ec-84b456252dbc admin admin] RBAC: Authorizing `identity:get_project(project_id=9345d01ad6914f64aaa073a1e6a86a02)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:52.441546 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18c0f9-c419-46d7-baf7-0a6c507967be admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:52.441748 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a27da-8ee9-4067-b5ec-84b456252dbc admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:52.443549 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 147/290] 10.222.0.25 () {56 vars in 1207 bytes} [Tue Oct 25 13:11:52 2022] GET /identity/v3/projects/9345d01ad6914f64aaa073a1e6a86a02 => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:52.452655 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a27da-8ee9-4067-b5ec-84b456252dbc admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:52.458237 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18c0f9-c419-46d7-baf7-0a6c507967be admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:52.463171 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a27da-8ee9-4067-b5ec-84b456252dbc admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:52.463652 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd4e77-32b5-4d8d-a6a8-0e4d702b8025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:52.464687 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd4e77-32b5-4d8d-a6a8-0e4d702b8025 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:52.465201 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd4e77-32b5-4d8d-a6a8-0e4d702b8025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:52.465722 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd4e77-32b5-4d8d-a6a8-0e4d702b8025 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:52.476085 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a70227-87cf-411f-9e9f-1f977ea275e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:52.476740 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a70227-87cf-411f-9e9f-1f977ea275e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:52.477019 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a70227-87cf-411f-9e9f-1f977ea275e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:52.477291 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a70227-87cf-411f-9e9f-1f977ea275e6 admin admin] PATH_INFO: `/v3/projects/9345d01ad6914f64aaa073a1e6a86a02/groups/23a70719192744bea823930ba165eab7/roles/955523e4392d4c278c29f6ce715a5ae6` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:52.480869 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a70227-87cf-411f-9e9f-1f977ea275e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9345d01ad6914f64aaa073a1e6a86a02, group_id=23a70719192744bea823930ba165eab7, role_id=955523e4392d4c278c29f6ce715a5ae6)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:52.481707 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd4e77-32b5-4d8d-a6a8-0e4d702b8025 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:11:52.489281 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a70227-87cf-411f-9e9f-1f977ea275e6 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:52.493993 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-f9bd4e77-32b5-4d8d-a6a8-0e4d702b8025 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 13:11:52.493993 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:11:52.493993 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:11:52.493993 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:11:52.493993 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:11:52.493993 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:11:52.493993 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:11:52.493993 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:11:52.493993 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:11:52.493993 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:11:52.493993 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:11:52.493993 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:11:52.493993 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:11:52.493993 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:11:52.493993 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:11:52.493993 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:11:52.494914 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:11:52.494914 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:11:52.494914 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:11:52.494914 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:11:52.494914 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:11:52.494914 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:11:52.494914 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:11:52.494914 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:11:52.494914 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:11:52.494914 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:11:52.494914 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:11:52.494914 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:11:52.494914 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:11:52.494914 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:11:52.494914 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:11:52.494914 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:11:52.495738 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:11:52.495738 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:11:52.495738 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:11:52.495738 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:11:52.495738 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:11:52.495738 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:11:52.495738 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:11:52.495738 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:11:52.495738 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:11:52.495738 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:11:52.495738 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 13:11:52.495738 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:11:52.499467 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 144/291] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Oct 25 13:11:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 13:11:52.506660 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd4e77-32b5-4d8d-a6a8-0e4d702b8025 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:52.520421 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd4e77-32b5-4d8d-a6a8-0e4d702b8025 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:52.528230 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 148/292] 10.222.0.25 () {58 vars in 1463 bytes} [Tue Oct 25 13:11:52 2022] PUT /identity/v3/projects/9345d01ad6914f64aaa073a1e6a86a02/groups/23a70719192744bea823930ba165eab7/roles/955523e4392d4c278c29f6ce715a5ae6 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:11:52.601971 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:52.617918 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c881a81-5221-4e67-bdb5-4369f9c57691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:52.618529 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c881a81-5221-4e67-bdb5-4369f9c57691 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:52.618803 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c881a81-5221-4e67-bdb5-4369f9c57691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:52.619071 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c881a81-5221-4e67-bdb5-4369f9c57691 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:52.619734 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c881a81-5221-4e67-bdb5-4369f9c57691 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:52.620059 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c881a81-5221-4e67-bdb5-4369f9c57691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:52.621751 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c881a81-5221-4e67-bdb5-4369f9c57691 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:52.634521 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 145/293] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Oct 25 13:11:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:11:52.640178 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a70227-87cf-411f-9e9f-1f977ea275e6 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:52.662161 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a70227-87cf-411f-9e9f-1f977ea275e6 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:52.672799 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1626b-7c39-4e6d-927d-9f9a0509b454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:52.676472 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1626b-7c39-4e6d-927d-9f9a0509b454 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:52.676786 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1626b-7c39-4e6d-927d-9f9a0509b454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:52.677070 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1626b-7c39-4e6d-927d-9f9a0509b454 admin admin] PATH_INFO: `/v3/groups/12682357ba2043869567b3a4d9087263` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:52.684221 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1626b-7c39-4e6d-927d-9f9a0509b454 admin admin] RBAC: Authorizing `identity:get_group(group_id=12682357ba2043869567b3a4d9087263)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:52.686157 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1626b-7c39-4e6d-927d-9f9a0509b454 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:52.688312 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 149/294] 10.222.0.25 () {56 vars in 1201 bytes} [Tue Oct 25 13:11:52 2022] GET /identity/v3/groups/12682357ba2043869567b3a4d9087263 => generated 229 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:52.694142 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c881a81-5221-4e67-bdb5-4369f9c57691 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:52.707674 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c881a81-5221-4e67-bdb5-4369f9c57691 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:52.726526 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d2c1e5-bd2b-40f6-b4e8-6b0267109874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:52.727232 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2c1e5-bd2b-40f6-b4e8-6b0267109874 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:52.727512 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2c1e5-bd2b-40f6-b4e8-6b0267109874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:52.727838 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2c1e5-bd2b-40f6-b4e8-6b0267109874 admin admin] PATH_INFO: `/v3/projects/9835e5a39eb74917a1e872356cdbdeb5` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:52.731324 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d2c1e5-bd2b-40f6-b4e8-6b0267109874 admin admin] RBAC: Authorizing `identity:get_project(project_id=9835e5a39eb74917a1e872356cdbdeb5)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:52.733352 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d2c1e5-bd2b-40f6-b4e8-6b0267109874 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:52.736170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 146/295] 10.222.0.25 () {56 vars in 1207 bytes} [Tue Oct 25 13:11:52 2022] GET /identity/v3/projects/9835e5a39eb74917a1e872356cdbdeb5 => generated 344 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:52.743039 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1626b-7c39-4e6d-927d-9f9a0509b454 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:52.765053 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1626b-7c39-4e6d-927d-9f9a0509b454 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:52.777712 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a942a-e226-4293-b493-7787ddbb1428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:52.778390 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a942a-e226-4293-b493-7787ddbb1428 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:52.778671 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a942a-e226-4293-b493-7787ddbb1428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:52.778947 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a942a-e226-4293-b493-7787ddbb1428 admin admin] PATH_INFO: `/v3/projects/9835e5a39eb74917a1e872356cdbdeb5/groups/12682357ba2043869567b3a4d9087263/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:52.780921 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a942a-e226-4293-b493-7787ddbb1428 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9835e5a39eb74917a1e872356cdbdeb5, group_id=12682357ba2043869567b3a4d9087263, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:52.783665 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a942a-e226-4293-b493-7787ddbb1428 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:52.806204 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 150/296] 10.222.0.25 () {58 vars in 1463 bytes} [Tue Oct 25 13:11:52 2022] PUT /identity/v3/projects/9835e5a39eb74917a1e872356cdbdeb5/groups/12682357ba2043869567b3a4d9087263/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:11:53.635814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4857e-1baf-476c-86c6-f52a7ae86da6 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:53.636529 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4857e-1baf-476c-86c6-f52a7ae86da6 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:53.636529 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4857e-1baf-476c-86c6-f52a7ae86da6 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:53.637953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 147/297] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:53.643792 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3dcd1-490a-4203-8a89-3c1806843868 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:53.644102 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3dcd1-490a-4203-8a89-3c1806843868 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:53.644385 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3dcd1-490a-4203-8a89-3c1806843868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:53.677779 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-1fa3dcd1-490a-4203-8a89-3c1806843868 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:53.678967 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1fa3dcd1-490a-4203-8a89-3c1806843868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:53.699781 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126a431-5a25-4567-822f-b8a2d9d5a7dd None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:53.700116 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126a431-5a25-4567-822f-b8a2d9d5a7dd None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:53.700346 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126a431-5a25-4567-822f-b8a2d9d5a7dd None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:53.701812 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 148/298] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 13:11:53.710781 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f0e29-6e90-44e4-852b-ab7c6861b745 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:53.711047 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f0e29-6e90-44e4-852b-ab7c6861b745 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:53.711319 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f0e29-6e90-44e4-852b-ab7c6861b745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:53.746460 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-517f0e29-6e90-44e4-852b-ab7c6861b745 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:53.747868 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-517f0e29-6e90-44e4-852b-ab7c6861b745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:53.794627 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 151/299] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 25 13:11:53.838865 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 149/300] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:11:54.120854 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3dcd1-490a-4203-8a89-3c1806843868 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:54.191362 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:54.242359 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3dcd1-490a-4203-8a89-3c1806843868 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:54.278364 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a69c4-b0a3-4317-b50c-d82167e04d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:54.279001 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a69c4-b0a3-4317-b50c-d82167e04d69 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:54.279281 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a69c4-b0a3-4317-b50c-d82167e04d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:54.279552 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a69c4-b0a3-4317-b50c-d82167e04d69 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:54.293531 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a69c4-b0a3-4317-b50c-d82167e04d69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:11:54.299156 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-337a69c4-b0a3-4317-b50c-d82167e04d69 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 25 13:11:54.299156 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:11:54.299156 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:11:54.299156 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:11:54.299156 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:11:54.299156 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:11:54.299156 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:11:54.299156 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:11:54.299156 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:11:54.299156 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:11:54.299156 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:11:54.299156 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:11:54.299156 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:11:54.299156 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:11:54.299156 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:11:54.299156 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:11:54.300055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:11:54.300055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:11:54.300055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:11:54.300055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:11:54.300055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:11:54.300055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:11:54.300055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:11:54.300055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:11:54.300055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:11:54.300055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:11:54.300055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:11:54.300055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:11:54.300055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:11:54.300055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:11:54.300055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:11:54.300055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:11:54.300848 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:11:54.300848 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:11:54.300848 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:11:54.300848 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:11:54.300848 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:11:54.300848 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:11:54.300848 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:11:54.300848 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:11:54.300848 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:11:54.300848 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:11:54.300848 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 25 13:11:54.300848 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:11:54.300848 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 152/301] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 25 13:11:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:11:54.307313 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f0e29-6e90-44e4-852b-ab7c6861b745 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:54.348777 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a69c4-b0a3-4317-b50c-d82167e04d69 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:54.467766 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f0e29-6e90-44e4-852b-ab7c6861b745 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:54.500887 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:54.522323 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a69c4-b0a3-4317-b50c-d82167e04d69 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:54.552409 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:54.559758 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bae288-596b-44ab-9b18-3c6d529c82b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:54.560563 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bae288-596b-44ab-9b18-3c6d529c82b2 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:54.560912 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bae288-596b-44ab-9b18-3c6d529c82b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:54.561252 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bae288-596b-44ab-9b18-3c6d529c82b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:54.562034 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bae288-596b-44ab-9b18-3c6d529c82b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:54.562412 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bae288-596b-44ab-9b18-3c6d529c82b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:54.567925 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bae288-596b-44ab-9b18-3c6d529c82b2 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:54.574917 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7cdb36-67b5-4245-9a95-6e586af0dd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:54.575613 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cdb36-67b5-4245-9a95-6e586af0dd04 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:54.575908 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cdb36-67b5-4245-9a95-6e586af0dd04 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:54.576185 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cdb36-67b5-4245-9a95-6e586af0dd04 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:54.580203 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 150/302] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 25 13:11:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:54.585892 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bae288-596b-44ab-9b18-3c6d529c82b2 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:54.601911 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7cdb36-67b5-4245-9a95-6e586af0dd04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:11:54.608515 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-fb7cdb36-67b5-4245-9a95-6e586af0dd04 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 13:11:54.608515 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:11:54.608515 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:11:54.608515 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:11:54.608515 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:11:54.608515 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:11:54.608515 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:11:54.608515 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:11:54.608515 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:11:54.608515 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:11:54.608515 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:11:54.608515 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:11:54.608515 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:11:54.608515 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:11:54.608515 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:11:54.608515 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:11:54.610071 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:11:54.610071 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:11:54.610071 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:11:54.610071 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:11:54.610071 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:11:54.610071 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:11:54.610071 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:11:54.610071 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:11:54.610071 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:11:54.610071 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:11:54.610071 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:11:54.610071 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:11:54.610071 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:11:54.610071 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:11:54.610071 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:11:54.610071 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:11:54.610975 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:11:54.610975 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:11:54.610975 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:11:54.610975 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:11:54.610975 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:11:54.610975 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:11:54.610975 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:11:54.610975 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:11:54.610975 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:11:54.610975 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:11:54.610975 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 13:11:54.610975 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:11:54.611571 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 153/303] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 25 13:11:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:11:54.616987 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7cdb36-67b5-4245-9a95-6e586af0dd04 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:54.786250 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bae288-596b-44ab-9b18-3c6d529c82b2 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:54.817347 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7cdb36-67b5-4245-9a95-6e586af0dd04 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:54.835935 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43fe27e-4702-4ce5-90ac-c73f92280238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:54.836931 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fe27e-4702-4ce5-90ac-c73f92280238 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:54.837211 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fe27e-4702-4ce5-90ac-c73f92280238 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:54.837865 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fe27e-4702-4ce5-90ac-c73f92280238 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:54.854805 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a21fd-046e-4d9b-b78d-b0060d0c8450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:54.855417 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a21fd-046e-4d9b-b78d-b0060d0c8450 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:54.855698 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a21fd-046e-4d9b-b78d-b0060d0c8450 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:54.856004 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a21fd-046e-4d9b-b78d-b0060d0c8450 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:54.856667 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2a21fd-046e-4d9b-b78d-b0060d0c8450 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:54.856973 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2a21fd-046e-4d9b-b78d-b0060d0c8450 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:54.858354 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2a21fd-046e-4d9b-b78d-b0060d0c8450 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:54.868143 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 154/304] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 25 13:11:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:54.869364 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3e413-4710-4a44-822d-ac60da5ef83f None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:54.869649 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3e413-4710-4a44-822d-ac60da5ef83f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:54.869918 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3e413-4710-4a44-822d-ac60da5ef83f None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:54.871378 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 155/305] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:54.877248 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb9c04-ab74-43e7-8e17-a07cffc555aa None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:54.877569 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb9c04-ab74-43e7-8e17-a07cffc555aa None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:54.877824 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb9c04-ab74-43e7-8e17-a07cffc555aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:54.893341 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:54.904536 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-6eeb9c04-ab74-43e7-8e17-a07cffc555aa None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:54.906368 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6eeb9c04-ab74-43e7-8e17-a07cffc555aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:54.928622 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43fe27e-4702-4ce5-90ac-c73f92280238 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:54.930346 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43fe27e-4702-4ce5-90ac-c73f92280238 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:54.964441 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:54.996515 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 156/306] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:11:54.997437 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb9c04-ab74-43e7-8e17-a07cffc555aa None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:55.081822 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 151/307] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 25 13:11:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 25 13:11:55.087563 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43fe27e-4702-4ce5-90ac-c73f92280238 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:55.139828 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb9c04-ab74-43e7-8e17-a07cffc555aa None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:55.177578 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c3041-95c4-447e-b420-83df4a29add9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:55.178194 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c3041-95c4-447e-b420-83df4a29add9 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:55.178472 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c3041-95c4-447e-b420-83df4a29add9 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:55.178745 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c3041-95c4-447e-b420-83df4a29add9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:55.231841 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:55.256980 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c3041-95c4-447e-b420-83df4a29add9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:55.258709 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c3041-95c4-447e-b420-83df4a29add9 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:55.262717 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:55.302889 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43fe27e-4702-4ce5-90ac-c73f92280238 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:55.373875 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 157/308] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 25 13:11:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 25 13:11:55.374131 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae898a3a-4970-435f-aad4-ab2335b29f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:55.374535 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae898a3a-4970-435f-aad4-ab2335b29f8f None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:55.374814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae898a3a-4970-435f-aad4-ab2335b29f8f None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:55.375641 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae898a3a-4970-435f-aad4-ab2335b29f8f None admin] PATH_INFO: `/v3/projects/f1b2d2ce464841cdb520ee093e9fc8d5` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:55.377135 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae898a3a-4970-435f-aad4-ab2335b29f8f None admin] RBAC: Authorizing `identity:get_project(project_id=f1b2d2ce464841cdb520ee093e9fc8d5)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:55.378650 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae898a3a-4970-435f-aad4-ab2335b29f8f None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:55.380279 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c3041-95c4-447e-b420-83df4a29add9 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:55.380561 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 152/309] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 25 13:11:55 2022] GET /identity/v3/projects/f1b2d2ce464841cdb520ee093e9fc8d5 => generated 298 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:11:55.386033 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae898a3a-4970-435f-aad4-ab2335b29f8f None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:55.470086 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:55.510596 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c3041-95c4-447e-b420-83df4a29add9 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:55.519313 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae898a3a-4970-435f-aad4-ab2335b29f8f None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:55.559480 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0c826-e544-48e1-8b60-d30507c9d1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:55.560277 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0c826-e544-48e1-8b60-d30507c9d1be None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:55.560563 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0c826-e544-48e1-8b60-d30507c9d1be None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:55.560839 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0c826-e544-48e1-8b60-d30507c9d1be None admin] PATH_INFO: `/v3/projects/f1b2d2ce464841cdb520ee093e9fc8d5` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:55.562206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b0c826-e544-48e1-8b60-d30507c9d1be None admin] RBAC: Authorizing `identity:get_project(project_id=f1b2d2ce464841cdb520ee093e9fc8d5)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:55.563030 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dddd12-b65f-4ae1-a0e9-7be3ed98a29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:55.563739 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dddd12-b65f-4ae1-a0e9-7be3ed98a29e None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:55.563836 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b0c826-e544-48e1-8b60-d30507c9d1be None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:55.564059 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dddd12-b65f-4ae1-a0e9-7be3ed98a29e None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:55.564339 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dddd12-b65f-4ae1-a0e9-7be3ed98a29e None admin] PATH_INFO: `/v3/groups/23a70719192744bea823930ba165eab7` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:55.565708 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dddd12-b65f-4ae1-a0e9-7be3ed98a29e None admin] RBAC: Authorizing `identity:get_group(group_id=23a70719192744bea823930ba165eab7)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:55.565826 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 158/310] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 25 13:11:55 2022] GET /identity/v3/projects/f1b2d2ce464841cdb520ee093e9fc8d5 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:11:55.570313 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0c826-e544-48e1-8b60-d30507c9d1be None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:55.570441 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dddd12-b65f-4ae1-a0e9-7be3ed98a29e None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:55.570441 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 153/311] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Oct 25 13:11:55 2022] GET /identity/v3/groups/23a70719192744bea823930ba165eab7 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:11:55.573138 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5681f-423e-4ada-b6ec-763d288eba5a None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:55.574092 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5681f-423e-4ada-b6ec-763d288eba5a None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:55.574665 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5681f-423e-4ada-b6ec-763d288eba5a None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:55.576132 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 154/312] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:55.576975 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5681f-423e-4ada-b6ec-763d288eba5a None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:55.592708 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:55.698922 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5681f-423e-4ada-b6ec-763d288eba5a None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:55.705419 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0c826-e544-48e1-8b60-d30507c9d1be None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:55.742308 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c497dc1-128f-4375-bc80-24ba6b85ad94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:55.742939 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c497dc1-128f-4375-bc80-24ba6b85ad94 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:55.743218 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c497dc1-128f-4375-bc80-24ba6b85ad94 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:55.743491 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c497dc1-128f-4375-bc80-24ba6b85ad94 None admin] PATH_INFO: `/v3/groups/23a70719192744bea823930ba165eab7` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:55.744655 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c497dc1-128f-4375-bc80-24ba6b85ad94 None admin] RBAC: Authorizing `identity:get_group(group_id=23a70719192744bea823930ba165eab7)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:55.747065 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c497dc1-128f-4375-bc80-24ba6b85ad94 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:55.748197 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 155/313] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Oct 25 13:11:55 2022] GET /identity/v3/groups/23a70719192744bea823930ba165eab7 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:55.748560 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c497dc1-128f-4375-bc80-24ba6b85ad94 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:55.757966 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd75e8-9c70-47d8-95cb-46e984d71e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:55.758931 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd75e8-9c70-47d8-95cb-46e984d71e7d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:55.759292 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd75e8-9c70-47d8-95cb-46e984d71e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:55.759659 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd75e8-9c70-47d8-95cb-46e984d71e7d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:55.772313 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd75e8-9c70-47d8-95cb-46e984d71e7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:11:55.777322 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-44dd75e8-9c70-47d8-95cb-46e984d71e7d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 25 13:11:55.777322 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:11:55.777322 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:11:55.777322 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:11:55.777322 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:11:55.777322 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:11:55.777322 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:11:55.777322 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:11:55.777322 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:11:55.777322 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:11:55.777322 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:11:55.777322 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:11:55.777322 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:11:55.777322 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:11:55.777322 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:11:55.777322 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:11:55.778219 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:11:55.778219 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:11:55.778219 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:11:55.778219 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:11:55.778219 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:11:55.778219 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:11:55.778219 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:11:55.778219 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:11:55.778219 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:11:55.778219 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:11:55.778219 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:11:55.778219 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:11:55.778219 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:11:55.778219 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:11:55.778219 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:11:55.778219 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:11:55.778989 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:11:55.778989 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:11:55.778989 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:11:55.778989 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:11:55.778989 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:11:55.778989 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:11:55.778989 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:11:55.778989 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:11:55.778989 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:11:55.778989 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:11:55.778989 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 25 13:11:55.778989 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:11:55.778989 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 159/314] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 25 13:11:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:11:55.779662 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f2444-52db-4976-9a1a-fe65f9ac9ef5 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:55.780453 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f2444-52db-4976-9a1a-fe65f9ac9ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:55.780453 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f2444-52db-4976-9a1a-fe65f9ac9ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:55.790216 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:55.804013 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-2c6f2444-52db-4976-9a1a-fe65f9ac9ef5 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:55.805503 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2c6f2444-52db-4976-9a1a-fe65f9ac9ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:55.864839 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:55.895708 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c497dc1-128f-4375-bc80-24ba6b85ad94 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:55.901364 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 160/315] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:11:55.908783 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f2444-52db-4976-9a1a-fe65f9ac9ef5 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:55.935984 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981da7f2-33ec-4c05-a894-7c67792fd60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:55.936646 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981da7f2-33ec-4c05-a894-7c67792fd60f None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:55.936927 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981da7f2-33ec-4c05-a894-7c67792fd60f None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:55.937200 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981da7f2-33ec-4c05-a894-7c67792fd60f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:55.938874 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981da7f2-33ec-4c05-a894-7c67792fd60f None admin] RBAC: Adding query filter params (group.id=23a70719192744bea823930ba165eab7, role.id=9a3705eba27c47daad42ad874948996d, scope.project.id=f1b2d2ce464841cdb520ee093e9fc8d5) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:55.938874 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981da7f2-33ec-4c05-a894-7c67792fd60f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:55.940498 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981da7f2-33ec-4c05-a894-7c67792fd60f None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:55.947974 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 156/316] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Oct 25 13:11:55 2022] GET /identity/v3/role_assignments?group.id=23a70719192744bea823930ba165eab7&scope.project.id=f1b2d2ce464841cdb520ee093e9fc8d5&role.id=9a3705eba27c47daad42ad874948996d => generated 611 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:55.948836 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981da7f2-33ec-4c05-a894-7c67792fd60f None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:56.044946 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f2444-52db-4976-9a1a-fe65f9ac9ef5 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:56.091377 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981da7f2-33ec-4c05-a894-7c67792fd60f None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:56.099534 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76fa38-8be2-4ad1-9d7e-35565e976b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:56.101250 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76fa38-8be2-4ad1-9d7e-35565e976b83 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:56.101764 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76fa38-8be2-4ad1-9d7e-35565e976b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:56.102240 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76fa38-8be2-4ad1-9d7e-35565e976b83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:56.103682 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f76fa38-8be2-4ad1-9d7e-35565e976b83 None admin] RBAC: Adding query filter params (group.id=23a70719192744bea823930ba165eab7, role.id=955523e4392d4c278c29f6ce715a5ae6, scope.project.id=f1b2d2ce464841cdb520ee093e9fc8d5) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:56.104268 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f76fa38-8be2-4ad1-9d7e-35565e976b83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:56.106693 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f76fa38-8be2-4ad1-9d7e-35565e976b83 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:56.109686 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:56.115623 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 161/317] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Oct 25 13:11:55 2022] GET /identity/v3/role_assignments?group.id=23a70719192744bea823930ba165eab7&scope.project.id=f1b2d2ce464841cdb520ee093e9fc8d5&role.id=955523e4392d4c278c29f6ce715a5ae6 => generated 611 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:56.122483 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac9ba4-23d4-49d5-a38d-e40336cf8c43 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:56.123107 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac9ba4-23d4-49d5-a38d-e40336cf8c43 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:56.123607 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac9ba4-23d4-49d5-a38d-e40336cf8c43 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:56.125957 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 162/318] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:11:56 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:11:56.133522 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffe6fc-f73c-4c88-ba22-eac36cb310ea None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:56.133843 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffe6fc-f73c-4c88-ba22-eac36cb310ea None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:56.134079 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffe6fc-f73c-4c88-ba22-eac36cb310ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:56.151915 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625657f-6fcf-4af9-9b27-b8f91a39ff4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:56.153486 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625657f-6fcf-4af9-9b27-b8f91a39ff4b None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:56.153772 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625657f-6fcf-4af9-9b27-b8f91a39ff4b None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:56.154045 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625657f-6fcf-4af9-9b27-b8f91a39ff4b None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:56.154731 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b625657f-6fcf-4af9-9b27-b8f91a39ff4b None admin] RBAC: Adding query filter params (name=member) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:56.155031 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b625657f-6fcf-4af9-9b27-b8f91a39ff4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:56.157228 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b625657f-6fcf-4af9-9b27-b8f91a39ff4b None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:56.172970 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-5cffe6fc-f73c-4c88-ba22-eac36cb310ea None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:11:56.174154 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 157/319] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 25 13:11:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:56.176392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5cffe6fc-f73c-4c88-ba22-eac36cb310ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:11:56.180570 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625657f-6fcf-4af9-9b27-b8f91a39ff4b None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:56.184488 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:56.276790 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 163/320] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:11:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:11:56.277898 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cffe6fc-f73c-4c88-ba22-eac36cb310ea None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:56.338243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625657f-6fcf-4af9-9b27-b8f91a39ff4b None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:56.377643 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70faa8ca-f529-4aae-832c-f8e2364a2d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:56.378621 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70faa8ca-f529-4aae-832c-f8e2364a2d92 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:56.379049 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70faa8ca-f529-4aae-832c-f8e2364a2d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:56.379463 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70faa8ca-f529-4aae-832c-f8e2364a2d92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:56.413122 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cffe6fc-f73c-4c88-ba22-eac36cb310ea None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:56.442592 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:56.452322 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14d190-5e8d-485a-be48-97d4abd188df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:56.452940 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14d190-5e8d-485a-be48-97d4abd188df None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:56.454220 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14d190-5e8d-485a-be48-97d4abd188df None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:56.454737 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14d190-5e8d-485a-be48-97d4abd188df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:56.462092 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70faa8ca-f529-4aae-832c-f8e2364a2d92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:56.463582 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70faa8ca-f529-4aae-832c-f8e2364a2d92 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:56.465600 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:56.465717 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe14d190-5e8d-485a-be48-97d4abd188df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:11:56.471995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-fe14d190-5e8d-485a-be48-97d4abd188df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 13:11:56.471995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:11:56.471995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:11:56.471995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:11:56.471995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:11:56.471995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:11:56.471995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:11:56.471995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:11:56.471995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:11:56.471995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:11:56.471995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:11:56.471995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:11:56.471995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:11:56.471995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:11:56.471995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:11:56.471995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:11:56.472889 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:11:56.472889 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:11:56.472889 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:11:56.472889 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:11:56.472889 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:11:56.472889 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:11:56.472889 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:11:56.472889 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:11:56.472889 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:11:56.472889 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:11:56.472889 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:11:56.472889 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:11:56.472889 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:11:56.472889 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:11:56.472889 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:11:56.472889 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:11:56.473694 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:11:56.473694 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:11:56.473694 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:11:56.473694 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:11:56.473694 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:11:56.473694 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:11:56.473694 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:11:56.473694 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:11:56.473694 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:11:56.473694 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:11:56.473694 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 13:11:56.473694 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:11:56.473694 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 164/321] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 25 13:11:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:11:56.479096 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14d190-5e8d-485a-be48-97d4abd188df None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:56.590890 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 158/322] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 25 13:11:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 25 13:11:56.596337 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70faa8ca-f529-4aae-832c-f8e2364a2d92 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:56.609075 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14d190-5e8d-485a-be48-97d4abd188df None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:56.651247 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4c75a-45ac-46a6-86d3-f303973f9bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:56.651862 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4c75a-45ac-46a6-86d3-f303973f9bb5 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:56.652173 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4c75a-45ac-46a6-86d3-f303973f9bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:56.652442 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4c75a-45ac-46a6-86d3-f303973f9bb5 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:56.653087 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d4c75a-45ac-46a6-86d3-f303973f9bb5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:56.653390 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d4c75a-45ac-46a6-86d3-f303973f9bb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:56.654752 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d4c75a-45ac-46a6-86d3-f303973f9bb5 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:56.664798 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 165/323] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 25 13:11:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:11:56.665722 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4c75a-45ac-46a6-86d3-f303973f9bb5 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:56.723013 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:56.730573 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70faa8ca-f529-4aae-832c-f8e2364a2d92 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:56.734057 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:56.772539 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd51519-4937-49f8-92e6-d739bc93b641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:56.773180 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd51519-4937-49f8-92e6-d739bc93b641 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:56.773459 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd51519-4937-49f8-92e6-d739bc93b641 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:56.773729 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd51519-4937-49f8-92e6-d739bc93b641 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:56.787039 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4c75a-45ac-46a6-86d3-f303973f9bb5 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:56.788738 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd51519-4937-49f8-92e6-d739bc93b641 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:11:56.793902 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-dbd51519-4937-49f8-92e6-d739bc93b641 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 13:11:56.793902 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:11:56.793902 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:11:56.793902 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:11:56.793902 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:11:56.793902 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:11:56.793902 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:11:56.793902 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:11:56.793902 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:11:56.793902 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:11:56.793902 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:11:56.793902 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:11:56.793902 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:11:56.793902 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:11:56.793902 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:11:56.793902 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:11:56.794840 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:11:56.794840 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:11:56.794840 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:11:56.794840 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:11:56.794840 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:11:56.794840 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:11:56.794840 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:11:56.794840 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:11:56.794840 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:11:56.794840 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:11:56.794840 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:11:56.794840 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:11:56.794840 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:11:56.794840 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:11:56.794840 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:11:56.794840 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:11:56.795623 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:11:56.795623 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:11:56.795623 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:11:56.795623 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:11:56.795623 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:11:56.795623 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:11:56.795623 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:11:56.795623 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:11:56.795623 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:11:56.795623 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:11:56.795623 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 13:11:56.795623 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:11:56.795623 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 159/324] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 25 13:11:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:11:56.796308 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd51519-4937-49f8-92e6-d739bc93b641 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:56.830680 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5120e-9052-4bb4-9df9-5e955c37d412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:56.831547 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5120e-9052-4bb4-9df9-5e955c37d412 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:56.832031 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5120e-9052-4bb4-9df9-5e955c37d412 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:56.832446 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5120e-9052-4bb4-9df9-5e955c37d412 None admin] PATH_INFO: `/v3/projects/9345d01ad6914f64aaa073a1e6a86a02` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:56.833728 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5120e-9052-4bb4-9df9-5e955c37d412 None admin] RBAC: Authorizing `identity:get_project(project_id=9345d01ad6914f64aaa073a1e6a86a02)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:56.835302 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5120e-9052-4bb4-9df9-5e955c37d412 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:56.837350 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 166/325] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 25 13:11:56 2022] GET /identity/v3/projects/9345d01ad6914f64aaa073a1e6a86a02 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:56.838094 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5120e-9052-4bb4-9df9-5e955c37d412 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:56.909820 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd51519-4937-49f8-92e6-d739bc93b641 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:56.951514 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70150c87-8469-449e-aade-f8da8156ddfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:56.952148 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70150c87-8469-449e-aade-f8da8156ddfc None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:56.952424 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70150c87-8469-449e-aade-f8da8156ddfc None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:56.952694 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70150c87-8469-449e-aade-f8da8156ddfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:56.972657 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5120e-9052-4bb4-9df9-5e955c37d412 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:56.991379 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:56.991956 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:57.016358 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239e0b1-9ad4-46c1-b105-da48e639749f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:57.017080 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239e0b1-9ad4-46c1-b105-da48e639749f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:57.019955 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239e0b1-9ad4-46c1-b105-da48e639749f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:57.019955 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239e0b1-9ad4-46c1-b105-da48e639749f None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:57.019955 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c239e0b1-9ad4-46c1-b105-da48e639749f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:57.019955 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c239e0b1-9ad4-46c1-b105-da48e639749f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:57.019955 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c239e0b1-9ad4-46c1-b105-da48e639749f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:57.029375 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 167/326] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 25 13:11:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:57.032173 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239e0b1-9ad4-46c1-b105-da48e639749f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:57.039357 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70150c87-8469-449e-aade-f8da8156ddfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:57.040851 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70150c87-8469-449e-aade-f8da8156ddfc None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:57.136822 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239e0b1-9ad4-46c1-b105-da48e639749f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:57.145148 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 160/327] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 25 13:11:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 25 13:11:57.145987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70150c87-8469-449e-aade-f8da8156ddfc None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:57.172937 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa00895c-2ea7-43df-874c-d4a460626125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:57.173486 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00895c-2ea7-43df-874c-d4a460626125 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:57.173760 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00895c-2ea7-43df-874c-d4a460626125 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:57.174024 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00895c-2ea7-43df-874c-d4a460626125 None admin] PATH_INFO: `/v3/groups/23a70719192744bea823930ba165eab7` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:57.175114 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa00895c-2ea7-43df-874c-d4a460626125 None admin] RBAC: Authorizing `identity:get_group(group_id=23a70719192744bea823930ba165eab7)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:57.176595 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa00895c-2ea7-43df-874c-d4a460626125 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:57.178145 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 168/328] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Oct 25 13:11:57 2022] GET /identity/v3/groups/23a70719192744bea823930ba165eab7 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:57.178889 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa00895c-2ea7-43df-874c-d4a460626125 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:57.207877 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:57.229735 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:57.246341 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70150c87-8469-449e-aade-f8da8156ddfc None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:57.279432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23b26c-fa28-4ee3-936c-75e39c6ff176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:57.280069 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23b26c-fa28-4ee3-936c-75e39c6ff176 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:57.280348 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23b26c-fa28-4ee3-936c-75e39c6ff176 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:57.280619 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23b26c-fa28-4ee3-936c-75e39c6ff176 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:57.281462 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa00895c-2ea7-43df-874c-d4a460626125 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:57.315825 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0e877-2822-43fe-bfcb-4329e66c55ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:57.316466 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0e877-2822-43fe-bfcb-4329e66c55ec None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:57.316744 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0e877-2822-43fe-bfcb-4329e66c55ec None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:57.317087 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0e877-2822-43fe-bfcb-4329e66c55ec None admin] PATH_INFO: `/v3/projects/9835e5a39eb74917a1e872356cdbdeb5` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:57.318184 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0e877-2822-43fe-bfcb-4329e66c55ec None admin] RBAC: Authorizing `identity:get_project(project_id=9835e5a39eb74917a1e872356cdbdeb5)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:57.319612 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0e877-2822-43fe-bfcb-4329e66c55ec None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:57.321250 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 169/329] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 25 13:11:57 2022] GET /identity/v3/projects/9835e5a39eb74917a1e872356cdbdeb5 => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:57.322006 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0e877-2822-43fe-bfcb-4329e66c55ec None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:57.348279 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23b26c-fa28-4ee3-936c-75e39c6ff176 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:57.349736 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23b26c-fa28-4ee3-936c-75e39c6ff176 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:57.407907 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:57.419788 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0e877-2822-43fe-bfcb-4329e66c55ec None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:57.435643 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:57.449931 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 161/330] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 25 13:11:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 25 13:11:57.450756 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23b26c-fa28-4ee3-936c-75e39c6ff176 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:57.459748 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbd054-f2af-43e5-b692-9efc0d06ee23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:57.460383 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbd054-f2af-43e5-b692-9efc0d06ee23 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:57.460665 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbd054-f2af-43e5-b692-9efc0d06ee23 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:57.460938 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbd054-f2af-43e5-b692-9efc0d06ee23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:57.461657 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cbd054-f2af-43e5-b692-9efc0d06ee23 None admin] RBAC: Adding query filter params (group.id=23a70719192744bea823930ba165eab7, role.id=9a3705eba27c47daad42ad874948996d, scope.project.id=9345d01ad6914f64aaa073a1e6a86a02) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:57.461964 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cbd054-f2af-43e5-b692-9efc0d06ee23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:57.463406 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cbd054-f2af-43e5-b692-9efc0d06ee23 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:57.469254 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 170/331] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Oct 25 13:11:57 2022] GET /identity/v3/role_assignments?group.id=23a70719192744bea823930ba165eab7&scope.project.id=9345d01ad6914f64aaa073a1e6a86a02&role.id=9a3705eba27c47daad42ad874948996d => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:57.470027 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbd054-f2af-43e5-b692-9efc0d06ee23 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:57.566313 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23b26c-fa28-4ee3-936c-75e39c6ff176 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:57.592795 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbd054-f2af-43e5-b692-9efc0d06ee23 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:57.605797 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a0d6b-5755-4374-a8ff-09e7c9f905e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:57.606442 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a0d6b-5755-4374-a8ff-09e7c9f905e9 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:57.606723 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a0d6b-5755-4374-a8ff-09e7c9f905e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:57.606999 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a0d6b-5755-4374-a8ff-09e7c9f905e9 None admin] PATH_INFO: `/v3/groups/12682357ba2043869567b3a4d9087263` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:57.608236 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a0d6b-5755-4374-a8ff-09e7c9f905e9 None admin] RBAC: Authorizing `identity:get_group(group_id=12682357ba2043869567b3a4d9087263)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:57.609915 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a0d6b-5755-4374-a8ff-09e7c9f905e9 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:57.611580 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 162/332] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Oct 25 13:11:57 2022] GET /identity/v3/groups/12682357ba2043869567b3a4d9087263 => generated 229 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:57.617723 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a0d6b-5755-4374-a8ff-09e7c9f905e9 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:57.633714 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50dc9df-d7ae-4dfc-a8d5-c81fee524a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:57.634352 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50dc9df-d7ae-4dfc-a8d5-c81fee524a97 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:57.634628 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50dc9df-d7ae-4dfc-a8d5-c81fee524a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:57.634900 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50dc9df-d7ae-4dfc-a8d5-c81fee524a97 None admin] PATH_INFO: `/v3/projects/9345d01ad6914f64aaa073a1e6a86a02` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:57.636049 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50dc9df-d7ae-4dfc-a8d5-c81fee524a97 None admin] RBAC: Authorizing `identity:get_project(project_id=9345d01ad6914f64aaa073a1e6a86a02)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:57.637723 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50dc9df-d7ae-4dfc-a8d5-c81fee524a97 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:57.639943 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 171/333] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 25 13:11:57 2022] GET /identity/v3/projects/9345d01ad6914f64aaa073a1e6a86a02 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:11:57.645279 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50dc9df-d7ae-4dfc-a8d5-c81fee524a97 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:57.651554 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:57.707929 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:57.745611 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a0d6b-5755-4374-a8ff-09e7c9f905e9 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:57.769096 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50dc9df-d7ae-4dfc-a8d5-c81fee524a97 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:57.784465 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cdba62-3362-46ba-a1c0-10b99a2f972a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:57.785100 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdba62-3362-46ba-a1c0-10b99a2f972a None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:57.785383 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdba62-3362-46ba-a1c0-10b99a2f972a None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:57.785658 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdba62-3362-46ba-a1c0-10b99a2f972a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:57.786385 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cdba62-3362-46ba-a1c0-10b99a2f972a None admin] RBAC: Adding query filter params (group.id=12682357ba2043869567b3a4d9087263, role.id=4c7114fda3ec4652abed55516b5f4315, scope.project.id=9835e5a39eb74917a1e872356cdbdeb5) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:57.786691 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cdba62-3362-46ba-a1c0-10b99a2f972a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:57.788169 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cdba62-3362-46ba-a1c0-10b99a2f972a None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:57.795625 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 163/334] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Oct 25 13:11:57 2022] GET /identity/v3/role_assignments?group.id=12682357ba2043869567b3a4d9087263&scope.project.id=9835e5a39eb74917a1e872356cdbdeb5&role.id=4c7114fda3ec4652abed55516b5f4315 => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:11:57.811403 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb85510e-5fa5-44c9-8dde-e9ac5593a853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:57.812439 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85510e-5fa5-44c9-8dde-e9ac5593a853 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:57.813043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85510e-5fa5-44c9-8dde-e9ac5593a853 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:57.813591 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85510e-5fa5-44c9-8dde-e9ac5593a853 None admin] PATH_INFO: `/v3/groups/23a70719192744bea823930ba165eab7` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:57.814936 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb85510e-5fa5-44c9-8dde-e9ac5593a853 None admin] RBAC: Authorizing `identity:get_group(group_id=23a70719192744bea823930ba165eab7)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:57.816534 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb85510e-5fa5-44c9-8dde-e9ac5593a853 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:57.818476 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 172/335] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Oct 25 13:11:57 2022] GET /identity/v3/groups/23a70719192744bea823930ba165eab7 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:11:57.824537 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cdba62-3362-46ba-a1c0-10b99a2f972a None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:11:57.930949 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:11:57.938637 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cdba62-3362-46ba-a1c0-10b99a2f972a None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:11:57.974711 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac9f89-958a-493d-98a9-7796d7e03e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:11:57.975246 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac9f89-958a-493d-98a9-7796d7e03e7e None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:11:57.975523 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac9f89-958a-493d-98a9-7796d7e03e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:11:57.975797 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac9f89-958a-493d-98a9-7796d7e03e7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:11:57.976577 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac9f89-958a-493d-98a9-7796d7e03e7e None admin] RBAC: Adding query filter params (group.id=23a70719192744bea823930ba165eab7, role.id=955523e4392d4c278c29f6ce715a5ae6, scope.project.id=9345d01ad6914f64aaa073a1e6a86a02) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:11:57.976884 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac9f89-958a-493d-98a9-7796d7e03e7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:11:57.978314 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac9f89-958a-493d-98a9-7796d7e03e7e None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:11:57.985539 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 164/336] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Oct 25 13:11:57 2022] GET /identity/v3/role_assignments?group.id=23a70719192744bea823930ba165eab7&scope.project.id=9345d01ad6914f64aaa073a1e6a86a02&role.id=955523e4392d4c278c29f6ce715a5ae6 => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:00.732451 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f23c4-6bd3-4a4d-a382-c78fc8053be1 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:00.733336 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f23c4-6bd3-4a4d-a382-c78fc8053be1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:00.733831 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f23c4-6bd3-4a4d-a382-c78fc8053be1 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:00.735697 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 173/337] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:00.741163 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a7b9e-7e1d-4c55-88b8-681152fc5342 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:00.742053 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a7b9e-7e1d-4c55-88b8-681152fc5342 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:00.742536 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a7b9e-7e1d-4c55-88b8-681152fc5342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:00.768878 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-992a7b9e-7e1d-4c55-88b8-681152fc5342 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:00.770428 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-992a7b9e-7e1d-4c55-88b8-681152fc5342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:00.863171 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 165/338] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:12:00.950961 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d47d8-ffc8-4b18-ad47-c3b798cb5a1a None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:00.951616 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d47d8-ffc8-4b18-ad47-c3b798cb5a1a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:00.952129 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d47d8-ffc8-4b18-ad47-c3b798cb5a1a None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:00.954369 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 174/339] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:00.959759 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44494bc7-6b58-4429-8213-cc4dc186af98 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:00.960301 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44494bc7-6b58-4429-8213-cc4dc186af98 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:00.960792 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44494bc7-6b58-4429-8213-cc4dc186af98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:00.989046 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-44494bc7-6b58-4429-8213-cc4dc186af98 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:00.990569 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-44494bc7-6b58-4429-8213-cc4dc186af98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:01.080961 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 166/340] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:12:01.204983 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7275e36-544b-496d-ae8d-124b18f6479e None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:01.205787 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7275e36-544b-496d-ae8d-124b18f6479e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:01.206284 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7275e36-544b-496d-ae8d-124b18f6479e None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:01.208276 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 175/341] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:01.213681 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86057fff-3d04-44a4-9c2d-32bdff89be28 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:01.214206 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86057fff-3d04-44a4-9c2d-32bdff89be28 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:01.214694 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86057fff-3d04-44a4-9c2d-32bdff89be28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:01.229892 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7275e36-544b-496d-ae8d-124b18f6479e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:01.239321 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-86057fff-3d04-44a4-9c2d-32bdff89be28 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:01.240815 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-86057fff-3d04-44a4-9c2d-32bdff89be28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:01.262646 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:01.370931 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 167/342] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:12:01.411011 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7275e36-544b-496d-ae8d-124b18f6479e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:01.428899 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86057fff-3d04-44a4-9c2d-32bdff89be28 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:01.441544 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:01.475494 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc4350-f7d0-4226-b8ee-825fdf4ebdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:01.476766 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc4350-f7d0-4226-b8ee-825fdf4ebdb3 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:01.476766 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc4350-f7d0-4226-b8ee-825fdf4ebdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:01.476766 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc4350-f7d0-4226-b8ee-825fdf4ebdb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:01.492486 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc4350-f7d0-4226-b8ee-825fdf4ebdb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:01.493976 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc4350-f7d0-4226-b8ee-825fdf4ebdb3 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:01.509710 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-e2dc4350-f7d0-4226-b8ee-825fdf4ebdb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:01.509710 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:01.509710 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:01.509710 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:01.509710 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:01.509710 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:01.509710 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:01.509710 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:01.509710 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:01.509710 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:01.509710 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:01.509710 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:01.509710 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:12:01.509710 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:12:01.509710 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:12:01.509710 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:12:01.510737 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:01.510737 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:01.510737 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:01.510737 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:01.510737 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:01.510737 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:01.510737 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:01.510737 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:01.510737 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:01.510737 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:01.510737 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:01.510737 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:01.510737 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:01.510737 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:01.510737 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:01.510737 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:01.510737 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:12:01.511696 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:12:01.511696 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:01.511696 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:01.511696 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 176/343] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:01.512467 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df62182-0ada-448d-a42a-3e758ab79ca6 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:01.512624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df62182-0ada-448d-a42a-3e758ab79ca6 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:01.512885 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df62182-0ada-448d-a42a-3e758ab79ca6 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:01.514215 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 177/344] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:01.522207 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677ff70-d85b-44e8-8654-6e263bd13df1 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:01.522496 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677ff70-d85b-44e8-8654-6e263bd13df1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:01.522776 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677ff70-d85b-44e8-8654-6e263bd13df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:01.541079 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-5677ff70-d85b-44e8-8654-6e263bd13df1 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:01.542562 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5677ff70-d85b-44e8-8654-6e263bd13df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:01.553034 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86057fff-3d04-44a4-9c2d-32bdff89be28 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:01.590341 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e81e2d-9740-4afd-a4f2-7322fec4db49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:01.592004 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e81e2d-9740-4afd-a4f2-7322fec4db49 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:01.592529 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e81e2d-9740-4afd-a4f2-7322fec4db49 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:01.593155 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e81e2d-9740-4afd-a4f2-7322fec4db49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:01.604799 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e81e2d-9740-4afd-a4f2-7322fec4db49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:01.606758 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e81e2d-9740-4afd-a4f2-7322fec4db49 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:01.616660 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:01.619997 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 178/345] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:12:01.620986 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677ff70-d85b-44e8-8654-6e263bd13df1 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:01.626772 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-d3e81e2d-9740-4afd-a4f2-7322fec4db49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:01.626772 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:01.626772 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:01.626772 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:01.626772 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:01.626772 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:01.626772 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:01.626772 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:01.626772 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:01.626772 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:01.626772 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:01.626772 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:01.626772 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:12:01.626772 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:12:01.626772 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:12:01.626772 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:12:01.627672 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:01.627672 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:01.627672 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:01.627672 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:01.627672 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:01.627672 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:01.627672 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:01.627672 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:01.627672 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:01.627672 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:01.627672 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:01.627672 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:01.627672 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:01.627672 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:01.627672 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:01.627672 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:01.627672 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:12:01.628576 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:12:01.628576 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:01.628576 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:01.630664 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 168/346] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 13:12:01.641435 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e81e2d-9740-4afd-a4f2-7322fec4db49 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:01.735355 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:01.739747 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677ff70-d85b-44e8-8654-6e263bd13df1 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:01.776610 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a8a3a-024f-4115-9b55-77d372e98ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:01.777139 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a8a3a-024f-4115-9b55-77d372e98ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:01.777428 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a8a3a-024f-4115-9b55-77d372e98ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:01.777705 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a8a3a-024f-4115-9b55-77d372e98ea7 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:01.778348 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a8a3a-024f-4115-9b55-77d372e98ea7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:01.778654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a8a3a-024f-4115-9b55-77d372e98ea7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:01.780062 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a8a3a-024f-4115-9b55-77d372e98ea7 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:01.786695 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e81e2d-9740-4afd-a4f2-7322fec4db49 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:01.797569 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 179/347] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:01.797569 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a8a3a-024f-4115-9b55-77d372e98ea7 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:01.835874 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15011f2a-1131-4779-b1ce-bf3658ba8511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:01.836507 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15011f2a-1131-4779-b1ce-bf3658ba8511 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:01.836790 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15011f2a-1131-4779-b1ce-bf3658ba8511 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:01.837067 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15011f2a-1131-4779-b1ce-bf3658ba8511 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:01.837982 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15011f2a-1131-4779-b1ce-bf3658ba8511 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:01.838290 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15011f2a-1131-4779-b1ce-bf3658ba8511 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:01.840648 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15011f2a-1131-4779-b1ce-bf3658ba8511 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:01.867001 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 169/348] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:01.868258 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15011f2a-1131-4779-b1ce-bf3658ba8511 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:01.916849 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a8a3a-024f-4115-9b55-77d372e98ea7 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:01.938836 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:01.954869 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34142e93-c935-49d2-9552-b833ca4d1089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:01.955499 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34142e93-c935-49d2-9552-b833ca4d1089 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:01.955776 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34142e93-c935-49d2-9552-b833ca4d1089 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:01.956099 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34142e93-c935-49d2-9552-b833ca4d1089 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:01.966945 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34142e93-c935-49d2-9552-b833ca4d1089 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:01.968423 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34142e93-c935-49d2-9552-b833ca4d1089 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:01.983346 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-34142e93-c935-49d2-9552-b833ca4d1089 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:01.983346 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:01.983346 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:01.983346 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:01.983346 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:01.983346 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:01.983346 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:01.983346 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:01.983346 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:01.983346 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:01.983346 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:01.983346 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:01.983346 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:12:01.983346 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:12:01.983346 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:12:01.983346 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:12:01.985018 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:01.985018 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:01.985018 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:01.985018 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:01.985018 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:01.985018 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:01.985018 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:01.985018 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:01.985018 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:01.985018 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:01.985018 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:01.985018 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:01.985018 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:01.985018 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:01.985018 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:01.985018 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:01.985018 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:12:01.985886 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:12:01.985886 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:01.985886 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:01.986048 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15011f2a-1131-4779-b1ce-bf3658ba8511 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:01.986129 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 180/349] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:01.986129 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34142e93-c935-49d2-9552-b833ca4d1089 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:01.998016 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:02.023784 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260ece9-2e03-4f1c-be11-a8b290e3915a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:02.024426 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260ece9-2e03-4f1c-be11-a8b290e3915a None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:02.024705 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260ece9-2e03-4f1c-be11-a8b290e3915a None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:02.024975 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260ece9-2e03-4f1c-be11-a8b290e3915a None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:02.025607 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260ece9-2e03-4f1c-be11-a8b290e3915a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:02.027082 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260ece9-2e03-4f1c-be11-a8b290e3915a None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:02.052255 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 170/350] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 25 13:12:01 2022] POST /identity/v3/users => generated 246 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:12:02.053263 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260ece9-2e03-4f1c-be11-a8b290e3915a None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:02.118527 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34142e93-c935-49d2-9552-b833ca4d1089 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:02.171000 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae32093-1516-48be-9dc4-4029d6c1832b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:02.172411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae32093-1516-48be-9dc4-4029d6c1832b None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:02.173197 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae32093-1516-48be-9dc4-4029d6c1832b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:02.174243 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae32093-1516-48be-9dc4-4029d6c1832b None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:02.175495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae32093-1516-48be-9dc4-4029d6c1832b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:02.177995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae32093-1516-48be-9dc4-4029d6c1832b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:02.183447 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260ece9-2e03-4f1c-be11-a8b290e3915a None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:02.204854 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:02.212855 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 181/351] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 25 13:12:01 2022] POST /identity/v3/users => generated 248 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:12:02.214225 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae32093-1516-48be-9dc4-4029d6c1832b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:02.229170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57ef28-bcd5-427a-86af-3b3376b53197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:02.229842 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57ef28-bcd5-427a-86af-3b3376b53197 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:02.230120 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57ef28-bcd5-427a-86af-3b3376b53197 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:02.230389 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57ef28-bcd5-427a-86af-3b3376b53197 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:02.243408 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d57ef28-bcd5-427a-86af-3b3376b53197 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:02.245040 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d57ef28-bcd5-427a-86af-3b3376b53197 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:02.261560 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-8d57ef28-bcd5-427a-86af-3b3376b53197 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:02.261560 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:02.261560 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:02.261560 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:02.261560 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:02.261560 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:02.261560 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:02.261560 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:02.261560 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:02.261560 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:02.261560 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:02.261560 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:02.261560 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:12:02.261560 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:12:02.261560 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:12:02.261560 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:12:02.262594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:02.262594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:02.262594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:02.262594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:02.262594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:02.262594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:02.262594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:02.262594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:02.262594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:02.262594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:02.262594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:02.262594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:02.262594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:02.262594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:02.262594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:02.262594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:02.262594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:12:02.263460 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:12:02.263460 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:02.263460 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:02.263460 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 171/352] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:02.269728 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57ef28-bcd5-427a-86af-3b3376b53197 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:02.315434 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:02.359080 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae32093-1516-48be-9dc4-4029d6c1832b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:02.399647 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c94ee-24f2-4c15-9aad-7e57ffbe9322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:02.400338 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c94ee-24f2-4c15-9aad-7e57ffbe9322 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:02.400648 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c94ee-24f2-4c15-9aad-7e57ffbe9322 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:02.400914 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c94ee-24f2-4c15-9aad-7e57ffbe9322 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:02.401542 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c94ee-24f2-4c15-9aad-7e57ffbe9322 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:02.401844 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c94ee-24f2-4c15-9aad-7e57ffbe9322 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:02.403305 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c94ee-24f2-4c15-9aad-7e57ffbe9322 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:02.409668 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57ef28-bcd5-427a-86af-3b3376b53197 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:02.417847 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 182/353] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:02.423749 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c94ee-24f2-4c15-9aad-7e57ffbe9322 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:02.450441 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890242bb-d10d-4486-be59-f53acbd06583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:02.451496 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890242bb-d10d-4486-be59-f53acbd06583 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:02.452004 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890242bb-d10d-4486-be59-f53acbd06583 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:02.452493 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890242bb-d10d-4486-be59-f53acbd06583 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:02.453896 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890242bb-d10d-4486-be59-f53acbd06583 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:02.454422 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890242bb-d10d-4486-be59-f53acbd06583 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:02.456088 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890242bb-d10d-4486-be59-f53acbd06583 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:02.470855 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 172/354] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:02.476873 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890242bb-d10d-4486-be59-f53acbd06583 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:02.508660 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:02.556188 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c94ee-24f2-4c15-9aad-7e57ffbe9322 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:02.589243 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:02.594592 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890242bb-d10d-4486-be59-f53acbd06583 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:02.603645 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c418eb0-3abf-44db-a8b9-13fe1e8f0504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:02.604315 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c418eb0-3abf-44db-a8b9-13fe1e8f0504 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:02.604597 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c418eb0-3abf-44db-a8b9-13fe1e8f0504 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:02.604875 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c418eb0-3abf-44db-a8b9-13fe1e8f0504 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:02.607298 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c418eb0-3abf-44db-a8b9-13fe1e8f0504 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:02.608800 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c418eb0-3abf-44db-a8b9-13fe1e8f0504 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:02.642689 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 183/355] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 25 13:12:02 2022] POST /identity/v3/users => generated 248 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:12:02.651606 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04f906-fdec-4061-b7b5-e8a9e7b7c41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:02.652626 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04f906-fdec-4061-b7b5-e8a9e7b7c41a None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:02.653087 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04f906-fdec-4061-b7b5-e8a9e7b7c41a None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:02.653544 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04f906-fdec-4061-b7b5-e8a9e7b7c41a None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:02.654368 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce04f906-fdec-4061-b7b5-e8a9e7b7c41a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:02.655999 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce04f906-fdec-4061-b7b5-e8a9e7b7c41a None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:02.697882 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 173/356] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 25 13:12:02 2022] POST /identity/v3/users => generated 249 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:12:02.724179 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9552e-3117-4ed0-b963-fe087aa977c9 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:02.724482 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9552e-3117-4ed0-b963-fe087aa977c9 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:02.724767 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9552e-3117-4ed0-b963-fe087aa977c9 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:02.726593 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 184/357] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:02 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:02.732492 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113c1f9-90a5-49f0-8456-c54717e09ee0 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:02.732988 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113c1f9-90a5-49f0-8456-c54717e09ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:02.733399 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113c1f9-90a5-49f0-8456-c54717e09ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:02.769171 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-0113c1f9-90a5-49f0-8456-c54717e09ee0 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:02.770702 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-0113c1f9-90a5-49f0-8456-c54717e09ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:02.874644 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 174/358] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:12:03.168811 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9552e-3117-4ed0-b963-fe087aa977c9 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:03.277691 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9552e-3117-4ed0-b963-fe087aa977c9 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:03.314376 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7f947-9e7e-470f-8ab3-d6529c93255e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:03.315032 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7f947-9e7e-470f-8ab3-d6529c93255e None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:03.315318 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7f947-9e7e-470f-8ab3-d6529c93255e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:03.315676 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7f947-9e7e-470f-8ab3-d6529c93255e None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:03.316448 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a7f947-9e7e-470f-8ab3-d6529c93255e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:03.317835 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a7f947-9e7e-470f-8ab3-d6529c93255e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:03.328082 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.sql.core [None req-50a7f947-9e7e-470f-8ab3-d6529c93255e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 25 13:12:03.328082 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 25 13:12:03.328082 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [parameters: {'id': 'c2e2d12192474e379cbb1b5bf8c1a6ec', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 25 13:12:03.328082 dv-cinder-862432-2-smb devstack@keystone.service[81362]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81362) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 25 13:12:03.335603 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-50a7f947-9e7e-470f-8ab3-d6529c93255e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 25 13:12:03.335603 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:03.335603 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 25 13:12:03.335603 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 25 13:12:03.335603 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 25 13:12:03.335603 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 25 13:12:03.335603 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 25 13:12:03.335603 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application result = self._query(query) Oct 25 13:12:03.335603 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 25 13:12:03.335603 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application conn.query(q) Oct 25 13:12:03.335603 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 25 13:12:03.335603 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 25 13:12:03.335603 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 25 13:12:03.335603 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application result.read() Oct 25 13:12:03.335603 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 25 13:12:03.336632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 25 13:12:03.336632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 25 13:12:03.336632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 25 13:12:03.336632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 25 13:12:03.336632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 25 13:12:03.336632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 25 13:12:03.336632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 25 13:12:03.336632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 25 13:12:03.336632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:03.336632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 25 13:12:03.336632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:03.336632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:03.336632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 25 13:12:03.336632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 25 13:12:03.336632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 25 13:12:03.336632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return ref.to_dict() Oct 25 13:12:03.336632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 25 13:12:03.336632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application next(self.gen) Oct 25 13:12:03.337727 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 25 13:12:03.337727 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application yield resource Oct 25 13:12:03.337727 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 25 13:12:03.337727 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application next(self.gen) Oct 25 13:12:03.337727 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 25 13:12:03.337727 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self.session.rollback() Oct 25 13:12:03.337727 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 13:12:03.337727 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self.force_reraise() Oct 25 13:12:03.337727 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 13:12:03.337727 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise self.value Oct 25 13:12:03.337727 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 25 13:12:03.337727 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 25 13:12:03.337727 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 25 13:12:03.337727 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application session.commit() Oct 25 13:12:03.337727 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 25 13:12:03.337727 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 25 13:12:03.337727 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 25 13:12:03.338814 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._prepare_impl() Oct 25 13:12:03.338814 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 25 13:12:03.338814 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self.session.flush() Oct 25 13:12:03.338814 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 25 13:12:03.338814 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._flush(objects) Oct 25 13:12:03.338814 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 25 13:12:03.338814 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 25 13:12:03.338814 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 25 13:12:03.338814 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application compat.raise_( Oct 25 13:12:03.338814 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 25 13:12:03.338814 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception Oct 25 13:12:03.338814 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 25 13:12:03.338814 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application flush_context.execute() Oct 25 13:12:03.338814 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 25 13:12:03.338814 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rec.execute(self) Oct 25 13:12:03.338814 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 25 13:12:03.338814 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 25 13:12:03.339704 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 25 13:12:03.339704 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 25 13:12:03.339704 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 25 13:12:03.339704 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 25 13:12:03.339704 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 25 13:12:03.339704 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 25 13:12:03.339704 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 25 13:12:03.339704 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 25 13:12:03.339704 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 25 13:12:03.339704 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 25 13:12:03.339704 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 25 13:12:03.339704 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 25 13:12:03.339704 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 25 13:12:03.339704 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 25 13:12:03.339704 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 25 13:12:03.339704 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception Oct 25 13:12:03.340550 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 25 13:12:03.340550 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 25 13:12:03.340550 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 25 13:12:03.340550 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 25 13:12:03.340550 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 25 13:12:03.340550 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application result = self._query(query) Oct 25 13:12:03.340550 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 25 13:12:03.340550 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application conn.query(q) Oct 25 13:12:03.340550 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 25 13:12:03.340550 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 25 13:12:03.340550 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 25 13:12:03.340550 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application result.read() Oct 25 13:12:03.340550 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 25 13:12:03.340550 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 25 13:12:03.340550 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 25 13:12:03.340550 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 25 13:12:03.341392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 25 13:12:03.341392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 25 13:12:03.341392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 25 13:12:03.341392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 25 13:12:03.341392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 25 13:12:03.341392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 25 13:12:03.341392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [parameters: {'id': 'c2e2d12192474e379cbb1b5bf8c1a6ec', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 25 13:12:03.341392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 25 13:12:03.341392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:03.341392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 13:12:03.341392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:03.341392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:03.341392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:03.341392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:03.341392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:03.341392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:03.342453 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:03.342453 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:03.342453 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:03.342453 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:03.342453 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:03.342453 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:03.342453 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 25 13:12:03.342453 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 25 13:12:03.342453 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:03.342453 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:03.342453 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 25 13:12:03.342453 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 25 13:12:03.342453 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 25 13:12:03.342453 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 25 13:12:03.342453 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 25 13:12:03.342453 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:03.343305 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 185/359] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Oct 25 13:12:03 2022] POST /identity/v3/roles => generated 144 bytes in 169 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:03.343373 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113c1f9-90a5-49f0-8456-c54717e09ee0 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:03.359708 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:03.459577 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113c1f9-90a5-49f0-8456-c54717e09ee0 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:03.504458 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489a4ec-46bd-4597-85b3-6c134d221201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:03.505103 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489a4ec-46bd-4597-85b3-6c134d221201 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:03.505380 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489a4ec-46bd-4597-85b3-6c134d221201 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:03.505651 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489a4ec-46bd-4597-85b3-6c134d221201 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:03.523360 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489a4ec-46bd-4597-85b3-6c134d221201 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:12:03.528456 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-b489a4ec-46bd-4597-85b3-6c134d221201 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 13:12:03.528456 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:03.528456 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:03.528456 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:03.528456 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:03.528456 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:03.528456 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:03.528456 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:03.528456 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:03.528456 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:03.528456 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:03.528456 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:03.528456 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:12:03.528456 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:12:03.528456 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:12:03.528456 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:12:03.529549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:12:03.529549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:12:03.529549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:12:03.529549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:12:03.529549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:03.529549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:03.529549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:03.529549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:03.529549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:03.529549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:03.529549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:03.529549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:03.529549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:03.529549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:03.529549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:03.529549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:03.530509 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:03.530509 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:03.530509 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:03.530509 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:03.530509 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:12:03.530509 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:12:03.530509 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:12:03.530509 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:12:03.530509 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:12:03.530509 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:12:03.530509 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 25 13:12:03.530509 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:03.530509 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 175/360] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 25 13:12:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:03.537447 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7f947-9e7e-470f-8ab3-d6529c93255e None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:03.599270 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:03.655878 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7f947-9e7e-470f-8ab3-d6529c93255e None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:03.693308 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90360ae-6d10-493f-a6e5-a1b51759ba3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:03.694068 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90360ae-6d10-493f-a6e5-a1b51759ba3c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:03.694448 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90360ae-6d10-493f-a6e5-a1b51759ba3c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:03.694820 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90360ae-6d10-493f-a6e5-a1b51759ba3c None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:03.695609 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90360ae-6d10-493f-a6e5-a1b51759ba3c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:03.696057 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90360ae-6d10-493f-a6e5-a1b51759ba3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:03.697526 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90360ae-6d10-493f-a6e5-a1b51759ba3c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:03.706859 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 186/361] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 25 13:12:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:05.005179 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc9b7c-c058-4c72-bae7-a9940aab4a11 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:05.005788 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc9b7c-c058-4c72-bae7-a9940aab4a11 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:05.005788 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc9b7c-c058-4c72-bae7-a9940aab4a11 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:05.007174 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 176/362] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:05.012535 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa118dcb-a4b1-4895-acc4-e63a87f4020e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:05.013011 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa118dcb-a4b1-4895-acc4-e63a87f4020e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:05.013187 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa118dcb-a4b1-4895-acc4-e63a87f4020e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:05.036852 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-aa118dcb-a4b1-4895-acc4-e63a87f4020e None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:05.038042 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-aa118dcb-a4b1-4895-acc4-e63a87f4020e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:05.050405 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567e9ce-2f20-4420-9340-55a66729655c None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:05.050687 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567e9ce-2f20-4420-9340-55a66729655c None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:05.050965 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567e9ce-2f20-4420-9340-55a66729655c None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:05.053184 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 177/363] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:05.061032 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53615fc-8579-49cc-8f24-d287f3b220f2 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:05.061032 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53615fc-8579-49cc-8f24-d287f3b220f2 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:05.061032 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53615fc-8579-49cc-8f24-d287f3b220f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:05.085195 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-c53615fc-8579-49cc-8f24-d287f3b220f2 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:05.086380 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c53615fc-8579-49cc-8f24-d287f3b220f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:05.169709 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 187/364] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:12:05.196155 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 178/365] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:12:05.462740 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa118dcb-a4b1-4895-acc4-e63a87f4020e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:05.513694 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:05.517658 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794b00b-8feb-4c3f-85b3-e00a4e01db3f None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:05.517945 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794b00b-8feb-4c3f-85b3-e00a4e01db3f None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:05.518222 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794b00b-8feb-4c3f-85b3-e00a4e01db3f None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:05.519888 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 179/366] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:05.526198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551df77-c6b0-41c5-8070-fc0448170f3d None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:05.526481 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551df77-c6b0-41c5-8070-fc0448170f3d None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:05.526759 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551df77-c6b0-41c5-8070-fc0448170f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:05.535650 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:05.552058 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-1551df77-c6b0-41c5-8070-fc0448170f3d None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:05.553526 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-1551df77-c6b0-41c5-8070-fc0448170f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:05.604620 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa118dcb-a4b1-4895-acc4-e63a87f4020e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:05.633876 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 180/367] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 25 13:12:05.634720 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551df77-c6b0-41c5-8070-fc0448170f3d None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:05.650029 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1401b8e-fd21-4a73-a99e-13be250b7381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:05.651192 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1401b8e-fd21-4a73-a99e-13be250b7381 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:05.651852 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1401b8e-fd21-4a73-a99e-13be250b7381 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:05.652338 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1401b8e-fd21-4a73-a99e-13be250b7381 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:05.668744 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1401b8e-fd21-4a73-a99e-13be250b7381 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:12:05.674028 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-e1401b8e-fd21-4a73-a99e-13be250b7381 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 13:12:05.674028 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:05.674028 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:05.674028 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:05.674028 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:05.674028 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:05.674028 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:05.674028 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:05.674028 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:05.674028 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:05.674028 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:05.674028 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:05.674028 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:12:05.674028 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:12:05.674028 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:12:05.674028 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:12:05.674906 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:12:05.674906 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:12:05.674906 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:12:05.674906 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:12:05.674906 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:05.674906 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:05.674906 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:05.674906 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:05.674906 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:05.674906 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:05.674906 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:05.674906 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:05.674906 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:05.674906 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:05.674906 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:05.674906 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:05.675705 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:05.675705 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:05.675705 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:05.675705 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:05.675705 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:12:05.675705 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:12:05.675705 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:12:05.675705 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:12:05.675705 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:12:05.675705 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:12:05.675705 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 25 13:12:05.675705 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:05.675705 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 188/368] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 25 13:12:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:05.677459 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd5784-7de1-4112-8d01-143ba13150c3 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:05.677843 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd5784-7de1-4112-8d01-143ba13150c3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:05.678213 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd5784-7de1-4112-8d01-143ba13150c3 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:05.679824 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 189/369] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:05.684759 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ad2ee-557b-44ce-b9fa-0bb14877b364 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:05.685177 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ad2ee-557b-44ce-b9fa-0bb14877b364 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:05.685548 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ad2ee-557b-44ce-b9fa-0bb14877b364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:05.707341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-9e5ad2ee-557b-44ce-b9fa-0bb14877b364 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:05.708966 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9e5ad2ee-557b-44ce-b9fa-0bb14877b364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:05.779222 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551df77-c6b0-41c5-8070-fc0448170f3d None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:05.789105 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 190/370] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 25 13:12:05.790006 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ad2ee-557b-44ce-b9fa-0bb14877b364 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:05.832250 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647e8bc-f2a4-4f9e-b4d9-72620eb87a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:05.834062 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647e8bc-f2a4-4f9e-b4d9-72620eb87a00 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:05.834487 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647e8bc-f2a4-4f9e-b4d9-72620eb87a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:05.835805 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647e8bc-f2a4-4f9e-b4d9-72620eb87a00 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:05.840185 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:05.848722 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:05.852341 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d647e8bc-f2a4-4f9e-b4d9-72620eb87a00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:12:05.857544 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-d647e8bc-f2a4-4f9e-b4d9-72620eb87a00 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 13:12:05.857544 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:05.857544 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:05.857544 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:05.857544 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:05.857544 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:05.857544 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:05.857544 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:05.857544 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:05.857544 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:05.857544 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:05.857544 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:05.857544 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:12:05.857544 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:12:05.857544 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:12:05.857544 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:12:05.858678 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:12:05.858678 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:12:05.858678 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:12:05.858678 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:12:05.858678 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:05.858678 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:05.858678 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:05.858678 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:05.858678 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:05.858678 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:05.858678 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:05.858678 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:05.858678 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:05.858678 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:05.858678 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:05.858678 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:05.859696 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:05.859696 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:05.859696 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:05.859696 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:05.859696 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:12:05.859696 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:12:05.859696 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:12:05.859696 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:12:05.859696 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:12:05.859696 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:12:05.859696 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 25 13:12:05.859696 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:05.859696 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 181/371] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 25 13:12:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:05.867942 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647e8bc-f2a4-4f9e-b4d9-72620eb87a00 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:05.957165 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ad2ee-557b-44ce-b9fa-0bb14877b364 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:05.999862 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d890aa0-6552-4292-9e1a-aed20d327bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:06.000859 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d890aa0-6552-4292-9e1a-aed20d327bd2 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:06.001145 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d890aa0-6552-4292-9e1a-aed20d327bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:06.001424 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d890aa0-6552-4292-9e1a-aed20d327bd2 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:06.002386 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d890aa0-6552-4292-9e1a-aed20d327bd2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:06.002694 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d890aa0-6552-4292-9e1a-aed20d327bd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:06.004636 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d890aa0-6552-4292-9e1a-aed20d327bd2 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:06.012991 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647e8bc-f2a4-4f9e-b4d9-72620eb87a00 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:06.015222 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 191/372] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 25 13:12:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:06.017486 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d890aa0-6552-4292-9e1a-aed20d327bd2 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:06.058008 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de947b86-8947-4e54-91b8-a12eeced1960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:06.059519 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de947b86-8947-4e54-91b8-a12eeced1960 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:06.059812 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de947b86-8947-4e54-91b8-a12eeced1960 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:06.060117 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de947b86-8947-4e54-91b8-a12eeced1960 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:06.060790 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de947b86-8947-4e54-91b8-a12eeced1960 None admin] RBAC: Adding query filter params (name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:06.061093 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de947b86-8947-4e54-91b8-a12eeced1960 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:06.062532 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de947b86-8947-4e54-91b8-a12eeced1960 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:06.074092 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 182/373] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 25 13:12:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:06.076765 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de947b86-8947-4e54-91b8-a12eeced1960 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:06.123602 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:06.136375 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d890aa0-6552-4292-9e1a-aed20d327bd2 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:06.142349 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:06.172934 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f9bb7-c48d-49c7-82f4-770e318ba735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:06.173563 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f9bb7-c48d-49c7-82f4-770e318ba735 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:06.173921 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f9bb7-c48d-49c7-82f4-770e318ba735 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:06.174115 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f9bb7-c48d-49c7-82f4-770e318ba735 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:06.185296 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f9bb7-c48d-49c7-82f4-770e318ba735 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:12:06.189838 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de947b86-8947-4e54-91b8-a12eeced1960 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:06.192786 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-834f9bb7-c48d-49c7-82f4-770e318ba735 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 13:12:06.192786 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:06.192786 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:06.192786 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:06.192786 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:06.192786 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:06.192786 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:06.192786 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:06.192786 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:06.192786 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:06.192786 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:06.192786 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:06.192786 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:12:06.192786 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:12:06.192786 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:12:06.192786 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:12:06.193890 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:12:06.193890 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:12:06.193890 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:12:06.193890 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:12:06.193890 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:06.193890 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:06.193890 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:06.193890 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:06.193890 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:06.193890 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:06.193890 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:06.193890 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:06.193890 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:06.193890 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:06.193890 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:06.193890 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:06.196981 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:06.196981 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:06.196981 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:06.196981 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:06.196981 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:12:06.196981 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:12:06.196981 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:12:06.196981 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:12:06.196981 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:12:06.196981 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:12:06.196981 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 25 13:12:06.196981 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:06.196981 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 192/374] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 25 13:12:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:06.196981 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f9bb7-c48d-49c7-82f4-770e318ba735 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:06.230200 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf9d3e-7650-4b46-9e2a-45bf3e2be8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:06.230824 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf9d3e-7650-4b46-9e2a-45bf3e2be8d4 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:06.231100 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf9d3e-7650-4b46-9e2a-45bf3e2be8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:06.231378 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf9d3e-7650-4b46-9e2a-45bf3e2be8d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:06.242763 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcf9d3e-7650-4b46-9e2a-45bf3e2be8d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:06.244287 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcf9d3e-7650-4b46-9e2a-45bf3e2be8d4 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:06.259706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-3dcf9d3e-7650-4b46-9e2a-45bf3e2be8d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:06.259706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:06.259706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:06.259706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:06.259706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:06.259706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:06.259706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:06.259706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:06.259706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:06.259706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:06.259706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:06.259706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:06.259706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:12:06.259706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:12:06.259706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:12:06.259706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:12:06.260784 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:06.260784 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:06.260784 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:06.260784 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:06.260784 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:06.260784 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:06.260784 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:06.260784 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:06.260784 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:06.260784 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:06.260784 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:06.260784 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:06.260784 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:06.260784 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:06.260784 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:06.260784 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:06.260784 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:12:06.261629 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:12:06.261629 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:06.261629 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:06.261629 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 183/375] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:06.262000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf9d3e-7650-4b46-9e2a-45bf3e2be8d4 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:06.312185 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f9bb7-c48d-49c7-82f4-770e318ba735 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:06.349354 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202dfb7-c06e-4987-991c-d789be05dc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:06.349971 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202dfb7-c06e-4987-991c-d789be05dc48 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:06.350245 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202dfb7-c06e-4987-991c-d789be05dc48 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:06.350522 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202dfb7-c06e-4987-991c-d789be05dc48 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:06.360902 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0202dfb7-c06e-4987-991c-d789be05dc48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:12:06.366051 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-0202dfb7-c06e-4987-991c-d789be05dc48 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 13:12:06.366051 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:06.366051 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:06.366051 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:06.366051 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:06.366051 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:06.366051 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:06.366051 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:06.366051 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:06.366051 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:06.366051 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:06.366051 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:06.366051 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:12:06.366051 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:12:06.366051 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:12:06.366051 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:12:06.366978 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:12:06.366978 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:12:06.366978 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:12:06.366978 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:12:06.366978 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:06.366978 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:06.366978 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:06.366978 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:06.366978 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:06.366978 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:06.366978 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:06.366978 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:06.366978 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:06.366978 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:06.366978 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:06.366978 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:06.367779 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:06.367779 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:06.367779 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:06.367779 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:06.367779 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:12:06.367779 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:12:06.367779 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:12:06.367779 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:12:06.367779 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:12:06.367779 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:12:06.367779 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 25 13:12:06.367779 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:06.367779 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 193/376] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 25 13:12:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:06.368997 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202dfb7-c06e-4987-991c-d789be05dc48 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:06.376348 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf9d3e-7650-4b46-9e2a-45bf3e2be8d4 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:06.381371 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:06.386325 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:06.413005 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c043b85-d468-4ee5-854b-e40b781159fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:06.413635 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c043b85-d468-4ee5-854b-e40b781159fe None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:06.413967 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c043b85-d468-4ee5-854b-e40b781159fe None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:06.414243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c043b85-d468-4ee5-854b-e40b781159fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:06.425796 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c043b85-d468-4ee5-854b-e40b781159fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:06.427243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c043b85-d468-4ee5-854b-e40b781159fe None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:06.443469 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-9c043b85-d468-4ee5-854b-e40b781159fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:06.443469 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:06.443469 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:06.443469 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:06.443469 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:06.443469 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:06.443469 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:06.443469 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:06.443469 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:06.443469 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:06.443469 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:06.443469 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:06.443469 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:12:06.443469 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:12:06.443469 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:12:06.443469 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:12:06.444706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:06.444706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:06.444706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:06.444706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:06.444706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:06.444706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:06.444706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:06.444706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:06.444706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:06.444706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:06.444706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:06.444706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:06.444706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:06.444706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:06.444706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:06.444706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:06.444706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:12:06.445577 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:12:06.445577 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:06.445577 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:06.445577 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 184/377] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:06.445577 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c043b85-d468-4ee5-854b-e40b781159fe None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:06.486225 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202dfb7-c06e-4987-991c-d789be05dc48 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:06.522983 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21fe2dd-6ab0-4e07-b58e-77122f1683c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:06.523504 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fe2dd-6ab0-4e07-b58e-77122f1683c0 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:06.523784 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fe2dd-6ab0-4e07-b58e-77122f1683c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:06.524100 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fe2dd-6ab0-4e07-b58e-77122f1683c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:06.524767 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21fe2dd-6ab0-4e07-b58e-77122f1683c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:06.525070 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21fe2dd-6ab0-4e07-b58e-77122f1683c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:06.526441 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21fe2dd-6ab0-4e07-b58e-77122f1683c0 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:06.534701 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 194/378] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 25 13:12:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:06.536955 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21fe2dd-6ab0-4e07-b58e-77122f1683c0 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:06.558405 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c043b85-d468-4ee5-854b-e40b781159fe None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:06.593394 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb3464-ba45-4c09-b7c2-ea7a62bb7f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:06.594626 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb3464-ba45-4c09-b7c2-ea7a62bb7f39 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:06.594904 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb3464-ba45-4c09-b7c2-ea7a62bb7f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:06.595178 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb3464-ba45-4c09-b7c2-ea7a62bb7f39 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:06.595827 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb3464-ba45-4c09-b7c2-ea7a62bb7f39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:06.596161 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb3464-ba45-4c09-b7c2-ea7a62bb7f39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:06.597531 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb3464-ba45-4c09-b7c2-ea7a62bb7f39 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:06.609025 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 185/379] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:06.610497 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb3464-ba45-4c09-b7c2-ea7a62bb7f39 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:06.614846 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:06.633207 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:06.645152 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21fe2dd-6ab0-4e07-b58e-77122f1683c0 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:06.678766 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3b92a-3e98-43a1-995b-d60896a41fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:06.679367 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3b92a-3e98-43a1-995b-d60896a41fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:06.679646 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3b92a-3e98-43a1-995b-d60896a41fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:06.679944 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3b92a-3e98-43a1-995b-d60896a41fd2 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:06.680600 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da3b92a-3e98-43a1-995b-d60896a41fd2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:06.680903 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da3b92a-3e98-43a1-995b-d60896a41fd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:06.682270 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da3b92a-3e98-43a1-995b-d60896a41fd2 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:06.690654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 195/380] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 25 13:12:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:06.694846 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3b92a-3e98-43a1-995b-d60896a41fd2 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:06.714698 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb3464-ba45-4c09-b7c2-ea7a62bb7f39 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:06.749775 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab35b3-ab6d-424e-b02e-aaae02dc2f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:06.750419 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab35b3-ab6d-424e-b02e-aaae02dc2f9a None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:06.750693 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab35b3-ab6d-424e-b02e-aaae02dc2f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:06.750967 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab35b3-ab6d-424e-b02e-aaae02dc2f9a None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:06.751598 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab35b3-ab6d-424e-b02e-aaae02dc2f9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:06.751919 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab35b3-ab6d-424e-b02e-aaae02dc2f9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:06.753293 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab35b3-ab6d-424e-b02e-aaae02dc2f9a None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:06.764198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 186/381] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:06.765837 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e872060-83ec-4b6a-a209-6305016b1402 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:06.766136 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e872060-83ec-4b6a-a209-6305016b1402 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:06.766412 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e872060-83ec-4b6a-a209-6305016b1402 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:06.767609 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 187/382] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:06.768325 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e872060-83ec-4b6a-a209-6305016b1402 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:06.805878 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3b92a-3e98-43a1-995b-d60896a41fd2 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:06.840759 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c61d5-782a-4c3f-8513-90707faacbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:06.841377 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c61d5-782a-4c3f-8513-90707faacbf3 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:06.841652 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c61d5-782a-4c3f-8513-90707faacbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:06.841925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c61d5-782a-4c3f-8513-90707faacbf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:06.844401 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:06.851490 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:06.853760 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c61d5-782a-4c3f-8513-90707faacbf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:06.855147 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c61d5-782a-4c3f-8513-90707faacbf3 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:06.869206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-f80c61d5-782a-4c3f-8513-90707faacbf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:06.869206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:06.869206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:06.869206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:06.869206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:06.869206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:06.869206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:06.869206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:06.869206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:06.869206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:06.869206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:06.869206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:06.869206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:12:06.869206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:12:06.869206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:12:06.869206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:12:06.870214 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:06.870214 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:06.870214 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:06.870214 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:06.870214 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:06.870214 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:06.870214 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:06.870214 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:06.870214 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:06.870214 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:06.870214 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:06.870214 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:06.870214 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:06.870214 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:06.870214 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:06.870214 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:06.870214 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:12:06.871065 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:12:06.871065 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:06.871065 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:06.871065 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 196/383] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:06.871065 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c61d5-782a-4c3f-8513-90707faacbf3 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:06.876223 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e872060-83ec-4b6a-a209-6305016b1402 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:06.909934 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16905f8f-32e2-42ca-afcd-675fec611a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:06.910548 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16905f8f-32e2-42ca-afcd-675fec611a9d None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:06.910819 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16905f8f-32e2-42ca-afcd-675fec611a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:06.911084 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16905f8f-32e2-42ca-afcd-675fec611a9d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:06.918642 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16905f8f-32e2-42ca-afcd-675fec611a9d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:06.920110 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16905f8f-32e2-42ca-afcd-675fec611a9d None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:06.932533 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-16905f8f-32e2-42ca-afcd-675fec611a9d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 25 13:12:06.932533 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:06.932533 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:06.932533 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:06.932533 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:06.932533 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:06.932533 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:06.932533 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:06.932533 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:06.932533 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:06.932533 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:06.932533 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:06.932533 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 25 13:12:06.932533 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 25 13:12:06.932533 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 25 13:12:06.932533 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 25 13:12:06.933432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:06.933432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:06.933432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 25 13:12:06.933432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:12:06.933432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 25 13:12:06.933432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:12:06.933432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:06.933432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:06.933432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:06.933432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:06.933432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:06.933432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:06.933432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:06.933432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:06.933432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:06.933432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:06.933432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:06.933432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:06.934379 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:06.934379 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:06.934379 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 25 13:12:06.934379 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 25 13:12:06.934379 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 25 13:12:06.934379 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 25 13:12:06.934379 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 25 13:12:06.934379 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 25 13:12:06.934379 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 25 13:12:06.934379 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:06.934379 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 188/384] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Oct 25 13:12:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:06.934379 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16905f8f-32e2-42ca-afcd-675fec611a9d None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:06.974277 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c61d5-782a-4c3f-8513-90707faacbf3 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:07.007250 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23565131-bfe2-4f3b-8d7b-a774c6297454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:07.007854 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23565131-bfe2-4f3b-8d7b-a774c6297454 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:07.008157 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23565131-bfe2-4f3b-8d7b-a774c6297454 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:07.008427 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23565131-bfe2-4f3b-8d7b-a774c6297454 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:07.019140 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23565131-bfe2-4f3b-8d7b-a774c6297454 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:07.020599 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23565131-bfe2-4f3b-8d7b-a774c6297454 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:07.034728 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-23565131-bfe2-4f3b-8d7b-a774c6297454 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:07.034728 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:07.034728 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:07.034728 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:07.034728 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:07.034728 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:07.034728 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:07.034728 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:07.034728 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:07.034728 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:07.034728 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:07.034728 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:07.034728 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:12:07.034728 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:12:07.034728 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:12:07.034728 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:12:07.035607 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:07.035607 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:07.035607 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:07.035607 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:07.035607 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:07.035607 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:07.035607 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:07.035607 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:07.035607 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:07.035607 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:07.035607 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:07.035607 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:07.035607 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:07.035607 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:07.035607 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:07.035607 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:07.035607 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:12:07.036501 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:12:07.036501 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:07.036501 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:07.036674 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16905f8f-32e2-42ca-afcd-675fec611a9d None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:07.037514 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 197/385] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:07.037514 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f1b8f-49d1-44c4-8300-ece20b29cb50 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:07.037514 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f1b8f-49d1-44c4-8300-ece20b29cb50 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:07.037514 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f1b8f-49d1-44c4-8300-ece20b29cb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:07.054852 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-589f1b8f-49d1-44c4-8300-ece20b29cb50 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:07.056127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-589f1b8f-49d1-44c4-8300-ece20b29cb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:07.073567 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c4075-2efb-44bc-83b5-19c9efcdb7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:07.074191 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c4075-2efb-44bc-83b5-19c9efcdb7ea None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:07.074471 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c4075-2efb-44bc-83b5-19c9efcdb7ea None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:07.074748 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c4075-2efb-44bc-83b5-19c9efcdb7ea None admin] PATH_INFO: `/v3/users/glance` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:07.082660 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c4075-2efb-44bc-83b5-19c9efcdb7ea None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:07.084121 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c4075-2efb-44bc-83b5-19c9efcdb7ea None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:07.085811 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:07.087591 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:07.098114 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-143c4075-2efb-44bc-83b5-19c9efcdb7ea None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 25 13:12:07.098114 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:07.098114 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:07.098114 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:07.098114 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:07.098114 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:07.098114 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:07.098114 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:07.098114 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:07.098114 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:07.098114 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:07.098114 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:07.098114 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 25 13:12:07.098114 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 25 13:12:07.098114 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 25 13:12:07.098114 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 25 13:12:07.099000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:07.099000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:07.099000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 25 13:12:07.099000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:12:07.099000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 25 13:12:07.099000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:12:07.099000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:07.099000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:07.099000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:07.099000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:07.099000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:07.099000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:07.099000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:07.099000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:07.099000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:07.099000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:07.099000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:07.099000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:07.099882 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:07.099882 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:07.099882 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 25 13:12:07.099882 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 25 13:12:07.099882 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 25 13:12:07.099882 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 25 13:12:07.099882 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 25 13:12:07.099882 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 25 13:12:07.099882 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 25 13:12:07.099882 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:07.100429 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 189/386] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 25 13:12:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:07.100955 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c4075-2efb-44bc-83b5-19c9efcdb7ea None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:07.126013 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 198/387] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:12:07.127016 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f1b8f-49d1-44c4-8300-ece20b29cb50 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:07.202606 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c4075-2efb-44bc-83b5-19c9efcdb7ea None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:07.233399 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f1b8f-49d1-44c4-8300-ece20b29cb50 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:07.235415 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00099df6-f439-4b52-b070-eeeb812621e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:07.236046 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00099df6-f439-4b52-b070-eeeb812621e2 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:07.236328 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00099df6-f439-4b52-b070-eeeb812621e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:07.236603 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00099df6-f439-4b52-b070-eeeb812621e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:07.237231 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00099df6-f439-4b52-b070-eeeb812621e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:07.237523 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00099df6-f439-4b52-b070-eeeb812621e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:07.238883 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00099df6-f439-4b52-b070-eeeb812621e2 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:07.250992 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 190/388] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:07.251780 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00099df6-f439-4b52-b070-eeeb812621e2 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:07.276317 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc9f41-10b6-40c2-9e8a-0e4300280c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:07.277287 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc9f41-10b6-40c2-9e8a-0e4300280c0d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:07.277776 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc9f41-10b6-40c2-9e8a-0e4300280c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:07.278118 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc9f41-10b6-40c2-9e8a-0e4300280c0d None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:07.278971 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fc9f41-10b6-40c2-9e8a-0e4300280c0d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:07.279261 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fc9f41-10b6-40c2-9e8a-0e4300280c0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:07.280831 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fc9f41-10b6-40c2-9e8a-0e4300280c0d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:07.310674 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:07.322775 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 199/389] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Oct 25 13:12:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:07.323613 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc9f41-10b6-40c2-9e8a-0e4300280c0d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:07.350755 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:07.356255 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00099df6-f439-4b52-b070-eeeb812621e2 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:07.391987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9144c-b33a-4477-8c74-d706a167a61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:07.392599 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9144c-b33a-4477-8c74-d706a167a61a None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:07.392928 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9144c-b33a-4477-8c74-d706a167a61a None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:07.393208 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9144c-b33a-4477-8c74-d706a167a61a None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:07.393869 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9144c-b33a-4477-8c74-d706a167a61a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:07.394176 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9144c-b33a-4477-8c74-d706a167a61a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:07.395970 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9144c-b33a-4477-8c74-d706a167a61a None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:07.407521 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 191/390] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:07.408363 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9144c-b33a-4477-8c74-d706a167a61a None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:07.430303 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc9f41-10b6-40c2-9e8a-0e4300280c0d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:07.464317 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed02b24-8ce0-4c90-be37-11c97bf1a753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:07.464920 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed02b24-8ce0-4c90-be37-11c97bf1a753 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:07.465200 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed02b24-8ce0-4c90-be37-11c97bf1a753 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:07.465475 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed02b24-8ce0-4c90-be37-11c97bf1a753 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:07.466196 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed02b24-8ce0-4c90-be37-11c97bf1a753 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:07.466501 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed02b24-8ce0-4c90-be37-11c97bf1a753 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:07.467988 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed02b24-8ce0-4c90-be37-11c97bf1a753 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:07.486176 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 200/391] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Oct 25 13:12:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:07.486978 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed02b24-8ce0-4c90-be37-11c97bf1a753 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:07.508626 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9144c-b33a-4477-8c74-d706a167a61a None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:07.528323 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:07.542437 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d1fc9-5975-42c7-8141-9dd2b1d8d2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:07.543074 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d1fc9-5975-42c7-8141-9dd2b1d8d2dd None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:07.543356 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d1fc9-5975-42c7-8141-9dd2b1d8d2dd None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:07.543632 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d1fc9-5975-42c7-8141-9dd2b1d8d2dd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:07.551600 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d1fc9-5975-42c7-8141-9dd2b1d8d2dd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:07.553064 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d1fc9-5975-42c7-8141-9dd2b1d8d2dd None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:07.564168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-f14d1fc9-5975-42c7-8141-9dd2b1d8d2dd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 25 13:12:07.564168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:07.564168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:07.564168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:07.564168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:07.564168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:07.564168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:07.564168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:07.564168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:07.564168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:07.564168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:07.564168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:07.564168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 25 13:12:07.564168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 25 13:12:07.564168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 25 13:12:07.564168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 25 13:12:07.565097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:07.565097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:07.565097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 25 13:12:07.565097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:12:07.565097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 25 13:12:07.565097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:12:07.565097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:07.565097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:07.565097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:07.565097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:07.565097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:07.565097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:07.565097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:07.565097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:07.565097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:07.565097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:07.565097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:07.565097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:07.566481 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:07.566481 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:07.566481 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 25 13:12:07.566481 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 25 13:12:07.566481 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 25 13:12:07.566481 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 25 13:12:07.566481 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 25 13:12:07.566481 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 25 13:12:07.566481 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 25 13:12:07.566481 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:07.566481 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 192/392] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 25 13:12:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:07.566481 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d1fc9-5975-42c7-8141-9dd2b1d8d2dd None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:07.574107 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:07.590595 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed02b24-8ce0-4c90-be37-11c97bf1a753 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:07.625728 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12b179-4609-4f53-86ea-13052c04412d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:07.626347 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12b179-4609-4f53-86ea-13052c04412d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:07.626623 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12b179-4609-4f53-86ea-13052c04412d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:07.626895 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12b179-4609-4f53-86ea-13052c04412d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:07.636778 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f12b179-4609-4f53-86ea-13052c04412d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:07.638216 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f12b179-4609-4f53-86ea-13052c04412d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:07.654277 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-9f12b179-4609-4f53-86ea-13052c04412d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:07.654277 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:07.654277 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:07.654277 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:07.654277 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:07.654277 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:07.654277 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:07.654277 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:07.654277 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:07.654277 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:07.654277 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:07.654277 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:07.654277 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:12:07.654277 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:12:07.654277 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:12:07.654277 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:12:07.655357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:07.655357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:07.655357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:07.655357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:07.655357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:07.655357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:07.655357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:07.655357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:07.655357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:07.655357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:07.655357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:07.655357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:07.655357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:07.655357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:07.655357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:07.655357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:07.655357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:12:07.657158 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:12:07.657158 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:07.657158 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:07.657158 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 201/393] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:07.657158 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12b179-4609-4f53-86ea-13052c04412d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:07.668556 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d1fc9-5975-42c7-8141-9dd2b1d8d2dd None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:07.702241 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17823571-c21a-4cdf-8437-990d3f21c229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:07.703376 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17823571-c21a-4cdf-8437-990d3f21c229 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:07.703656 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17823571-c21a-4cdf-8437-990d3f21c229 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:07.703947 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17823571-c21a-4cdf-8437-990d3f21c229 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:07.714828 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17823571-c21a-4cdf-8437-990d3f21c229 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:07.716304 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17823571-c21a-4cdf-8437-990d3f21c229 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:07.731131 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-17823571-c21a-4cdf-8437-990d3f21c229 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:07.731131 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:07.731131 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:07.731131 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:07.731131 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:07.731131 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:07.731131 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:07.731131 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:07.731131 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:07.731131 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:07.731131 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:07.731131 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:07.731131 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:12:07.731131 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:12:07.731131 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:12:07.731131 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:12:07.732198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:07.732198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:07.732198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:07.732198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:07.732198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:07.732198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:07.732198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:07.732198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:07.732198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:07.732198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:07.732198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:07.732198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:07.732198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:07.732198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:07.732198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:07.732198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:07.732198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:12:07.733243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:12:07.733243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:07.733243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:07.733243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 193/394] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:07.733502 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17823571-c21a-4cdf-8437-990d3f21c229 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:07.764711 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:07.770052 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12b179-4609-4f53-86ea-13052c04412d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:07.803669 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb4401-5fba-41c6-a842-860d415a8011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:07.804323 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb4401-5fba-41c6-a842-860d415a8011 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:07.804605 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb4401-5fba-41c6-a842-860d415a8011 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:07.804880 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb4401-5fba-41c6-a842-860d415a8011 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:07.807512 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:07.812816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cb4401-5fba-41c6-a842-860d415a8011 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:07.814624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cb4401-5fba-41c6-a842-860d415a8011 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:07.827111 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-e6cb4401-5fba-41c6-a842-860d415a8011 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 25 13:12:07.827111 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:07.827111 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:07.827111 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:07.827111 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:07.827111 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:07.827111 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:07.827111 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:07.827111 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:07.827111 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:07.827111 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:07.827111 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:07.827111 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 25 13:12:07.827111 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 25 13:12:07.827111 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 25 13:12:07.827111 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 25 13:12:07.828411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:07.828411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:07.828411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 25 13:12:07.828411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:12:07.828411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 25 13:12:07.828411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:12:07.828411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:07.828411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:07.828411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:07.828411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:07.828411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:07.828411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:07.828411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:07.828411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:07.828411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:07.828411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:07.828411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:07.828411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:07.829332 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:07.829332 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:07.829332 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 25 13:12:07.829332 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 25 13:12:07.829332 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 25 13:12:07.829332 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 25 13:12:07.829332 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 25 13:12:07.829332 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 25 13:12:07.829332 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 25 13:12:07.829332 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:07.829332 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 202/395] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 25 13:12:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:07.829332 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb4401-5fba-41c6-a842-860d415a8011 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:07.840942 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17823571-c21a-4cdf-8437-990d3f21c229 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:07.874338 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b91fb-1d09-4f59-857b-d9dee0e45c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:07.875561 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b91fb-1d09-4f59-857b-d9dee0e45c68 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:07.875849 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b91fb-1d09-4f59-857b-d9dee0e45c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:07.876166 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b91fb-1d09-4f59-857b-d9dee0e45c68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:07.886462 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82b91fb-1d09-4f59-857b-d9dee0e45c68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:07.887913 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82b91fb-1d09-4f59-857b-d9dee0e45c68 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:07.901692 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-b82b91fb-1d09-4f59-857b-d9dee0e45c68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:07.901692 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:07.901692 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:07.901692 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:07.901692 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:07.901692 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:07.901692 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:07.901692 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:07.901692 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:07.901692 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:07.901692 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:07.901692 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:07.901692 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:12:07.901692 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:12:07.901692 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:12:07.901692 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:12:07.902769 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:07.902769 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:07.902769 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:07.902769 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:07.902769 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:07.902769 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:07.902769 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:07.902769 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:07.902769 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:07.902769 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:07.902769 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:07.902769 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:07.902769 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:07.902769 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:07.902769 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:07.902769 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:07.902769 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:12:07.903849 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:12:07.903849 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:07.903849 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:07.903849 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 194/396] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:07.903849 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b91fb-1d09-4f59-857b-d9dee0e45c68 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:07.930765 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb4401-5fba-41c6-a842-860d415a8011 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:07.964383 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a75a1-7feb-447e-bef9-639cbd3ede9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:07.965008 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a75a1-7feb-447e-bef9-639cbd3ede9c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:07.965462 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a75a1-7feb-447e-bef9-639cbd3ede9c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:07.965744 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a75a1-7feb-447e-bef9-639cbd3ede9c None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:07.966797 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a75a1-7feb-447e-bef9-639cbd3ede9c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:07.967108 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a75a1-7feb-447e-bef9-639cbd3ede9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:07.968718 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a75a1-7feb-447e-bef9-639cbd3ede9c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:07.986881 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 203/397] 10.222.0.25 () {56 vars in 1139 bytes} [Tue Oct 25 13:12:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:07.987695 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a75a1-7feb-447e-bef9-639cbd3ede9c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:07.995168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:08.011850 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b91fb-1d09-4f59-857b-d9dee0e45c68 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:08.042731 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:08.045839 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873164b-7ff4-4700-b25d-90b67d138a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:08.046435 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873164b-7ff4-4700-b25d-90b67d138a8d None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:08.046753 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873164b-7ff4-4700-b25d-90b67d138a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:08.047025 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873164b-7ff4-4700-b25d-90b67d138a8d None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:08.047655 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d873164b-7ff4-4700-b25d-90b67d138a8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:08.047976 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d873164b-7ff4-4700-b25d-90b67d138a8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:08.049335 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d873164b-7ff4-4700-b25d-90b67d138a8d None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:08.060746 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 195/398] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:08.061530 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873164b-7ff4-4700-b25d-90b67d138a8d None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:08.090556 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a75a1-7feb-447e-bef9-639cbd3ede9c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:08.123265 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32787e5d-61cf-431a-82d4-418be671cea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:08.123876 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32787e5d-61cf-431a-82d4-418be671cea7 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:08.124188 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32787e5d-61cf-431a-82d4-418be671cea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:08.124463 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32787e5d-61cf-431a-82d4-418be671cea7 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:08.125619 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32787e5d-61cf-431a-82d4-418be671cea7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:08.125919 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32787e5d-61cf-431a-82d4-418be671cea7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:08.127282 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32787e5d-61cf-431a-82d4-418be671cea7 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:08.138317 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 204/399] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:08.139098 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32787e5d-61cf-431a-82d4-418be671cea7 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:08.160454 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873164b-7ff4-4700-b25d-90b67d138a8d None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:08.193186 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb4681-7032-4f46-ab91-09819487e4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:08.193785 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb4681-7032-4f46-ab91-09819487e4b2 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:08.194066 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb4681-7032-4f46-ab91-09819487e4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:08.194339 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb4681-7032-4f46-ab91-09819487e4b2 None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:08.195057 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb4681-7032-4f46-ab91-09819487e4b2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:08.195354 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb4681-7032-4f46-ab91-09819487e4b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:08.196804 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb4681-7032-4f46-ab91-09819487e4b2 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:08.233224 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 196/400] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Oct 25 13:12:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:08.234086 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb4681-7032-4f46-ab91-09819487e4b2 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:08.236756 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:08.241310 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32787e5d-61cf-431a-82d4-418be671cea7 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:08.254860 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:08.275154 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206026e-dd43-457b-b44b-01527e863a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:08.275756 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206026e-dd43-457b-b44b-01527e863a6a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:08.276104 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206026e-dd43-457b-b44b-01527e863a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:08.276383 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206026e-dd43-457b-b44b-01527e863a6a None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:08.277017 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7206026e-dd43-457b-b44b-01527e863a6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:08.277317 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7206026e-dd43-457b-b44b-01527e863a6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:08.278696 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7206026e-dd43-457b-b44b-01527e863a6a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:08.291371 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 205/401] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:08.292507 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206026e-dd43-457b-b44b-01527e863a6a None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:08.334334 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb4681-7032-4f46-ab91-09819487e4b2 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:08.369549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39a0b2-689a-4948-8ecc-266727af3db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:08.370098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39a0b2-689a-4948-8ecc-266727af3db0 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:08.370379 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39a0b2-689a-4948-8ecc-266727af3db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:08.370648 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39a0b2-689a-4948-8ecc-266727af3db0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:08.380792 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39a0b2-689a-4948-8ecc-266727af3db0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:08.382247 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39a0b2-689a-4948-8ecc-266727af3db0 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:08.390794 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206026e-dd43-457b-b44b-01527e863a6a None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:08.397613 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-ff39a0b2-689a-4948-8ecc-266727af3db0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:08.397613 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:08.397613 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:08.397613 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:08.397613 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:08.397613 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:08.397613 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:08.397613 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:08.397613 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:08.397613 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:08.397613 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:08.397613 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:08.397613 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:12:08.397613 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:12:08.397613 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:12:08.397613 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:12:08.398522 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:08.398522 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:08.398522 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:08.398522 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:08.398522 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:08.398522 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:08.398522 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:08.398522 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:08.398522 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:08.398522 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:08.398522 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:08.398522 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:08.398522 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:08.398522 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:08.398522 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:08.398522 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:08.398522 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:12:08.399385 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:12:08.399385 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:08.399385 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:08.399385 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 197/402] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:08.399606 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39a0b2-689a-4948-8ecc-266727af3db0 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:08.425179 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fb4ac-376f-456a-9611-4d3966b51928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:08.425829 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fb4ac-376f-456a-9611-4d3966b51928 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:08.426109 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fb4ac-376f-456a-9611-4d3966b51928 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:08.426382 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fb4ac-376f-456a-9611-4d3966b51928 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:08.432813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3fb4ac-376f-456a-9611-4d3966b51928 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:08.434256 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3fb4ac-376f-456a-9611-4d3966b51928 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:08.445645 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-2f3fb4ac-376f-456a-9611-4d3966b51928 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:12:08.445645 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:08.445645 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:08.445645 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:08.445645 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:08.445645 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:08.445645 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:08.445645 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:08.445645 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:08.445645 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:08.445645 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:08.445645 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:08.445645 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 25 13:12:08.445645 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 25 13:12:08.445645 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 25 13:12:08.446576 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 25 13:12:08.446576 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:08.446576 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:08.446576 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:08.446576 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:08.446576 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:08.446576 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:08.446576 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:08.446576 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:08.446576 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:08.446576 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:08.446576 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:08.446576 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:08.446576 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:08.446576 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:08.446576 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:08.446576 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:08.452307 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 25 13:12:08.452307 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 25 13:12:08.452307 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 25 13:12:08.452307 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 25 13:12:08.452307 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 25 13:12:08.452307 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 25 13:12:08.452307 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:12:08.452307 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:08.452307 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 206/403] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 25 13:12:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:08.452307 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fb4ac-376f-456a-9611-4d3966b51928 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:08.458426 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:08.485829 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:08.503239 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39a0b2-689a-4948-8ecc-266727af3db0 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:08.536911 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea316a5-3eac-4f34-903e-df3ba4afb4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:08.537516 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea316a5-3eac-4f34-903e-df3ba4afb4ca None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:08.537794 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea316a5-3eac-4f34-903e-df3ba4afb4ca None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:08.538070 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea316a5-3eac-4f34-903e-df3ba4afb4ca None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:08.538705 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea316a5-3eac-4f34-903e-df3ba4afb4ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:08.540164 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea316a5-3eac-4f34-903e-df3ba4afb4ca None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:08.553218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fb4ac-376f-456a-9611-4d3966b51928 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:08.560670 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 198/404] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 25 13:12:08 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:12:08.561474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea316a5-3eac-4f34-903e-df3ba4afb4ca None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:08.605287 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfb0d7-ed73-476c-aab3-63222da6c55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:08.605948 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfb0d7-ed73-476c-aab3-63222da6c55e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:08.606234 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfb0d7-ed73-476c-aab3-63222da6c55e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:08.606510 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfb0d7-ed73-476c-aab3-63222da6c55e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:08.619506 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bfb0d7-ed73-476c-aab3-63222da6c55e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:08.621096 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bfb0d7-ed73-476c-aab3-63222da6c55e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:08.638648 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-e3bfb0d7-ed73-476c-aab3-63222da6c55e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:08.638648 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:08.638648 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:08.638648 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:08.638648 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:08.638648 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:08.638648 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:08.638648 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:08.638648 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:08.638648 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:08.638648 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:08.638648 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:08.638648 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:12:08.638648 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:12:08.638648 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:12:08.638648 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:12:08.639865 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:08.639865 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:08.639865 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:08.639865 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:08.639865 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:08.639865 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:08.639865 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:08.639865 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:08.639865 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:08.639865 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:08.639865 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:08.639865 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:08.639865 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:08.639865 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:08.639865 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:08.639865 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:08.639865 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:12:08.641328 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:12:08.641328 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:08.641328 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:08.641328 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 207/405] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:08.641328 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfb0d7-ed73-476c-aab3-63222da6c55e None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:08.679835 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea316a5-3eac-4f34-903e-df3ba4afb4ca None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:08.692293 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:08.721314 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd7a1c-aad1-4e28-910f-41346b157117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:08.723947 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd7a1c-aad1-4e28-910f-41346b157117 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:08.723947 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd7a1c-aad1-4e28-910f-41346b157117 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:08.723947 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd7a1c-aad1-4e28-910f-41346b157117 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:08.731595 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd7a1c-aad1-4e28-910f-41346b157117 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:08.733128 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd7a1c-aad1-4e28-910f-41346b157117 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:08.746283 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-11fd7a1c-aad1-4e28-910f-41346b157117 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:12:08.746283 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:08.746283 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:08.746283 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:08.746283 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:08.746283 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:08.746283 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:08.746283 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:08.746283 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:08.746283 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:08.746283 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:08.746283 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:08.746283 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 25 13:12:08.746283 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 25 13:12:08.746283 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 25 13:12:08.747164 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 25 13:12:08.747164 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:08.747164 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:08.747164 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:08.747164 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:08.747164 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:08.747164 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:08.747164 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:08.747164 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:08.747164 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:08.747164 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:08.747164 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:08.747164 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:08.747164 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:08.747164 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:08.747164 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:08.747164 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:08.748033 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 25 13:12:08.748033 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 25 13:12:08.748033 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 25 13:12:08.748033 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 25 13:12:08.748033 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 25 13:12:08.748033 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 25 13:12:08.748033 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:12:08.748033 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:08.748033 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 199/406] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 25 13:12:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:08.748531 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd7a1c-aad1-4e28-910f-41346b157117 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:08.764282 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:08.782760 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfb0d7-ed73-476c-aab3-63222da6c55e None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:08.819141 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef161e-95ad-4e31-8d1d-b2a41f5bf058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:08.819771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef161e-95ad-4e31-8d1d-b2a41f5bf058 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:08.820088 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef161e-95ad-4e31-8d1d-b2a41f5bf058 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:08.820372 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef161e-95ad-4e31-8d1d-b2a41f5bf058 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:08.821099 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef161e-95ad-4e31-8d1d-b2a41f5bf058 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:08.821408 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef161e-95ad-4e31-8d1d-b2a41f5bf058 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:08.822802 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef161e-95ad-4e31-8d1d-b2a41f5bf058 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:08.840075 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 208/407] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:08.840075 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef161e-95ad-4e31-8d1d-b2a41f5bf058 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:08.864384 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd7a1c-aad1-4e28-910f-41346b157117 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:08.900088 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff73dbe-3fb5-4e4b-a19a-69bb6c232b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:08.900743 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff73dbe-3fb5-4e4b-a19a-69bb6c232b61 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:08.901027 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff73dbe-3fb5-4e4b-a19a-69bb6c232b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:08.901296 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff73dbe-3fb5-4e4b-a19a-69bb6c232b61 None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:08.901987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff73dbe-3fb5-4e4b-a19a-69bb6c232b61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:08.902539 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff73dbe-3fb5-4e4b-a19a-69bb6c232b61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:08.903715 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff73dbe-3fb5-4e4b-a19a-69bb6c232b61 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:08.923625 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 200/408] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 25 13:12:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:08.924815 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff73dbe-3fb5-4e4b-a19a-69bb6c232b61 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:08.945339 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef161e-95ad-4e31-8d1d-b2a41f5bf058 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:08.956674 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:08.982251 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67727336-2507-4c19-bcd0-c1edda9ea174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:08.982855 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67727336-2507-4c19-bcd0-c1edda9ea174 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:08.983171 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67727336-2507-4c19-bcd0-c1edda9ea174 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:08.983409 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67727336-2507-4c19-bcd0-c1edda9ea174 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:08.984626 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67727336-2507-4c19-bcd0-c1edda9ea174 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:08.985019 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67727336-2507-4c19-bcd0-c1edda9ea174 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:08.986406 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67727336-2507-4c19-bcd0-c1edda9ea174 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:09.002499 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 209/409] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:09.003397 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67727336-2507-4c19-bcd0-c1edda9ea174 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:09.013529 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:09.032661 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff73dbe-3fb5-4e4b-a19a-69bb6c232b61 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:09.070814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186ec21-afed-4860-9a37-1bbfa17818e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:09.071434 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186ec21-afed-4860-9a37-1bbfa17818e0 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:09.071705 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186ec21-afed-4860-9a37-1bbfa17818e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:09.072004 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186ec21-afed-4860-9a37-1bbfa17818e0 None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:09.072694 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186ec21-afed-4860-9a37-1bbfa17818e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:09.072999 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186ec21-afed-4860-9a37-1bbfa17818e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:09.074429 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186ec21-afed-4860-9a37-1bbfa17818e0 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:09.088113 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 201/410] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 25 13:12:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:09.088918 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186ec21-afed-4860-9a37-1bbfa17818e0 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:09.122201 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67727336-2507-4c19-bcd0-c1edda9ea174 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:09.159133 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb138168-31c9-475c-b5fe-d95d154b62eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:09.159688 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb138168-31c9-475c-b5fe-d95d154b62eb None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:09.160000 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb138168-31c9-475c-b5fe-d95d154b62eb None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:09.160281 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb138168-31c9-475c-b5fe-d95d154b62eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:09.167819 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb138168-31c9-475c-b5fe-d95d154b62eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:09.169316 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb138168-31c9-475c-b5fe-d95d154b62eb None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:09.180907 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-bb138168-31c9-475c-b5fe-d95d154b62eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:12:09.180907 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:09.180907 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:09.180907 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:09.180907 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:09.180907 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:09.180907 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:09.180907 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:09.180907 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:09.180907 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:09.180907 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:09.180907 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:09.180907 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 25 13:12:09.180907 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 25 13:12:09.180907 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 25 13:12:09.181930 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 25 13:12:09.181930 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:09.181930 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:09.181930 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:09.181930 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:09.181930 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:09.181930 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:09.181930 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:09.181930 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:09.181930 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:09.181930 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:09.181930 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:09.181930 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:09.181930 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:09.181930 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:09.181930 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:09.181930 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:09.182787 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 25 13:12:09.182787 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 25 13:12:09.182787 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 25 13:12:09.182787 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 25 13:12:09.182787 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 25 13:12:09.182787 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 25 13:12:09.182787 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:12:09.182787 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:09.182787 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 210/411] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 25 13:12:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:09.183257 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb138168-31c9-475c-b5fe-d95d154b62eb None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:09.189500 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:09.200637 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186ec21-afed-4860-9a37-1bbfa17818e0 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:09.238240 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d67a4-4773-4319-82e2-9268b3905235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:09.238904 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d67a4-4773-4319-82e2-9268b3905235 None admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:09.239186 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d67a4-4773-4319-82e2-9268b3905235 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:09.239459 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d67a4-4773-4319-82e2-9268b3905235 None admin] PATH_INFO: `/v3/projects/616ecfe8d2c74aad9386720718392e81/users/63e73c00cadb4deea934db6111ed76d5/roles/b3a463dfc621439eaee93c0551a4e296` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:09.254785 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d67a4-4773-4319-82e2-9268b3905235 None admin] RBAC: Authorizing `identity:create_grant(project_id=616ecfe8d2c74aad9386720718392e81, user_id=63e73c00cadb4deea934db6111ed76d5, role_id=b3a463dfc621439eaee93c0551a4e296)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:09.256274 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d67a4-4773-4319-82e2-9268b3905235 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:09.257263 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:09.271163 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 202/412] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 25 13:12:09 2022] PUT /identity/v3/projects/616ecfe8d2c74aad9386720718392e81/users/63e73c00cadb4deea934db6111ed76d5/roles/b3a463dfc621439eaee93c0551a4e296 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:12:09.271994 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d67a4-4773-4319-82e2-9268b3905235 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:09.317692 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb138168-31c9-475c-b5fe-d95d154b62eb None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:09.361691 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591b07f-bd68-4f51-b3c9-a016b80a0679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:09.362756 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591b07f-bd68-4f51-b3c9-a016b80a0679 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:09.363261 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591b07f-bd68-4f51-b3c9-a016b80a0679 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:09.363768 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591b07f-bd68-4f51-b3c9-a016b80a0679 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:09.373747 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4591b07f-bd68-4f51-b3c9-a016b80a0679 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:09.376134 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4591b07f-bd68-4f51-b3c9-a016b80a0679 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:09.390156 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-4591b07f-bd68-4f51-b3c9-a016b80a0679 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:12:09.390156 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:09.390156 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:09.390156 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:09.390156 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:09.390156 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:09.390156 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:09.390156 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:09.390156 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:09.390156 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:09.390156 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:09.390156 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:09.390156 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 25 13:12:09.390156 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 25 13:12:09.390156 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 25 13:12:09.391103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 25 13:12:09.391103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:09.391103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:09.391103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:09.391103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:09.391103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:09.391103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:09.391103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:09.391103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:09.391103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:09.391103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:09.391103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:09.391103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:09.391103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:09.391103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:09.391103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:09.391103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:09.391994 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 25 13:12:09.391994 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 25 13:12:09.391994 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 25 13:12:09.391994 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 25 13:12:09.391994 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 25 13:12:09.391994 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 25 13:12:09.391994 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:12:09.391994 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:09.394617 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 211/413] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 25 13:12:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:09.395825 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591b07f-bd68-4f51-b3c9-a016b80a0679 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:09.434863 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d67a4-4773-4319-82e2-9268b3905235 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:09.479753 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feded7d-4fed-4e67-a6eb-5e76be065855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:09.480476 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feded7d-4fed-4e67-a6eb-5e76be065855 None admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:09.480760 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feded7d-4fed-4e67-a6eb-5e76be065855 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:09.481036 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feded7d-4fed-4e67-a6eb-5e76be065855 None admin] PATH_INFO: `/v3/projects/616ecfe8d2c74aad9386720718392e81/users/89f67d808ffb4641b03f96406b3fe9e5/roles/b3a463dfc621439eaee93c0551a4e296` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:09.498166 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:09.499570 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feded7d-4fed-4e67-a6eb-5e76be065855 None admin] RBAC: Authorizing `identity:create_grant(project_id=616ecfe8d2c74aad9386720718392e81, user_id=89f67d808ffb4641b03f96406b3fe9e5, role_id=b3a463dfc621439eaee93c0551a4e296)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:09.501929 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feded7d-4fed-4e67-a6eb-5e76be065855 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:09.520585 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 203/414] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 25 13:12:09 2022] PUT /identity/v3/projects/616ecfe8d2c74aad9386720718392e81/users/89f67d808ffb4641b03f96406b3fe9e5/roles/b3a463dfc621439eaee93c0551a4e296 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:12:09.521658 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feded7d-4fed-4e67-a6eb-5e76be065855 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:09.535927 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591b07f-bd68-4f51-b3c9-a016b80a0679 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:09.598077 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:09.617291 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8109f-8854-48bf-ad10-9b4a9ac72a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:09.618167 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8109f-8854-48bf-ad10-9b4a9ac72a85 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:09.618451 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8109f-8854-48bf-ad10-9b4a9ac72a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:09.618780 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8109f-8854-48bf-ad10-9b4a9ac72a85 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:09.619494 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8109f-8854-48bf-ad10-9b4a9ac72a85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:09.619805 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8109f-8854-48bf-ad10-9b4a9ac72a85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:09.623517 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8109f-8854-48bf-ad10-9b4a9ac72a85 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:09.665001 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 212/415] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 25 13:12:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:09.670998 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8109f-8854-48bf-ad10-9b4a9ac72a85 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:09.733782 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feded7d-4fed-4e67-a6eb-5e76be065855 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:09.773167 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e9e3c-0251-42ab-bc06-9c614c671fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:09.774135 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e9e3c-0251-42ab-bc06-9c614c671fa8 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:09.774689 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e9e3c-0251-42ab-bc06-9c614c671fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:09.775161 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e9e3c-0251-42ab-bc06-9c614c671fa8 None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:09.776201 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e9e3c-0251-42ab-bc06-9c614c671fa8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:09.776579 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e9e3c-0251-42ab-bc06-9c614c671fa8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:09.778087 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e9e3c-0251-42ab-bc06-9c614c671fa8 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:09.792450 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 204/416] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 25 13:12:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:09.799543 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e9e3c-0251-42ab-bc06-9c614c671fa8 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:09.837900 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8109f-8854-48bf-ad10-9b4a9ac72a85 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:09.856401 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:09.896613 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55498dd9-cf4e-4475-9b83-c79a542b23b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:09.897299 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55498dd9-cf4e-4475-9b83-c79a542b23b9 None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:09.897582 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55498dd9-cf4e-4475-9b83-c79a542b23b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:09.897858 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55498dd9-cf4e-4475-9b83-c79a542b23b9 None admin] PATH_INFO: `/v3/projects/616ecfe8d2c74aad9386720718392e81/users/cec40e8c81fe4eafb474d40bc7bf38fc/roles/b3a463dfc621439eaee93c0551a4e296` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:09.912525 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e9e3c-0251-42ab-bc06-9c614c671fa8 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:09.933307 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55498dd9-cf4e-4475-9b83-c79a542b23b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=616ecfe8d2c74aad9386720718392e81, user_id=cec40e8c81fe4eafb474d40bc7bf38fc, role_id=b3a463dfc621439eaee93c0551a4e296)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:09.934784 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55498dd9-cf4e-4475-9b83-c79a542b23b9 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:09.952138 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b843b15-66b9-4bc4-a35c-fa7845315173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:09.953458 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b843b15-66b9-4bc4-a35c-fa7845315173 None admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:09.953756 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b843b15-66b9-4bc4-a35c-fa7845315173 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:09.954035 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b843b15-66b9-4bc4-a35c-fa7845315173 None admin] PATH_INFO: `/v3/projects/616ecfe8d2c74aad9386720718392e81/users/858fa61f39fa4d3daf4125f6099e7721/roles/b3a463dfc621439eaee93c0551a4e296` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:09.970585 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 213/417] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 25 13:12:09 2022] PUT /identity/v3/projects/616ecfe8d2c74aad9386720718392e81/users/cec40e8c81fe4eafb474d40bc7bf38fc/roles/b3a463dfc621439eaee93c0551a4e296 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:12:09.971553 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b843b15-66b9-4bc4-a35c-fa7845315173 None admin] RBAC: Authorizing `identity:create_grant(project_id=616ecfe8d2c74aad9386720718392e81, user_id=858fa61f39fa4d3daf4125f6099e7721, role_id=b3a463dfc621439eaee93c0551a4e296)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:09.973290 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b843b15-66b9-4bc4-a35c-fa7845315173 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:10.003049 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 205/418] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 25 13:12:09 2022] PUT /identity/v3/projects/616ecfe8d2c74aad9386720718392e81/users/858fa61f39fa4d3daf4125f6099e7721/roles/b3a463dfc621439eaee93c0551a4e296 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:12:10.911255 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a2015-4342-49fb-8585-bfce6a8dae3c None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:10.911754 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a2015-4342-49fb-8585-bfce6a8dae3c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:10.911827 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a2015-4342-49fb-8585-bfce6a8dae3c None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:10.913474 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 214/419] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 13:12:10.918596 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8b501-84a1-4831-8e8e-baf9ceee9af5 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:10.919090 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8b501-84a1-4831-8e8e-baf9ceee9af5 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:10.919247 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8b501-84a1-4831-8e8e-baf9ceee9af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:10.960887 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-68e8b501-84a1-4831-8e8e-baf9ceee9af5 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:10.962088 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-68e8b501-84a1-4831-8e8e-baf9ceee9af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:11.044898 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 206/420] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 25 13:12:11.507493 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a2015-4342-49fb-8585-bfce6a8dae3c None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:11.555732 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:11.637630 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a2015-4342-49fb-8585-bfce6a8dae3c None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:11.683279 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5ee46-2fda-484d-9cec-e46d76010e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:11.683921 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5ee46-2fda-484d-9cec-e46d76010e63 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:11.684210 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5ee46-2fda-484d-9cec-e46d76010e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:11.684476 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5ee46-2fda-484d-9cec-e46d76010e63 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:11.699870 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd5ee46-2fda-484d-9cec-e46d76010e63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:12:11.705034 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-4dd5ee46-2fda-484d-9cec-e46d76010e63 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 13:12:11.705034 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:11.705034 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:11.705034 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:11.705034 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:11.705034 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:11.705034 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:11.705034 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:11.705034 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:11.705034 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:11.705034 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:11.705034 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:11.705034 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:12:11.705034 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:12:11.705034 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:12:11.705034 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:12:11.707078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:12:11.707078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:12:11.707078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:12:11.707078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:12:11.707078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:11.707078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:11.707078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:11.707078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:11.707078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:11.707078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:11.707078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:11.707078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:11.707078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:11.707078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:11.707078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:11.707078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:11.709153 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:11.709153 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:11.709153 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:11.709153 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:11.709153 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:12:11.709153 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:12:11.709153 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:12:11.709153 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:12:11.709153 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:12:11.709153 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:12:11.709153 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 25 13:12:11.709153 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:11.709153 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 215/421] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 25 13:12:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:11.716993 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8b501-84a1-4831-8e8e-baf9ceee9af5 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:11.762356 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:11.854556 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8b501-84a1-4831-8e8e-baf9ceee9af5 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:11.890162 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f562a-4199-4c7e-be23-250d3a696ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:11.890916 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f562a-4199-4c7e-be23-250d3a696ef0 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:11.891191 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f562a-4199-4c7e-be23-250d3a696ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:11.891464 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f562a-4199-4c7e-be23-250d3a696ef0 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:11.892155 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f562a-4199-4c7e-be23-250d3a696ef0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:11.892453 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f562a-4199-4c7e-be23-250d3a696ef0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:11.893822 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f562a-4199-4c7e-be23-250d3a696ef0 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:11.902555 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 207/422] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 25 13:12:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:11.908578 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5ee46-2fda-484d-9cec-e46d76010e63 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:12.029078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:12.035186 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5ee46-2fda-484d-9cec-e46d76010e63 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:12.084851 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f106527b-0a36-446d-8ef0-acb731c17a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:12.085502 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106527b-0a36-446d-8ef0-acb731c17a30 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:12.085778 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106527b-0a36-446d-8ef0-acb731c17a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:12.086050 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106527b-0a36-446d-8ef0-acb731c17a30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:12.103264 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f106527b-0a36-446d-8ef0-acb731c17a30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:12.104769 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f106527b-0a36-446d-8ef0-acb731c17a30 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:12.124039 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-f106527b-0a36-446d-8ef0-acb731c17a30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:12.124039 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:12.124039 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:12.124039 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:12.124039 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:12.124039 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:12.124039 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:12.124039 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:12.124039 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:12.124039 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:12.124039 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:12.124039 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:12.124039 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:12:12.124039 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:12:12.124039 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:12:12.124039 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:12:12.125092 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:12.125092 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:12.125092 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:12.125092 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:12.125092 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:12.125092 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:12.125092 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:12.125092 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:12.125092 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:12.125092 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:12.125092 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:12.125092 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:12.125092 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:12.125092 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:12.125092 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:12.125092 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:12.125092 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:12:12.125944 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:12:12.125944 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:12.125944 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:12.125944 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 216/423] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 13:12:12.137320 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f562a-4199-4c7e-be23-250d3a696ef0 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:12.190236 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c8fb7-cdf1-483c-90ce-4ebeb9e06c5b None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:12.190549 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c8fb7-cdf1-483c-90ce-4ebeb9e06c5b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:12.190797 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c8fb7-cdf1-483c-90ce-4ebeb9e06c5b None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:12.192516 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 217/424] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:12.197814 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8042c01-bf66-40cf-ba96-b0de437b59ec None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:12.198089 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8042c01-bf66-40cf-ba96-b0de437b59ec None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:12.198362 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8042c01-bf66-40cf-ba96-b0de437b59ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:12.236438 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f8042c01-bf66-40cf-ba96-b0de437b59ec None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:12.237639 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f8042c01-bf66-40cf-ba96-b0de437b59ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:12.264832 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:12.276983 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f562a-4199-4c7e-be23-250d3a696ef0 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:12.315619 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2251e-7cee-422f-aa94-696539c2b4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:12.316792 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2251e-7cee-422f-aa94-696539c2b4b9 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:12.317220 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2251e-7cee-422f-aa94-696539c2b4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:12.317892 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2251e-7cee-422f-aa94-696539c2b4b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:12.319109 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e2251e-7cee-422f-aa94-696539c2b4b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:12.319838 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e2251e-7cee-422f-aa94-696539c2b4b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:12.321447 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e2251e-7cee-422f-aa94-696539c2b4b9 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:12.331919 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 218/425] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 25 13:12:12.331919 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b6877-e2cc-4249-a677-fbce461d44d9 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:12.331919 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b6877-e2cc-4249-a677-fbce461d44d9 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:12.331919 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b6877-e2cc-4249-a677-fbce461d44d9 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:12.331919 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 219/426] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:12.338459 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f21fbd-1620-460d-8b7c-a67f9813defb None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:12.338746 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f21fbd-1620-460d-8b7c-a67f9813defb None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:12.339018 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f21fbd-1620-460d-8b7c-a67f9813defb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:12.355991 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 208/427] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:12:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:12.361606 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2251e-7cee-422f-aa94-696539c2b4b9 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:12.371850 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e4f21fbd-1620-460d-8b7c-a67f9813defb None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:12.373353 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e4f21fbd-1620-460d-8b7c-a67f9813defb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:12.474231 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2251e-7cee-422f-aa94-696539c2b4b9 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:12.512432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75111b-01b6-4a66-a574-c32d4fdfe00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:12.513056 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75111b-01b6-4a66-a574-c32d4fdfe00f None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:12.513381 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75111b-01b6-4a66-a574-c32d4fdfe00f None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:12.513655 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75111b-01b6-4a66-a574-c32d4fdfe00f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:12.522098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75111b-01b6-4a66-a574-c32d4fdfe00f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:12.523787 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75111b-01b6-4a66-a574-c32d4fdfe00f None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:12.539531 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-cb75111b-01b6-4a66-a574-c32d4fdfe00f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 25 13:12:12.539531 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:12.539531 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:12.539531 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:12.539531 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:12.539531 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:12.539531 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:12.539531 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:12.539531 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:12.539531 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:12.539531 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:12.539531 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:12.539531 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 25 13:12:12.539531 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 25 13:12:12.539531 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 25 13:12:12.539531 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 25 13:12:12.540541 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:12.540541 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:12.540541 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 25 13:12:12.540541 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:12:12.540541 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 25 13:12:12.540541 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:12:12.540541 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:12.540541 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:12.540541 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:12.540541 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:12.540541 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:12.540541 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:12.540541 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:12.540541 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:12.540541 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:12.540541 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:12.540541 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:12.540541 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:12.541433 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:12.541433 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:12.541433 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 25 13:12:12.541433 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 25 13:12:12.541433 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 25 13:12:12.541433 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 25 13:12:12.541433 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 25 13:12:12.541433 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 25 13:12:12.541433 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 25 13:12:12.541433 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:12.541433 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 209/428] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 25 13:12:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 13:12:12.550398 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75111b-01b6-4a66-a574-c32d4fdfe00f None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:12.558652 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 220/429] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 25 13:12:12.572622 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:12.666292 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07101ac-d93d-4e1e-8b96-60214674de44 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:12.666669 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07101ac-d93d-4e1e-8b96-60214674de44 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:12.667016 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07101ac-d93d-4e1e-8b96-60214674de44 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:12.668990 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 221/430] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 13:12:12.674317 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6973b-8499-4936-bb12-776af84e3d03 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:12.674599 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6973b-8499-4936-bb12-776af84e3d03 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:12.674875 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6973b-8499-4936-bb12-776af84e3d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:12.698159 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-24c6973b-8499-4936-bb12-776af84e3d03 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:12.699403 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-24c6973b-8499-4936-bb12-776af84e3d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:12.703295 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75111b-01b6-4a66-a574-c32d4fdfe00f None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:12.706591 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:12.766891 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca045d40-a3d6-4f13-bbd8-913490a4669b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:12.767494 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca045d40-a3d6-4f13-bbd8-913490a4669b None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:12.767773 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca045d40-a3d6-4f13-bbd8-913490a4669b None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:12.768075 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca045d40-a3d6-4f13-bbd8-913490a4669b None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:12.769212 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca045d40-a3d6-4f13-bbd8-913490a4669b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:12.769578 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca045d40-a3d6-4f13-bbd8-913490a4669b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:12.771297 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca045d40-a3d6-4f13-bbd8-913490a4669b None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:12.796218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 222/431] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 25 13:12:12.797943 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6973b-8499-4936-bb12-776af84e3d03 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:12.806086 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 210/432] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Oct 25 13:12:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:12:12.811214 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca045d40-a3d6-4f13-bbd8-913490a4669b None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:12.912411 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:12.937989 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6973b-8499-4936-bb12-776af84e3d03 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:12.951854 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca045d40-a3d6-4f13-bbd8-913490a4669b None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:12.975545 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce13d30-c471-4631-b565-4c3e439332e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:12.976218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce13d30-c471-4631-b565-4c3e439332e5 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:12.976498 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce13d30-c471-4631-b565-4c3e439332e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:12.976771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce13d30-c471-4631-b565-4c3e439332e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:12.985011 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:12.988783 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce13d30-c471-4631-b565-4c3e439332e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:12:12.993935 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-7ce13d30-c471-4631-b565-4c3e439332e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 13:12:12.993935 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:12.993935 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:12.993935 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:12.993935 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:12.993935 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:12.993935 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:12.993935 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:12.993935 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:12.993935 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:12.993935 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:12.993935 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:12.993935 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:12:12.993935 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:12:12.993935 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:12:12.993935 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:12:12.994816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:12:12.994816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:12:12.994816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:12:12.994816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:12:12.994816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:12.994816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:12.994816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:12.994816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:12.994816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:12.994816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:12.994816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:12.994816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:12.994816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:12.994816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:12.994816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:12.994816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:12.995640 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:12.995640 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:12.995640 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:12.995640 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:12.995640 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:12:12.995640 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:12:12.995640 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:12:12.995640 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:12:12.995640 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:12:12.995640 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:12:12.995640 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 25 13:12:12.995640 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:12.996283 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad41ab4-e843-4e50-b537-db2263de07f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:12.996283 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad41ab4-e843-4e50-b537-db2263de07f3 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:12.996283 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad41ab4-e843-4e50-b537-db2263de07f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:12.996485 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad41ab4-e843-4e50-b537-db2263de07f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:12.997790 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 223/433] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 25 13:12:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:13.004304 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a231b1-00ed-43b7-b8c0-7be3e8d7e1e2 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:13.004592 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a231b1-00ed-43b7-b8c0-7be3e8d7e1e2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:13.004876 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a231b1-00ed-43b7-b8c0-7be3e8d7e1e2 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:13.006931 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 224/434] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:13.007648 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a231b1-00ed-43b7-b8c0-7be3e8d7e1e2 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:13.012647 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad41ab4-e843-4e50-b537-db2263de07f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:13.014309 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad41ab4-e843-4e50-b537-db2263de07f3 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:13.031867 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-bad41ab4-e843-4e50-b537-db2263de07f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:13.031867 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:13.031867 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:13.031867 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:13.031867 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:13.031867 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:13.031867 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:13.031867 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:13.031867 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:13.031867 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:13.031867 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:13.031867 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:13.031867 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:12:13.031867 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:12:13.031867 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:12:13.031867 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:12:13.032823 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:13.032823 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:13.032823 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:13.032823 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:13.032823 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:13.032823 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:13.032823 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:13.032823 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:13.032823 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:13.032823 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:13.032823 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:13.032823 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:13.032823 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:13.032823 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:13.032823 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:13.032823 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:13.032823 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:12:13.033686 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:12:13.033686 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:13.033686 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:13.033686 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 211/435] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:13.033906 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad41ab4-e843-4e50-b537-db2263de07f3 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:13.116117 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a231b1-00ed-43b7-b8c0-7be3e8d7e1e2 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:13.141896 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad41ab4-e843-4e50-b537-db2263de07f3 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:13.150143 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b37f3-2ed0-4349-9b54-0cb3cd245f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:13.150765 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b37f3-2ed0-4349-9b54-0cb3cd245f58 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:13.151042 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b37f3-2ed0-4349-9b54-0cb3cd245f58 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:13.151314 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b37f3-2ed0-4349-9b54-0cb3cd245f58 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:13.161878 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b37f3-2ed0-4349-9b54-0cb3cd245f58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:12:13.164516 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:13.166635 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-bb0b37f3-2ed0-4349-9b54-0cb3cd245f58 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 13:12:13.166635 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:13.166635 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:13.166635 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:13.166635 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:13.166635 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:13.166635 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:13.166635 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:13.166635 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:13.166635 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:13.166635 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:13.166635 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:13.166635 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:12:13.166635 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:12:13.166635 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:12:13.166635 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:12:13.167798 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:12:13.167798 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:12:13.167798 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:12:13.167798 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:12:13.167798 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:13.167798 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:13.167798 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:13.167798 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:13.167798 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:13.167798 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:13.167798 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:13.167798 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:13.167798 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:13.167798 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:13.167798 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:13.167798 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:13.168668 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:13.168668 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:13.168668 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:13.168668 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:13.168668 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:12:13.168668 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:12:13.168668 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:12:13.168668 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:12:13.168668 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:12:13.168668 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:12:13.168668 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 25 13:12:13.168668 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:13.168668 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 225/436] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 25 13:12:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:13.169324 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ee96c-ffce-4e36-9a41-30d2a824b34c None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:13.169388 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ee96c-ffce-4e36-9a41-30d2a824b34c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:13.169713 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ee96c-ffce-4e36-9a41-30d2a824b34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:13.182975 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611aaaaf-bf8d-40e9-a4ea-4c8fa477ecc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:13.183577 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611aaaaf-bf8d-40e9-a4ea-4c8fa477ecc1 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:13.183858 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611aaaaf-bf8d-40e9-a4ea-4c8fa477ecc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:13.184174 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611aaaaf-bf8d-40e9-a4ea-4c8fa477ecc1 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:13.184836 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611aaaaf-bf8d-40e9-a4ea-4c8fa477ecc1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:13.185138 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611aaaaf-bf8d-40e9-a4ea-4c8fa477ecc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:13.186502 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611aaaaf-bf8d-40e9-a4ea-4c8fa477ecc1 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:13.188320 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-378ee96c-ffce-4e36-9a41-30d2a824b34c None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:13.189516 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-378ee96c-ffce-4e36-9a41-30d2a824b34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:13.194534 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 212/437] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 25 13:12:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:13.195317 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611aaaaf-bf8d-40e9-a4ea-4c8fa477ecc1 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:13.241950 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:13.257115 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 226/438] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:12:13.257923 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ee96c-ffce-4e36-9a41-30d2a824b34c None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:13.301851 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611aaaaf-bf8d-40e9-a4ea-4c8fa477ecc1 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:13.336802 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36356f31-8744-4fa0-8404-aa972360673c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:13.337401 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36356f31-8744-4fa0-8404-aa972360673c None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:13.337683 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36356f31-8744-4fa0-8404-aa972360673c None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:13.337956 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36356f31-8744-4fa0-8404-aa972360673c None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:13.338585 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36356f31-8744-4fa0-8404-aa972360673c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:13.338889 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36356f31-8744-4fa0-8404-aa972360673c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:13.340313 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36356f31-8744-4fa0-8404-aa972360673c None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:13.356771 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 213/439] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:13.356771 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36356f31-8744-4fa0-8404-aa972360673c None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:13.385090 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ee96c-ffce-4e36-9a41-30d2a824b34c None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:13.401166 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:13.421086 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0e9e8-fa22-45fd-b1ba-762aaec9fb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:13.421821 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0e9e8-fa22-45fd-b1ba-762aaec9fb22 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:13.422174 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0e9e8-fa22-45fd-b1ba-762aaec9fb22 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:13.422532 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0e9e8-fa22-45fd-b1ba-762aaec9fb22 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:13.433914 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d0e9e8-fa22-45fd-b1ba-762aaec9fb22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:12:13.439383 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-66d0e9e8-fa22-45fd-b1ba-762aaec9fb22 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 13:12:13.439383 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:13.439383 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:13.439383 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:13.439383 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:13.439383 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:13.439383 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:13.439383 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:13.439383 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:13.439383 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:13.439383 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:13.439383 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:13.439383 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:12:13.439383 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:12:13.439383 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:12:13.439383 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:12:13.440282 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:12:13.440282 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:12:13.440282 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:12:13.440282 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:12:13.440282 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:13.440282 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:13.440282 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:13.440282 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:13.440282 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:13.440282 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:13.440282 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:13.440282 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:13.440282 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:13.440282 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:13.440282 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:13.440282 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:13.441115 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:13.441115 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:13.441115 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:13.441115 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:13.441115 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:12:13.441115 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:12:13.441115 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:12:13.441115 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:12:13.441115 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:12:13.441115 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:12:13.441115 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 25 13:12:13.441115 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:13.441115 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 227/440] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 25 13:12:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:13.441788 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0e9e8-fa22-45fd-b1ba-762aaec9fb22 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:13.463987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36356f31-8744-4fa0-8404-aa972360673c None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:13.494068 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:13.501382 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbfa0b-491b-4836-af29-e5a07ee5f26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:13.501988 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbfa0b-491b-4836-af29-e5a07ee5f26a None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:13.502436 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbfa0b-491b-4836-af29-e5a07ee5f26a None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:13.502710 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbfa0b-491b-4836-af29-e5a07ee5f26a None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:13.503709 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcbfa0b-491b-4836-af29-e5a07ee5f26a None admin] RBAC: Adding query filter params (name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:13.504045 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcbfa0b-491b-4836-af29-e5a07ee5f26a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:13.505445 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcbfa0b-491b-4836-af29-e5a07ee5f26a None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:13.513676 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 214/441] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 25 13:12:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:13.514997 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbfa0b-491b-4836-af29-e5a07ee5f26a None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:13.548615 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0e9e8-fa22-45fd-b1ba-762aaec9fb22 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:13.582288 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe0141-f992-4a41-9da3-74473569d69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:13.582907 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe0141-f992-4a41-9da3-74473569d69a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:13.583188 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe0141-f992-4a41-9da3-74473569d69a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:13.583462 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe0141-f992-4a41-9da3-74473569d69a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:13.595183 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe0141-f992-4a41-9da3-74473569d69a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:13.596659 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe0141-f992-4a41-9da3-74473569d69a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:13.610867 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-3afe0141-f992-4a41-9da3-74473569d69a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:13.610867 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:13.610867 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:13.610867 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:13.610867 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:13.610867 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:13.610867 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:13.610867 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:13.610867 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:13.610867 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:13.610867 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:13.610867 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:13.610867 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:12:13.610867 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:12:13.610867 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:12:13.610867 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:12:13.611823 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:13.611823 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:13.611823 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:13.611823 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:13.611823 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:13.611823 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:13.611823 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:13.611823 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:13.611823 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:13.611823 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:13.611823 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:13.611823 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:13.611823 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:13.611823 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:13.611823 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:13.611823 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:13.611823 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:12:13.612697 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:12:13.612697 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:13.612697 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:13.612697 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 228/442] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:13.612918 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe0141-f992-4a41-9da3-74473569d69a None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:13.623554 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbfa0b-491b-4836-af29-e5a07ee5f26a None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:13.630532 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:13.657642 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d287e4-dc50-47cd-b059-542c425dc9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:13.658266 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d287e4-dc50-47cd-b059-542c425dc9ab None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:13.658577 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d287e4-dc50-47cd-b059-542c425dc9ab None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:13.658846 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d287e4-dc50-47cd-b059-542c425dc9ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:13.665520 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d287e4-dc50-47cd-b059-542c425dc9ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:13.666963 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d287e4-dc50-47cd-b059-542c425dc9ab None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:13.678895 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-62d287e4-dc50-47cd-b059-542c425dc9ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:12:13.678895 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:13.678895 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:13.678895 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:13.678895 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:13.678895 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:13.678895 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:13.678895 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:13.678895 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:13.678895 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:13.678895 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:13.678895 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:13.678895 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 25 13:12:13.678895 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 25 13:12:13.678895 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 25 13:12:13.679877 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 25 13:12:13.679877 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:13.679877 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:13.679877 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:13.679877 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:13.679877 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:13.679877 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:13.679877 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:13.679877 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:13.679877 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:13.679877 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:13.679877 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:13.679877 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:13.679877 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:13.679877 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:13.679877 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:13.679877 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:13.680960 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 25 13:12:13.680960 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 25 13:12:13.680960 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 25 13:12:13.680960 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 25 13:12:13.680960 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 25 13:12:13.680960 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 25 13:12:13.680960 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:12:13.680960 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:13.680960 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 215/443] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 25 13:12:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:13.680960 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d287e4-dc50-47cd-b059-542c425dc9ab None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:13.713330 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:13.716596 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe0141-f992-4a41-9da3-74473569d69a None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:13.752270 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e9cd7-886d-45d8-b861-15685da52b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:13.752957 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e9cd7-886d-45d8-b861-15685da52b07 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:13.753234 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e9cd7-886d-45d8-b861-15685da52b07 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:13.753505 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e9cd7-886d-45d8-b861-15685da52b07 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:13.754159 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e9cd7-886d-45d8-b861-15685da52b07 None admin] RBAC: Adding query filter params (name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:13.754461 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e9cd7-886d-45d8-b861-15685da52b07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:13.755821 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e9cd7-886d-45d8-b861-15685da52b07 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:13.763844 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 229/444] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 25 13:12:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:13.764646 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e9cd7-886d-45d8-b861-15685da52b07 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:13.785573 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d287e4-dc50-47cd-b059-542c425dc9ab None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:13.819106 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133effe0-825e-4efb-867b-163a3126a671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:13.819722 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133effe0-825e-4efb-867b-163a3126a671 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:13.820031 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133effe0-825e-4efb-867b-163a3126a671 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:13.820312 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133effe0-825e-4efb-867b-163a3126a671 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:13.831480 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133effe0-825e-4efb-867b-163a3126a671 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:13.832978 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133effe0-825e-4efb-867b-163a3126a671 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:13.847072 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-133effe0-825e-4efb-867b-163a3126a671 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:13.847072 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:13.847072 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:13.847072 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:13.847072 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:13.847072 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:13.847072 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:13.847072 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:13.847072 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:13.847072 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:13.847072 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:13.847072 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:13.847072 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:12:13.847072 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:12:13.847072 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:12:13.847072 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:12:13.848198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:13.848198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:13.848198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:13.848198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:13.848198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:13.848198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:13.848198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:13.848198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:13.848198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:13.848198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:13.848198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:13.848198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:13.848198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:13.848198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:13.848198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:13.848198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:13.848198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:12:13.849422 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:12:13.849422 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:13.849422 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:13.849422 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 216/445] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:13.849422 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133effe0-825e-4efb-867b-163a3126a671 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:13.867541 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e9cd7-886d-45d8-b861-15685da52b07 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:13.868499 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:13.902550 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52554533-b03e-4c8c-8bda-098ac5c4859e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:13.903178 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52554533-b03e-4c8c-8bda-098ac5c4859e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:13.903459 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52554533-b03e-4c8c-8bda-098ac5c4859e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:13.903735 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52554533-b03e-4c8c-8bda-098ac5c4859e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:13.913796 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52554533-b03e-4c8c-8bda-098ac5c4859e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:12:13.919145 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-52554533-b03e-4c8c-8bda-098ac5c4859e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 13:12:13.919145 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:13.919145 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:13.919145 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:13.919145 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:13.919145 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:13.919145 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:13.919145 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:13.919145 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:13.919145 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:13.919145 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:13.919145 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:13.919145 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:12:13.919145 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:12:13.919145 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:12:13.919145 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:12:13.920280 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:12:13.920280 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:12:13.920280 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:12:13.920280 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:12:13.920280 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:13.920280 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:13.920280 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:13.920280 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:13.920280 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:13.920280 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:13.920280 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:13.920280 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:13.920280 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:13.920280 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:13.920280 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:13.920280 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:13.921228 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:13.921228 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:13.921228 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:13.921228 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:13.921228 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:12:13.921228 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:12:13.921228 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:12:13.921228 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:12:13.921228 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:12:13.921228 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:12:13.921228 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 25 13:12:13.921228 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:13.921228 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 230/446] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 25 13:12:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:13.924556 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52554533-b03e-4c8c-8bda-098ac5c4859e None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:13.948303 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133effe0-825e-4efb-867b-163a3126a671 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:13.948595 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:13.981863 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff57be-928a-49bc-9f85-f196a4e68915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:13.982461 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff57be-928a-49bc-9f85-f196a4e68915 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:13.982744 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff57be-928a-49bc-9f85-f196a4e68915 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:13.983018 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff57be-928a-49bc-9f85-f196a4e68915 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:13.983646 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff57be-928a-49bc-9f85-f196a4e68915 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:13.983993 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff57be-928a-49bc-9f85-f196a4e68915 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:13.985430 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff57be-928a-49bc-9f85-f196a4e68915 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:13.996730 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 217/447] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:13.997516 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff57be-928a-49bc-9f85-f196a4e68915 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:14.026841 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52554533-b03e-4c8c-8bda-098ac5c4859e None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:14.061028 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c80e25-172b-4cef-bcbd-fddb2265a799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:14.061619 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c80e25-172b-4cef-bcbd-fddb2265a799 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:14.061909 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c80e25-172b-4cef-bcbd-fddb2265a799 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:14.062751 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c80e25-172b-4cef-bcbd-fddb2265a799 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:14.063462 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c80e25-172b-4cef-bcbd-fddb2265a799 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:14.063768 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c80e25-172b-4cef-bcbd-fddb2265a799 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:14.065221 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c80e25-172b-4cef-bcbd-fddb2265a799 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:14.073836 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:14.077524 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 231/448] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 25 13:12:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:14.078944 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c80e25-172b-4cef-bcbd-fddb2265a799 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:14.096459 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff57be-928a-49bc-9f85-f196a4e68915 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:14.130765 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424a033-5280-47fb-b17e-199fac157689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:14.131387 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424a033-5280-47fb-b17e-199fac157689 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:14.131661 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424a033-5280-47fb-b17e-199fac157689 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:14.131954 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424a033-5280-47fb-b17e-199fac157689 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:14.142587 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e424a033-5280-47fb-b17e-199fac157689 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:14.144036 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e424a033-5280-47fb-b17e-199fac157689 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:14.158951 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-e424a033-5280-47fb-b17e-199fac157689 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:14.158951 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:14.158951 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:14.158951 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:14.158951 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:14.158951 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:14.158951 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:14.158951 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:14.158951 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:14.158951 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:14.158951 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:14.158951 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:14.158951 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:12:14.158951 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:12:14.158951 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:12:14.158951 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:12:14.159949 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:14.159949 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:14.159949 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:14.159949 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:14.159949 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:14.159949 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:14.159949 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:14.159949 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:14.159949 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:14.159949 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:14.159949 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:14.159949 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:14.159949 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:14.159949 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:14.159949 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:14.159949 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:14.159949 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:12:14.160790 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:12:14.160790 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:14.160790 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:14.160961 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:14.161325 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 218/449] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:14.161325 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424a033-5280-47fb-b17e-199fac157689 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:14.182416 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c80e25-172b-4cef-bcbd-fddb2265a799 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:14.216226 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57dae64-5c3e-423e-86ab-435db49c3bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:14.216772 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57dae64-5c3e-423e-86ab-435db49c3bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:14.217053 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57dae64-5c3e-423e-86ab-435db49c3bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:14.217325 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57dae64-5c3e-423e-86ab-435db49c3bc7 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:14.217954 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57dae64-5c3e-423e-86ab-435db49c3bc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:14.218259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57dae64-5c3e-423e-86ab-435db49c3bc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:14.220381 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57dae64-5c3e-423e-86ab-435db49c3bc7 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:14.231961 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 232/450] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:14.232749 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57dae64-5c3e-423e-86ab-435db49c3bc7 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:14.263885 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424a033-5280-47fb-b17e-199fac157689 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:14.291939 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:14.298978 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9043dc-fba7-4bb0-8e1a-f527bae52b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:14.299575 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9043dc-fba7-4bb0-8e1a-f527bae52b38 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:14.299855 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9043dc-fba7-4bb0-8e1a-f527bae52b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:14.300154 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9043dc-fba7-4bb0-8e1a-f527bae52b38 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:14.300807 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9043dc-fba7-4bb0-8e1a-f527bae52b38 None admin] RBAC: Adding query filter params (name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:14.301109 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9043dc-fba7-4bb0-8e1a-f527bae52b38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:14.302483 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9043dc-fba7-4bb0-8e1a-f527bae52b38 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:14.310409 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 219/451] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 25 13:12:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:14.311228 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9043dc-fba7-4bb0-8e1a-f527bae52b38 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:14.340351 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57dae64-5c3e-423e-86ab-435db49c3bc7 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:14.373705 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c5301-4b1e-4636-bb09-bbc5bcefb52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:14.374326 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c5301-4b1e-4636-bb09-bbc5bcefb52c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:14.374608 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c5301-4b1e-4636-bb09-bbc5bcefb52c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:14.375435 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c5301-4b1e-4636-bb09-bbc5bcefb52c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:14.382663 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c5301-4b1e-4636-bb09-bbc5bcefb52c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:14.384127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c5301-4b1e-4636-bb09-bbc5bcefb52c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:14.394966 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-cd6c5301-4b1e-4636-bb09-bbc5bcefb52c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 25 13:12:14.394966 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:14.394966 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:14.394966 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:14.394966 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:14.394966 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:14.394966 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:14.394966 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:14.394966 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:14.394966 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:14.394966 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:14.394966 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:14.394966 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 25 13:12:14.394966 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 25 13:12:14.394966 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 25 13:12:14.394966 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 25 13:12:14.395838 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:14.395838 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:14.395838 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 25 13:12:14.395838 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:12:14.395838 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 25 13:12:14.395838 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:12:14.395838 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:14.395838 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:14.395838 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:14.395838 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:14.395838 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:14.395838 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:14.395838 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:14.395838 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:14.395838 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:14.395838 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:14.395838 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:14.395838 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:14.396756 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:14.396756 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:14.396756 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 25 13:12:14.396756 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 25 13:12:14.396756 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 25 13:12:14.396756 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 25 13:12:14.396756 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 25 13:12:14.396756 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 25 13:12:14.396756 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 25 13:12:14.396756 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:14.400257 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 233/452] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Oct 25 13:12:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:14.401196 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c5301-4b1e-4636-bb09-bbc5bcefb52c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:14.403718 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:14.409277 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9043dc-fba7-4bb0-8e1a-f527bae52b38 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:14.443483 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c3130-ac6a-4c18-b42e-60fcd6f6c9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:14.444160 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c3130-ac6a-4c18-b42e-60fcd6f6c9b3 None admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:14.444446 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c3130-ac6a-4c18-b42e-60fcd6f6c9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:14.444722 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c3130-ac6a-4c18-b42e-60fcd6f6c9b3 None admin] PATH_INFO: `/v3/projects/616ecfe8d2c74aad9386720718392e81/users/07413369b0c14e878d04ee528487801d/roles/b3a463dfc621439eaee93c0551a4e296` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:14.458950 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c3130-ac6a-4c18-b42e-60fcd6f6c9b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=616ecfe8d2c74aad9386720718392e81, user_id=07413369b0c14e878d04ee528487801d, role_id=b3a463dfc621439eaee93c0551a4e296)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:14.460438 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c3130-ac6a-4c18-b42e-60fcd6f6c9b3 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:14.473115 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 220/453] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 25 13:12:14 2022] PUT /identity/v3/projects/616ecfe8d2c74aad9386720718392e81/users/07413369b0c14e878d04ee528487801d/roles/b3a463dfc621439eaee93c0551a4e296 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:12:14.473840 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c3130-ac6a-4c18-b42e-60fcd6f6c9b3 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:14.517850 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c5301-4b1e-4636-bb09-bbc5bcefb52c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:14.520522 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:14.561698 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e435e-6cbd-4b28-91ca-751c9d63c8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:14.563146 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e435e-6cbd-4b28-91ca-751c9d63c8b0 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:14.563864 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e435e-6cbd-4b28-91ca-751c9d63c8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:14.564083 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e435e-6cbd-4b28-91ca-751c9d63c8b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:14.564746 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e435e-6cbd-4b28-91ca-751c9d63c8b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:14.565061 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e435e-6cbd-4b28-91ca-751c9d63c8b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:14.566455 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e435e-6cbd-4b28-91ca-751c9d63c8b0 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:14.582704 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 234/454] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:14.582704 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e435e-6cbd-4b28-91ca-751c9d63c8b0 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:14.594827 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c3130-ac6a-4c18-b42e-60fcd6f6c9b3 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:14.640530 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76914f77-aef1-4877-9577-d4dc85b534d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:14.641559 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76914f77-aef1-4877-9577-d4dc85b534d9 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:14.641917 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76914f77-aef1-4877-9577-d4dc85b534d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:14.642397 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76914f77-aef1-4877-9577-d4dc85b534d9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:14.650477 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76914f77-aef1-4877-9577-d4dc85b534d9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:14.651963 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76914f77-aef1-4877-9577-d4dc85b534d9 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:14.661643 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:14.666814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-76914f77-aef1-4877-9577-d4dc85b534d9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 25 13:12:14.666814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:14.666814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:14.666814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:14.666814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:14.666814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:14.666814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:14.666814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:14.666814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:14.666814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:14.666814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:14.666814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:14.666814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 25 13:12:14.666814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 25 13:12:14.666814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 25 13:12:14.666814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 25 13:12:14.668170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:14.668170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:14.668170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 25 13:12:14.668170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:12:14.668170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 25 13:12:14.668170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:12:14.668170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:14.668170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:14.668170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:14.668170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:14.668170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:14.668170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:14.668170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:14.668170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:14.668170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:14.668170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:14.668170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:14.668170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:14.672766 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:14.672766 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:14.672766 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 25 13:12:14.672766 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 25 13:12:14.672766 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 25 13:12:14.672766 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 25 13:12:14.672766 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 25 13:12:14.672766 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 25 13:12:14.672766 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 25 13:12:14.672766 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:14.672766 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 221/455] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 25 13:12:14 2022] GET /identity/v3/users/glance => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:14.672766 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76914f77-aef1-4877-9577-d4dc85b534d9 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:14.710856 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e435e-6cbd-4b28-91ca-751c9d63c8b0 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:14.758725 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad9cd8-82d8-43c0-8124-9e90f77b7202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:14.759443 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad9cd8-82d8-43c0-8124-9e90f77b7202 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:14.759719 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad9cd8-82d8-43c0-8124-9e90f77b7202 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:14.760035 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad9cd8-82d8-43c0-8124-9e90f77b7202 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:14.772864 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad9cd8-82d8-43c0-8124-9e90f77b7202 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:14.774490 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad9cd8-82d8-43c0-8124-9e90f77b7202 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:14.790627 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76914f77-aef1-4877-9577-d4dc85b534d9 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:14.792596 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:14.792925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-9bad9cd8-82d8-43c0-8124-9e90f77b7202 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:14.792925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:14.792925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:14.792925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:14.792925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:14.792925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:14.792925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:14.792925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:14.792925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:14.792925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:14.792925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:14.792925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:14.792925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:12:14.792925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:12:14.792925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:12:14.792925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:12:14.793852 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:14.793852 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:14.793852 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:14.793852 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:14.793852 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:14.793852 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:14.793852 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:14.793852 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:14.793852 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:14.793852 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:14.793852 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:14.793852 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:14.793852 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:14.793852 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:14.793852 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:14.793852 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:14.793852 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:12:14.794789 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:12:14.794789 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:14.794789 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:14.796456 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 235/456] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:14.797580 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad9cd8-82d8-43c0-8124-9e90f77b7202 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:14.844834 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7571f96-634a-41a4-8c5d-2fd3fa246278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:14.845462 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7571f96-634a-41a4-8c5d-2fd3fa246278 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:14.845798 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7571f96-634a-41a4-8c5d-2fd3fa246278 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:14.846067 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7571f96-634a-41a4-8c5d-2fd3fa246278 None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:14.846849 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7571f96-634a-41a4-8c5d-2fd3fa246278 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:14.847249 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7571f96-634a-41a4-8c5d-2fd3fa246278 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:14.848860 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7571f96-634a-41a4-8c5d-2fd3fa246278 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:14.871344 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 222/457] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Oct 25 13:12:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:14.872277 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7571f96-634a-41a4-8c5d-2fd3fa246278 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:14.927385 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad9cd8-82d8-43c0-8124-9e90f77b7202 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:14.947530 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:14.975833 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e09b81-b545-47c6-b3f8-ab7638a12956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:14.976500 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e09b81-b545-47c6-b3f8-ab7638a12956 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:14.976773 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e09b81-b545-47c6-b3f8-ab7638a12956 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:14.977121 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e09b81-b545-47c6-b3f8-ab7638a12956 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:14.985692 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e09b81-b545-47c6-b3f8-ab7638a12956 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:14.987159 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e09b81-b545-47c6-b3f8-ab7638a12956 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:14.998871 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7571f96-634a-41a4-8c5d-2fd3fa246278 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:14.999045 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-d8e09b81-b545-47c6-b3f8-ab7638a12956 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 25 13:12:14.999045 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:14.999045 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:14.999045 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:14.999045 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:14.999045 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:14.999045 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:14.999045 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:14.999045 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:14.999045 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:14.999045 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:14.999045 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:14.999045 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 25 13:12:14.999045 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 25 13:12:14.999045 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 25 13:12:14.999045 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 25 13:12:15.000492 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:15.000492 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:15.000492 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 25 13:12:15.000492 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:12:15.000492 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 25 13:12:15.000492 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:12:15.000492 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:15.000492 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:15.000492 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:15.000492 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:15.000492 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:15.000492 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:15.000492 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:15.000492 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:15.000492 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:15.000492 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:15.000492 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:15.000492 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:15.007299 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:15.007299 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:15.007299 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 25 13:12:15.007299 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 25 13:12:15.007299 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 25 13:12:15.007299 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 25 13:12:15.007299 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 25 13:12:15.007299 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 25 13:12:15.007299 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 25 13:12:15.007299 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:15.007299 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 236/458] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 25 13:12:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:15.007299 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e09b81-b545-47c6-b3f8-ab7638a12956 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:15.053568 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb26baf-86d9-44a7-b3e2-7151feef4964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:15.054556 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb26baf-86d9-44a7-b3e2-7151feef4964 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:15.054833 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb26baf-86d9-44a7-b3e2-7151feef4964 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:15.055107 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb26baf-86d9-44a7-b3e2-7151feef4964 None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:15.056265 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb26baf-86d9-44a7-b3e2-7151feef4964 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:15.056579 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb26baf-86d9-44a7-b3e2-7151feef4964 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:15.058117 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb26baf-86d9-44a7-b3e2-7151feef4964 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:15.079932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 223/459] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Oct 25 13:12:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:15.080825 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb26baf-86d9-44a7-b3e2-7151feef4964 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:15.109436 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:15.125708 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e09b81-b545-47c6-b3f8-ab7638a12956 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:15.167067 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21330d-af52-4c69-a959-831f5b592d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:15.167980 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21330d-af52-4c69-a959-831f5b592d8d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:15.168207 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21330d-af52-4c69-a959-831f5b592d8d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:15.168471 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21330d-af52-4c69-a959-831f5b592d8d None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:15.169103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f21330d-af52-4c69-a959-831f5b592d8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:15.169399 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f21330d-af52-4c69-a959-831f5b592d8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:15.170772 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f21330d-af52-4c69-a959-831f5b592d8d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:15.183833 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 237/460] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:15.184487 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21330d-af52-4c69-a959-831f5b592d8d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:15.224969 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb26baf-86d9-44a7-b3e2-7151feef4964 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:15.232913 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:15.264967 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3129096-5384-4e63-ad79-2fb310d3bdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:15.266897 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3129096-5384-4e63-ad79-2fb310d3bdac None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:15.267177 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3129096-5384-4e63-ad79-2fb310d3bdac None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:15.267437 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3129096-5384-4e63-ad79-2fb310d3bdac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:15.314929 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21330d-af52-4c69-a959-831f5b592d8d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:15.350854 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3129096-5384-4e63-ad79-2fb310d3bdac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:15.352354 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3129096-5384-4e63-ad79-2fb310d3bdac None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:15.355461 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae38ad-ac4e-444f-8d82-0b87e67ebc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:15.356108 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae38ad-ac4e-444f-8d82-0b87e67ebc1a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:15.356389 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae38ad-ac4e-444f-8d82-0b87e67ebc1a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:15.356664 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae38ad-ac4e-444f-8d82-0b87e67ebc1a None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:15.357392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae38ad-ac4e-444f-8d82-0b87e67ebc1a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:15.357700 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae38ad-ac4e-444f-8d82-0b87e67ebc1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:15.359371 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae38ad-ac4e-444f-8d82-0b87e67ebc1a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:15.372557 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:15.380314 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 238/461] 10.222.0.25 () {56 vars in 1139 bytes} [Tue Oct 25 13:12:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:15.381185 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae38ad-ac4e-444f-8d82-0b87e67ebc1a None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:15.480405 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 224/462] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 25 13:12:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 25 13:12:15.481598 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3129096-5384-4e63-ad79-2fb310d3bdac None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:15.501793 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:15.515117 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae38ad-ac4e-444f-8d82-0b87e67ebc1a None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:15.567541 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f466737-5a15-4f17-99f6-4b64d462ade3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:15.568196 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f466737-5a15-4f17-99f6-4b64d462ade3 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:15.568564 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f466737-5a15-4f17-99f6-4b64d462ade3 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:15.568751 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f466737-5a15-4f17-99f6-4b64d462ade3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:15.593834 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3129096-5384-4e63-ad79-2fb310d3bdac None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:15.613814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:15.635095 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759bf52-5cce-4395-b7eb-203e693b7e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:15.635721 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759bf52-5cce-4395-b7eb-203e693b7e6c None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:15.636038 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759bf52-5cce-4395-b7eb-203e693b7e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:15.636315 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759bf52-5cce-4395-b7eb-203e693b7e6c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:15.644482 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3759bf52-5cce-4395-b7eb-203e693b7e6c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:15.645941 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3759bf52-5cce-4395-b7eb-203e693b7e6c None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:15.658473 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f466737-5a15-4f17-99f6-4b64d462ade3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:15.659211 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-3759bf52-5cce-4395-b7eb-203e693b7e6c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 25 13:12:15.659211 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:15.659211 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:15.659211 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:15.659211 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:15.659211 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:15.659211 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:15.659211 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:15.659211 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:15.659211 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:15.659211 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:15.659211 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:15.659211 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 25 13:12:15.659211 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 25 13:12:15.659211 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 25 13:12:15.659211 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 25 13:12:15.661000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:15.661000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:15.661000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 25 13:12:15.661000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:12:15.661000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 25 13:12:15.661000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:12:15.661000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:15.661000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:15.661000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:15.661000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:15.661000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:15.661000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:15.661000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:15.661000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:15.661000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:15.661000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:15.661000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:15.661000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:15.662076 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:15.662076 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:15.662076 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 25 13:12:15.662076 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 25 13:12:15.662076 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 25 13:12:15.662076 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 25 13:12:15.662076 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 25 13:12:15.662076 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 25 13:12:15.662076 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 25 13:12:15.662076 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:15.667010 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f466737-5a15-4f17-99f6-4b64d462ade3 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:15.667117 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 225/463] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 25 13:12:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:15.667117 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759bf52-5cce-4395-b7eb-203e693b7e6c None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:15.768199 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:15.778988 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 239/464] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 25 13:12:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 25 13:12:15.779649 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f466737-5a15-4f17-99f6-4b64d462ade3 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:15.786522 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759bf52-5cce-4395-b7eb-203e693b7e6c None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:15.823047 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348aa61e-feef-4ae0-9cb4-b231a60e3b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:15.823655 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348aa61e-feef-4ae0-9cb4-b231a60e3b34 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:15.823955 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348aa61e-feef-4ae0-9cb4-b231a60e3b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:15.824233 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348aa61e-feef-4ae0-9cb4-b231a60e3b34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:15.870309 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:15.890924 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f466737-5a15-4f17-99f6-4b64d462ade3 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:15.892696 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348aa61e-feef-4ae0-9cb4-b231a60e3b34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:15.894159 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348aa61e-feef-4ae0-9cb4-b231a60e3b34 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:15.927864 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8c3d9-1671-42de-a2f9-338cdb45ff61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:15.928730 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8c3d9-1671-42de-a2f9-338cdb45ff61 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:15.929154 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8c3d9-1671-42de-a2f9-338cdb45ff61 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:15.929570 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8c3d9-1671-42de-a2f9-338cdb45ff61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:15.940382 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8c3d9-1671-42de-a2f9-338cdb45ff61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:15.942105 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8c3d9-1671-42de-a2f9-338cdb45ff61 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:15.960678 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-8bc8c3d9-1671-42de-a2f9-338cdb45ff61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:15.960678 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:15.960678 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:15.960678 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:15.960678 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:15.960678 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:15.960678 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:15.960678 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:15.960678 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:15.960678 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:15.960678 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:15.960678 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:15.960678 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:12:15.960678 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:12:15.960678 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:12:15.960678 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:12:15.961630 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:15.961630 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:15.961630 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:15.961630 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:15.961630 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:15.961630 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:15.961630 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:15.961630 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:15.961630 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:15.961630 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:15.961630 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:15.961630 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:15.961630 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:15.961630 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:15.961630 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:15.961630 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:15.961630 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:12:15.962460 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:12:15.962460 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:15.962460 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:15.962460 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 240/465] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:15.962693 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8c3d9-1671-42de-a2f9-338cdb45ff61 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:16.004307 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 226/466] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 25 13:12:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 25 13:12:16.005343 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348aa61e-feef-4ae0-9cb4-b231a60e3b34 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:16.015918 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:16.077129 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8c3d9-1671-42de-a2f9-338cdb45ff61 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:16.084116 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:16.110348 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348aa61e-feef-4ae0-9cb4-b231a60e3b34 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:16.115022 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bf07f-a509-4363-bff4-6f8d93a39a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:16.115635 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bf07f-a509-4363-bff4-6f8d93a39a92 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:16.115982 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bf07f-a509-4363-bff4-6f8d93a39a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:16.116210 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bf07f-a509-4363-bff4-6f8d93a39a92 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:16.116921 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27bf07f-a509-4363-bff4-6f8d93a39a92 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:16.117228 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27bf07f-a509-4363-bff4-6f8d93a39a92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:16.118663 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27bf07f-a509-4363-bff4-6f8d93a39a92 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:16.136709 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 241/467] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Oct 25 13:12:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:16.136709 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bf07f-a509-4363-bff4-6f8d93a39a92 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:16.150329 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ecbdfd-2fc5-42bb-aa1b-a55bdb280957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:16.150954 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecbdfd-2fc5-42bb-aa1b-a55bdb280957 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:16.151235 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecbdfd-2fc5-42bb-aa1b-a55bdb280957 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:16.151505 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecbdfd-2fc5-42bb-aa1b-a55bdb280957 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:16.162086 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ecbdfd-2fc5-42bb-aa1b-a55bdb280957 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:16.163544 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ecbdfd-2fc5-42bb-aa1b-a55bdb280957 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:16.178440 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-86ecbdfd-2fc5-42bb-aa1b-a55bdb280957 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:16.178440 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:16.178440 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:16.178440 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:16.178440 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:16.178440 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:16.178440 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:16.178440 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:16.178440 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:16.178440 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:16.178440 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:16.178440 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:16.178440 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:12:16.178440 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:12:16.178440 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:12:16.178440 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:12:16.179518 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:16.179518 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:16.179518 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:16.179518 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:16.179518 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:16.179518 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:16.179518 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:16.179518 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:16.179518 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:16.179518 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:16.179518 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:16.179518 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:16.179518 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:16.179518 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:16.179518 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:16.179518 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:16.179518 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:12:16.180389 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:12:16.180389 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:16.180389 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:16.180389 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 227/468] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:16.180609 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ecbdfd-2fc5-42bb-aa1b-a55bdb280957 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:16.252436 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bf07f-a509-4363-bff4-6f8d93a39a92 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:16.254180 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:16.292183 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb3b11-154c-432a-8cac-36c0dca7a456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:16.293120 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb3b11-154c-432a-8cac-36c0dca7a456 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:16.293467 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb3b11-154c-432a-8cac-36c0dca7a456 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:16.293801 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb3b11-154c-432a-8cac-36c0dca7a456 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:16.294263 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ecbdfd-2fc5-42bb-aa1b-a55bdb280957 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:16.294687 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb3b11-154c-432a-8cac-36c0dca7a456 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:16.294912 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb3b11-154c-432a-8cac-36c0dca7a456 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:16.296376 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb3b11-154c-432a-8cac-36c0dca7a456 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:16.310033 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 242/469] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:16.310868 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb3b11-154c-432a-8cac-36c0dca7a456 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:16.334154 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:16.340316 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38feae14-b611-4f96-ad3c-1679857304a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:16.341069 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38feae14-b611-4f96-ad3c-1679857304a3 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:16.341381 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38feae14-b611-4f96-ad3c-1679857304a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:16.341716 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38feae14-b611-4f96-ad3c-1679857304a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:16.353293 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38feae14-b611-4f96-ad3c-1679857304a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:16.354808 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38feae14-b611-4f96-ad3c-1679857304a3 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:16.371364 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-38feae14-b611-4f96-ad3c-1679857304a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:16.371364 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:16.371364 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:16.371364 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:16.371364 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:16.371364 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:16.371364 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:16.371364 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:16.371364 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:16.371364 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:16.371364 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:16.371364 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:16.371364 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:12:16.371364 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:12:16.371364 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:12:16.371364 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:12:16.372476 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:16.372476 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:16.372476 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:16.372476 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:16.372476 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:16.372476 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:16.372476 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:16.372476 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:16.372476 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:16.372476 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:16.372476 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:16.372476 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:16.372476 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:16.372476 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:16.372476 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:16.372476 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:16.372476 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:12:16.380252 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:12:16.380252 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:16.380252 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:16.380252 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 228/470] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:16.380252 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38feae14-b611-4f96-ad3c-1679857304a3 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:16.419394 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb3b11-154c-432a-8cac-36c0dca7a456 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:16.456088 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521ec69-e357-4c70-8873-b9b0ba143c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:16.456691 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521ec69-e357-4c70-8873-b9b0ba143c2a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:16.456970 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521ec69-e357-4c70-8873-b9b0ba143c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:16.457243 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521ec69-e357-4c70-8873-b9b0ba143c2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:16.490772 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:16.508509 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38feae14-b611-4f96-ad3c-1679857304a3 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:16.533425 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521ec69-e357-4c70-8873-b9b0ba143c2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:16.534878 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521ec69-e357-4c70-8873-b9b0ba143c2a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:16.544336 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50165221-bc28-4906-8c05-ab6edfbf3149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:16.544942 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50165221-bc28-4906-8c05-ab6edfbf3149 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:16.545215 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50165221-bc28-4906-8c05-ab6edfbf3149 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:16.545487 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50165221-bc28-4906-8c05-ab6edfbf3149 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:16.546114 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50165221-bc28-4906-8c05-ab6edfbf3149 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:16.546447 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50165221-bc28-4906-8c05-ab6edfbf3149 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:16.547811 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50165221-bc28-4906-8c05-ab6edfbf3149 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:16.564679 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 229/471] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:16.564679 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50165221-bc28-4906-8c05-ab6edfbf3149 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:16.607263 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:16.646687 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 243/472] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 25 13:12:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 25 13:12:16.647851 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521ec69-e357-4c70-8873-b9b0ba143c2a None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:16.676978 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50165221-bc28-4906-8c05-ab6edfbf3149 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:16.713307 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc602e90-f49b-46b5-8c3b-d2c9ec4e170e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:16.713933 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc602e90-f49b-46b5-8c3b-d2c9ec4e170e None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:16.714209 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc602e90-f49b-46b5-8c3b-d2c9ec4e170e None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:16.714481 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc602e90-f49b-46b5-8c3b-d2c9ec4e170e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:16.726076 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc602e90-f49b-46b5-8c3b-d2c9ec4e170e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:16.726833 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:16.727284 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc602e90-f49b-46b5-8c3b-d2c9ec4e170e None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:16.741051 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-fc602e90-f49b-46b5-8c3b-d2c9ec4e170e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:12:16.741051 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:16.741051 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:16.741051 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:16.741051 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:16.741051 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:16.741051 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:16.741051 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:16.741051 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:16.741051 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:16.741051 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:16.741051 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:16.741051 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 25 13:12:16.741051 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 25 13:12:16.741051 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 25 13:12:16.741953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 25 13:12:16.741953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:16.741953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:16.741953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:16.741953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:16.741953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:16.741953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:16.741953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:16.741953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:16.741953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:16.741953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:16.741953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:16.741953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:16.741953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:16.741953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:16.741953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:16.741953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:16.742780 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 25 13:12:16.742780 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 25 13:12:16.742780 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 25 13:12:16.742780 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 25 13:12:16.742780 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 25 13:12:16.742780 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 25 13:12:16.742780 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:12:16.742780 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:16.744040 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 230/473] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 25 13:12:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:16.745595 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc602e90-f49b-46b5-8c3b-d2c9ec4e170e None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:16.773855 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521ec69-e357-4c70-8873-b9b0ba143c2a None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:16.808618 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271fe78-0347-485a-ae90-b8c5277f70d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:16.809219 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271fe78-0347-485a-ae90-b8c5277f70d1 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:16.809490 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271fe78-0347-485a-ae90-b8c5277f70d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:16.809758 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271fe78-0347-485a-ae90-b8c5277f70d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:16.810378 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1271fe78-0347-485a-ae90-b8c5277f70d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:16.810673 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1271fe78-0347-485a-ae90-b8c5277f70d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:16.812608 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1271fe78-0347-485a-ae90-b8c5277f70d1 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:16.823747 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 244/474] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:16.824555 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271fe78-0347-485a-ae90-b8c5277f70d1 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:16.845904 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc602e90-f49b-46b5-8c3b-d2c9ec4e170e None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:16.847433 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:16.880407 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c78272-2593-4410-b48f-9642f3f9193e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:16.880938 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c78272-2593-4410-b48f-9642f3f9193e None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:16.881216 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c78272-2593-4410-b48f-9642f3f9193e None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:16.881491 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c78272-2593-4410-b48f-9642f3f9193e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:16.887891 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c78272-2593-4410-b48f-9642f3f9193e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:16.889345 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c78272-2593-4410-b48f-9642f3f9193e None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:16.900343 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-09c78272-2593-4410-b48f-9642f3f9193e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:12:16.900343 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:16.900343 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:16.900343 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:16.900343 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:16.900343 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:16.900343 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:16.900343 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:16.900343 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:16.900343 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:16.900343 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:16.900343 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:16.900343 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 25 13:12:16.900343 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 25 13:12:16.900343 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 25 13:12:16.901230 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 25 13:12:16.901230 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:16.901230 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:16.901230 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:16.901230 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:16.901230 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:16.901230 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:16.901230 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:16.901230 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:16.901230 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:16.901230 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:16.901230 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:16.901230 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:16.901230 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:16.901230 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:16.901230 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:16.901230 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:16.902066 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 25 13:12:16.902066 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 25 13:12:16.902066 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 25 13:12:16.902066 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 25 13:12:16.902066 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 25 13:12:16.902066 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 25 13:12:16.902066 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:12:16.902066 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:16.902066 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 231/475] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 25 13:12:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:16.902522 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c78272-2593-4410-b48f-9642f3f9193e None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:16.926737 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271fe78-0347-485a-ae90-b8c5277f70d1 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:16.948490 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:16.961117 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f19b3a-10c3-4273-abe5-7555f5c84eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:16.961741 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f19b3a-10c3-4273-abe5-7555f5c84eaa None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:16.962015 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f19b3a-10c3-4273-abe5-7555f5c84eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:16.962285 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f19b3a-10c3-4273-abe5-7555f5c84eaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:16.973257 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f19b3a-10c3-4273-abe5-7555f5c84eaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:16.974775 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f19b3a-10c3-4273-abe5-7555f5c84eaa None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:16.988992 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-89f19b3a-10c3-4273-abe5-7555f5c84eaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:16.988992 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:16.988992 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:16.988992 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:16.988992 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:16.988992 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:16.988992 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:16.988992 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:16.988992 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:16.988992 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:16.988992 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:16.988992 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:16.988992 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:12:16.988992 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:12:16.988992 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:12:16.988992 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:12:16.990043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:16.990043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:16.990043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:16.990043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:16.990043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:16.990043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:16.990043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:16.990043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:16.990043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:16.990043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:16.990043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:16.990043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:16.990043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:16.990043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:16.990043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:16.990043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:16.990043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:12:16.995450 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:12:16.995450 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:16.995450 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:16.995450 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 245/476] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:16.995450 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091ce32-e904-46a5-89d0-ac3cf4090e4a None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:16.995450 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091ce32-e904-46a5-89d0-ac3cf4090e4a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:16.995450 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091ce32-e904-46a5-89d0-ac3cf4090e4a None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:16.995450 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 246/477] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:16.995450 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091ce32-e904-46a5-89d0-ac3cf4090e4a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:17.006683 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c78272-2593-4410-b48f-9642f3f9193e None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:17.040675 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424fc8a-17c1-4d36-abb1-84824be938d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:17.041274 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424fc8a-17c1-4d36-abb1-84824be938d1 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:17.041552 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424fc8a-17c1-4d36-abb1-84824be938d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:17.041823 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424fc8a-17c1-4d36-abb1-84824be938d1 None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:17.042759 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424fc8a-17c1-4d36-abb1-84824be938d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:17.043063 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424fc8a-17c1-4d36-abb1-84824be938d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:17.044522 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424fc8a-17c1-4d36-abb1-84824be938d1 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:17.056729 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 232/478] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 25 13:12:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:17.057513 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424fc8a-17c1-4d36-abb1-84824be938d1 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:17.083595 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:17.095647 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091ce32-e904-46a5-89d0-ac3cf4090e4a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:17.129716 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a1447-e830-4f74-be24-77fb9ca64615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:17.130333 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a1447-e830-4f74-be24-77fb9ca64615 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:17.130657 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a1447-e830-4f74-be24-77fb9ca64615 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:17.130877 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a1447-e830-4f74-be24-77fb9ca64615 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:17.137665 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a1447-e830-4f74-be24-77fb9ca64615 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:17.139092 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a1447-e830-4f74-be24-77fb9ca64615 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:17.150521 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-591a1447-e830-4f74-be24-77fb9ca64615 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:12:17.150521 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:17.150521 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:17.150521 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:17.150521 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:17.150521 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:17.150521 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:17.150521 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:17.150521 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:17.150521 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:17.150521 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:17.150521 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:17.150521 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 25 13:12:17.150521 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 25 13:12:17.150521 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 25 13:12:17.151329 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 25 13:12:17.151329 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:17.151329 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:17.151329 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:17.151329 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:17.151329 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:17.151329 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:17.151329 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:17.151329 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:17.151329 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:17.151329 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:17.151329 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:17.151329 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:17.151329 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:17.151329 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:17.151329 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:17.151329 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:17.152790 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 25 13:12:17.152790 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 25 13:12:17.152790 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 25 13:12:17.152790 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 25 13:12:17.152790 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 25 13:12:17.152790 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 25 13:12:17.152790 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:12:17.152790 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:17.152790 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 247/479] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 25 13:12:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:17.152790 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a1447-e830-4f74-be24-77fb9ca64615 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:17.162724 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424fc8a-17c1-4d36-abb1-84824be938d1 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:17.188858 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:17.196207 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448e415-6a7a-4838-851f-ff4c416fb172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:17.196804 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448e415-6a7a-4838-851f-ff4c416fb172 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:17.197082 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448e415-6a7a-4838-851f-ff4c416fb172 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:17.197351 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448e415-6a7a-4838-851f-ff4c416fb172 None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:17.198032 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448e415-6a7a-4838-851f-ff4c416fb172 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:17.198331 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448e415-6a7a-4838-851f-ff4c416fb172 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:17.199758 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448e415-6a7a-4838-851f-ff4c416fb172 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:17.212812 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 233/480] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 25 13:12:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:17.213827 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db5c41-f80d-4e4b-99f0-2e0ab4354583 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:17.214112 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db5c41-f80d-4e4b-99f0-2e0ab4354583 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:17.214380 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db5c41-f80d-4e4b-99f0-2e0ab4354583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:17.232723 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-a4db5c41-f80d-4e4b-99f0-2e0ab4354583 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:17.234373 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a4db5c41-f80d-4e4b-99f0-2e0ab4354583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:17.258307 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a1447-e830-4f74-be24-77fb9ca64615 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:17.291116 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd044bb-19dc-4105-8b72-5055a8cda5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:17.291713 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd044bb-19dc-4105-8b72-5055a8cda5f8 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:17.292022 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd044bb-19dc-4105-8b72-5055a8cda5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:17.292297 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd044bb-19dc-4105-8b72-5055a8cda5f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:17.293169 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd044bb-19dc-4105-8b72-5055a8cda5f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:17.293469 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd044bb-19dc-4105-8b72-5055a8cda5f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:17.294827 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd044bb-19dc-4105-8b72-5055a8cda5f8 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:17.301902 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 234/481] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:12:17.302724 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db5c41-f80d-4e4b-99f0-2e0ab4354583 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:17.308556 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 248/482] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:17.309473 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd044bb-19dc-4105-8b72-5055a8cda5f8 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:17.321949 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:17.411253 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:17.417763 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db5c41-f80d-4e4b-99f0-2e0ab4354583 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:17.419516 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd044bb-19dc-4105-8b72-5055a8cda5f8 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:17.453248 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267dfaa1-dd23-425b-b030-1618adad86d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:17.453932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267dfaa1-dd23-425b-b030-1618adad86d0 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:17.454288 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267dfaa1-dd23-425b-b030-1618adad86d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:17.454620 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267dfaa1-dd23-425b-b030-1618adad86d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:17.455399 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267dfaa1-dd23-425b-b030-1618adad86d0 None admin] RBAC: Adding query filter params (role.id=b3a463dfc621439eaee93c0551a4e296, scope.project.id=616ecfe8d2c74aad9386720718392e81, user.id=63e73c00cadb4deea934db6111ed76d5) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:17.455764 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267dfaa1-dd23-425b-b030-1618adad86d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:17.456290 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b74717-9921-42e0-9296-57e423d38bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:17.456966 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b74717-9921-42e0-9296-57e423d38bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:17.457315 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b74717-9921-42e0-9296-57e423d38bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:17.457404 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267dfaa1-dd23-425b-b030-1618adad86d0 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:17.457708 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b74717-9921-42e0-9296-57e423d38bd5 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:17.458454 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b74717-9921-42e0-9296-57e423d38bd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:17.458827 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b74717-9921-42e0-9296-57e423d38bd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:17.460333 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b74717-9921-42e0-9296-57e423d38bd5 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:17.463454 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 235/483] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 25 13:12:17 2022] GET /identity/v3/role_assignments?user.id=63e73c00cadb4deea934db6111ed76d5&scope.project.id=616ecfe8d2c74aad9386720718392e81&role.id=b3a463dfc621439eaee93c0551a4e296 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:17.464403 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267dfaa1-dd23-425b-b030-1618adad86d0 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:17.472736 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 249/484] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 25 13:12:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:17.473730 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b74717-9921-42e0-9296-57e423d38bd5 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:17.575380 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:17.591013 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b74717-9921-42e0-9296-57e423d38bd5 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:17.608031 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267dfaa1-dd23-425b-b030-1618adad86d0 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:17.631346 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165373cd-0934-4cc3-81dc-5f047955d04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:17.632276 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165373cd-0934-4cc3-81dc-5f047955d04c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:17.632722 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165373cd-0934-4cc3-81dc-5f047955d04c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:17.633129 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165373cd-0934-4cc3-81dc-5f047955d04c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:17.641348 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165373cd-0934-4cc3-81dc-5f047955d04c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:17.643080 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165373cd-0934-4cc3-81dc-5f047955d04c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:17.648753 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488cb79-af95-496e-b385-92b869a0e50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:17.649367 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488cb79-af95-496e-b385-92b869a0e50c None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:17.649646 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488cb79-af95-496e-b385-92b869a0e50c None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:17.649918 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488cb79-af95-496e-b385-92b869a0e50c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:17.650650 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0488cb79-af95-496e-b385-92b869a0e50c None admin] RBAC: Adding query filter params (role.id=b3a463dfc621439eaee93c0551a4e296, scope.project.id=616ecfe8d2c74aad9386720718392e81, user.id=89f67d808ffb4641b03f96406b3fe9e5) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:17.650958 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0488cb79-af95-496e-b385-92b869a0e50c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:17.652442 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0488cb79-af95-496e-b385-92b869a0e50c None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:17.657520 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-165373cd-0934-4cc3-81dc-5f047955d04c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:12:17.657520 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:17.657520 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:17.657520 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:17.657520 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:17.657520 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:17.657520 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:17.657520 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:17.657520 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:17.657520 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:17.657520 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:17.657520 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:17.657520 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 25 13:12:17.657520 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 25 13:12:17.657520 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 25 13:12:17.658584 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 25 13:12:17.658584 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:17.658584 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:17.658584 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:17.658584 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:17.658584 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:17.658584 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:17.658584 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:17.658584 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:17.658584 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:17.658584 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:17.658584 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:17.658584 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:17.658584 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:17.658584 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:17.658584 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:17.658584 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:17.659567 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 25 13:12:17.659567 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 25 13:12:17.659567 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 25 13:12:17.659567 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 25 13:12:17.659567 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 25 13:12:17.659567 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 25 13:12:17.659567 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:12:17.659567 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:17.659994 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 236/485] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 25 13:12:17 2022] GET /identity/v3/role_assignments?user.id=89f67d808ffb4641b03f96406b3fe9e5&scope.project.id=616ecfe8d2c74aad9386720718392e81&role.id=b3a463dfc621439eaee93c0551a4e296 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:17.660595 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488cb79-af95-496e-b385-92b869a0e50c None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:17.664120 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 250/486] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 25 13:12:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:17.665244 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165373cd-0934-4cc3-81dc-5f047955d04c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:17.691276 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:17.807194 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488cb79-af95-496e-b385-92b869a0e50c None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:17.816966 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165373cd-0934-4cc3-81dc-5f047955d04c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:17.853490 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190a5be-5849-4b8f-9dbf-bccfed97301d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:17.854095 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190a5be-5849-4b8f-9dbf-bccfed97301d None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:17.854377 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190a5be-5849-4b8f-9dbf-bccfed97301d None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:17.854650 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190a5be-5849-4b8f-9dbf-bccfed97301d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:17.855380 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1190a5be-5849-4b8f-9dbf-bccfed97301d None admin] RBAC: Adding query filter params (role.id=b3a463dfc621439eaee93c0551a4e296, scope.project.id=616ecfe8d2c74aad9386720718392e81, user.id=cec40e8c81fe4eafb474d40bc7bf38fc) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:17.855691 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1190a5be-5849-4b8f-9dbf-bccfed97301d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:17.857172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1190a5be-5849-4b8f-9dbf-bccfed97301d None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:17.857707 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3b1f5-c07f-41be-85da-20f0c5fb54e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:17.858357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3b1f5-c07f-41be-85da-20f0c5fb54e6 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:17.858726 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3b1f5-c07f-41be-85da-20f0c5fb54e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:17.859320 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3b1f5-c07f-41be-85da-20f0c5fb54e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:17.865275 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 237/487] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 25 13:12:17 2022] GET /identity/v3/role_assignments?user.id=cec40e8c81fe4eafb474d40bc7bf38fc&scope.project.id=616ecfe8d2c74aad9386720718392e81&role.id=b3a463dfc621439eaee93c0551a4e296 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:17.868780 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190a5be-5849-4b8f-9dbf-bccfed97301d None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:17.872268 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c3b1f5-c07f-41be-85da-20f0c5fb54e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:12:17.878392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-b8c3b1f5-c07f-41be-85da-20f0c5fb54e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 13:12:17.878392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:17.878392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:17.878392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:17.878392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:17.878392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:17.878392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:17.878392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:17.878392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:17.878392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:17.878392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:17.878392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:17.878392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:12:17.878392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:12:17.878392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:12:17.878392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:12:17.879543 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:12:17.879543 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:12:17.879543 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:12:17.879543 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:12:17.879543 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:17.879543 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:17.879543 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:17.879543 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:17.879543 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:17.879543 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:17.879543 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:17.879543 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:17.879543 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:17.879543 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:17.879543 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:17.879543 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:17.880559 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:17.880559 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:17.880559 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:17.880559 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:17.880559 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:12:17.880559 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:12:17.880559 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:12:17.880559 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:12:17.880559 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:12:17.880559 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:12:17.880559 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 25 13:12:17.880559 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:17.882191 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 251/488] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 25 13:12:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:17.882676 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:17.888554 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3b1f5-c07f-41be-85da-20f0c5fb54e6 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:17.990404 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:18.022817 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190a5be-5849-4b8f-9dbf-bccfed97301d None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:18.029838 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3b1f5-c07f-41be-85da-20f0c5fb54e6 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:18.074198 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50fc54-9aa4-4dd8-ac09-069279a82160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:18.074813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50fc54-9aa4-4dd8-ac09-069279a82160 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:18.075051 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997fac5-dffd-4fdb-a0af-9c032e6f03c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:18.075165 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50fc54-9aa4-4dd8-ac09-069279a82160 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:18.075344 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50fc54-9aa4-4dd8-ac09-069279a82160 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:18.076069 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50fc54-9aa4-4dd8-ac09-069279a82160 None admin] RBAC: Adding query filter params (name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:18.076337 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997fac5-dffd-4fdb-a0af-9c032e6f03c6 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:18.076434 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50fc54-9aa4-4dd8-ac09-069279a82160 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:18.076882 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997fac5-dffd-4fdb-a0af-9c032e6f03c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:18.077344 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997fac5-dffd-4fdb-a0af-9c032e6f03c6 None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:18.078294 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50fc54-9aa4-4dd8-ac09-069279a82160 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:18.079333 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997fac5-dffd-4fdb-a0af-9c032e6f03c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:18.079993 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997fac5-dffd-4fdb-a0af-9c032e6f03c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:18.081729 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997fac5-dffd-4fdb-a0af-9c032e6f03c6 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:18.089173 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 252/489] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 25 13:12:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:18.094795 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50fc54-9aa4-4dd8-ac09-069279a82160 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:18.095232 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 238/490] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 25 13:12:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:18.101826 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997fac5-dffd-4fdb-a0af-9c032e6f03c6 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:18.200839 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:18.233799 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50fc54-9aa4-4dd8-ac09-069279a82160 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:18.283473 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997fac5-dffd-4fdb-a0af-9c032e6f03c6 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:18.289635 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf3027-8a1e-4c3b-9de2-417291778427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:18.295705 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf3027-8a1e-4c3b-9de2-417291778427 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:18.296179 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf3027-8a1e-4c3b-9de2-417291778427 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:18.297323 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf3027-8a1e-4c3b-9de2-417291778427 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:18.302896 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:18.316960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf3027-8a1e-4c3b-9de2-417291778427 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:18.320169 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf3027-8a1e-4c3b-9de2-417291778427 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:18.344188 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-27cf3027-8a1e-4c3b-9de2-417291778427 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:18.344188 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:18.344188 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:18.344188 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:18.344188 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:18.344188 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:18.344188 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:18.344188 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:18.344188 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:18.344188 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:18.344188 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:18.344188 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:18.344188 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:12:18.344188 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:12:18.344188 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:12:18.344188 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:12:18.345375 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:18.345375 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:18.345375 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:18.345375 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:18.345375 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:18.345375 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:18.345375 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:18.345375 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:18.345375 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:18.345375 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:18.345375 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:18.345375 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:18.345375 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:18.345375 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:18.345375 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:18.345375 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:18.345375 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:12:18.346847 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:12:18.346847 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:18.346847 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:18.354113 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 253/491] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:18.356749 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ef0cc-9811-4cb7-b406-4083ee8fe048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:18.357884 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ef0cc-9811-4cb7-b406-4083ee8fe048 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:18.358325 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ef0cc-9811-4cb7-b406-4083ee8fe048 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:18.358753 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ef0cc-9811-4cb7-b406-4083ee8fe048 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:18.359842 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf3027-8a1e-4c3b-9de2-417291778427 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:18.360744 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ef0cc-9811-4cb7-b406-4083ee8fe048 None admin] RBAC: Adding query filter params (role.id=b3a463dfc621439eaee93c0551a4e296, scope.project.id=616ecfe8d2c74aad9386720718392e81, user.id=858fa61f39fa4d3daf4125f6099e7721) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:18.361578 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ef0cc-9811-4cb7-b406-4083ee8fe048 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:18.363547 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ef0cc-9811-4cb7-b406-4083ee8fe048 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:18.379533 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 239/492] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 25 13:12:18 2022] GET /identity/v3/role_assignments?user.id=858fa61f39fa4d3daf4125f6099e7721&scope.project.id=616ecfe8d2c74aad9386720718392e81&role.id=b3a463dfc621439eaee93c0551a4e296 => generated 608 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:18.515820 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf3027-8a1e-4c3b-9de2-417291778427 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:18.565797 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3285db-ea2e-4085-b666-ab469d052091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:18.566850 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3285db-ea2e-4085-b666-ab469d052091 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:18.567463 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3285db-ea2e-4085-b666-ab469d052091 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:18.567955 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3285db-ea2e-4085-b666-ab469d052091 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:18.568803 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3285db-ea2e-4085-b666-ab469d052091 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:18.569390 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3285db-ea2e-4085-b666-ab469d052091 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:18.570982 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3285db-ea2e-4085-b666-ab469d052091 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:18.590189 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 254/493] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:18.596243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ef0cc-9811-4cb7-b406-4083ee8fe048 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:18.732908 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ef0cc-9811-4cb7-b406-4083ee8fe048 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:18.763100 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:18.772437 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef71c14-5991-4d39-bdcc-bea4aac75180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:18.773072 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef71c14-5991-4d39-bdcc-bea4aac75180 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:18.773348 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef71c14-5991-4d39-bdcc-bea4aac75180 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:18.773621 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef71c14-5991-4d39-bdcc-bea4aac75180 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:18.781575 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef71c14-5991-4d39-bdcc-bea4aac75180 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:18.783028 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef71c14-5991-4d39-bdcc-bea4aac75180 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:18.795014 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-2ef71c14-5991-4d39-bdcc-bea4aac75180 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 25 13:12:18.795014 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:18.795014 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:18.795014 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:18.795014 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:18.795014 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:18.795014 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:18.795014 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:18.795014 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:18.795014 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:18.795014 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:18.795014 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:18.795014 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 25 13:12:18.795014 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 25 13:12:18.795014 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 25 13:12:18.795014 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 25 13:12:18.796013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:18.796013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:18.796013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 25 13:12:18.796013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:12:18.796013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 25 13:12:18.796013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:12:18.796013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:18.796013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:18.796013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:18.796013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:18.796013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:18.796013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:18.796013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:18.796013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:18.796013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:18.796013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:18.796013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:18.796013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:18.797833 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:18.797833 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:18.797833 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 25 13:12:18.797833 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 25 13:12:18.797833 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 25 13:12:18.797833 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 25 13:12:18.797833 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 25 13:12:18.797833 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 25 13:12:18.797833 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 25 13:12:18.797833 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:18.797833 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 240/494] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 25 13:12:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:18.802798 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3285db-ea2e-4085-b666-ab469d052091 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:18.858146 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:18.918497 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3285db-ea2e-4085-b666-ab469d052091 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:18.998472 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a940618-0bdd-48f0-876d-7d2947239126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:18.999083 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a940618-0bdd-48f0-876d-7d2947239126 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:18.999362 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a940618-0bdd-48f0-876d-7d2947239126 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:19.000183 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a940618-0bdd-48f0-876d-7d2947239126 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:19.000992 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a940618-0bdd-48f0-876d-7d2947239126 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:19.001302 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a940618-0bdd-48f0-876d-7d2947239126 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:19.002767 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a940618-0bdd-48f0-876d-7d2947239126 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:19.025065 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 255/495] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Oct 25 13:12:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:19.031497 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef71c14-5991-4d39-bdcc-bea4aac75180 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:19.165876 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef71c14-5991-4d39-bdcc-bea4aac75180 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:19.210195 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7fc3b-2601-429a-94d2-66be61b71e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:19.210799 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7fc3b-2601-429a-94d2-66be61b71e44 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:19.211080 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7fc3b-2601-429a-94d2-66be61b71e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:19.211360 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7fc3b-2601-429a-94d2-66be61b71e44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:19.287690 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:19.300463 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae7fc3b-2601-429a-94d2-66be61b71e44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:19.302104 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae7fc3b-2601-429a-94d2-66be61b71e44 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:19.421120 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 241/496] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 25 13:12:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 25 13:12:19.428149 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a940618-0bdd-48f0-876d-7d2947239126 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:19.579295 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a940618-0bdd-48f0-876d-7d2947239126 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:19.590243 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:19.629487 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5034a-e89d-4f1a-8b34-bbceedc13172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:19.630115 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5034a-e89d-4f1a-8b34-bbceedc13172 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:19.630393 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5034a-e89d-4f1a-8b34-bbceedc13172 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:19.630665 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5034a-e89d-4f1a-8b34-bbceedc13172 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:19.649410 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a5034a-e89d-4f1a-8b34-bbceedc13172 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:19.650860 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a5034a-e89d-4f1a-8b34-bbceedc13172 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:19.672770 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-35a5034a-e89d-4f1a-8b34-bbceedc13172 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:19.672770 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:19.672770 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:19.672770 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:19.672770 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:19.672770 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:19.672770 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:19.672770 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:19.672770 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:19.672770 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:19.672770 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:19.672770 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:19.672770 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:12:19.672770 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:12:19.672770 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:12:19.672770 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:12:19.673882 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:19.673882 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:19.673882 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:19.673882 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:19.673882 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:19.673882 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:19.673882 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:19.673882 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:19.673882 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:19.673882 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:19.673882 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:19.673882 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:19.673882 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:19.673882 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:19.673882 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:19.673882 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:19.673882 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:12:19.674729 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:12:19.674729 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:19.674729 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:19.674729 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 256/497] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:19.680833 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7fc3b-2601-429a-94d2-66be61b71e44 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:19.810904 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:19.824217 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7fc3b-2601-429a-94d2-66be61b71e44 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:19.860122 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e9828-78b7-4f54-bc18-55b60723071f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:19.860724 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e9828-78b7-4f54-bc18-55b60723071f None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:19.861008 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e9828-78b7-4f54-bc18-55b60723071f None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:19.861282 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e9828-78b7-4f54-bc18-55b60723071f None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:19.861919 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e9828-78b7-4f54-bc18-55b60723071f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:19.862217 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e9828-78b7-4f54-bc18-55b60723071f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:19.863574 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e9828-78b7-4f54-bc18-55b60723071f None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:19.876438 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 242/498] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:19.884990 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5034a-e89d-4f1a-8b34-bbceedc13172 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:20.014483 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5034a-e89d-4f1a-8b34-bbceedc13172 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:20.050868 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060dcde6-0d7a-4b4e-870e-a09a5f858481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:20.051777 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060dcde6-0d7a-4b4e-870e-a09a5f858481 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:20.052154 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060dcde6-0d7a-4b4e-870e-a09a5f858481 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:20.052434 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060dcde6-0d7a-4b4e-870e-a09a5f858481 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:20.059389 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060dcde6-0d7a-4b4e-870e-a09a5f858481 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:20.060941 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060dcde6-0d7a-4b4e-870e-a09a5f858481 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:20.077558 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-060dcde6-0d7a-4b4e-870e-a09a5f858481 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:12:20.077558 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:20.077558 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:20.077558 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:20.077558 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:20.077558 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:20.077558 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:20.077558 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:20.077558 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:20.077558 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:20.077558 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:20.077558 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:20.077558 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 25 13:12:20.077558 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 25 13:12:20.077558 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 25 13:12:20.079215 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 25 13:12:20.079215 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:20.079215 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:20.079215 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:20.079215 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:20.079215 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:20.079215 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:20.079215 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:20.079215 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:20.079215 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:20.079215 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:20.079215 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:20.079215 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:20.079215 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:20.079215 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:20.079215 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:20.079215 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:20.080578 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 25 13:12:20.080578 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 25 13:12:20.080578 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 25 13:12:20.080578 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 25 13:12:20.080578 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 25 13:12:20.080578 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 25 13:12:20.080578 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:12:20.080578 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:20.080578 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 257/499] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 25 13:12:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:20.087218 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e9828-78b7-4f54-bc18-55b60723071f None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:20.209637 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e9828-78b7-4f54-bc18-55b60723071f None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:20.217690 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b18f5-8db8-4816-87db-ae2a000b667a None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:20.217975 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b18f5-8db8-4816-87db-ae2a000b667a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:20.218358 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b18f5-8db8-4816-87db-ae2a000b667a None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:20.221220 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 258/500] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:20.228812 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974b35c-a9e0-441a-b5d4-4cf4868471ad None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:20.229098 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974b35c-a9e0-441a-b5d4-4cf4868471ad None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:20.229377 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974b35c-a9e0-441a-b5d4-4cf4868471ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:20.259910 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c974b35c-a9e0-441a-b5d4-4cf4868471ad None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:20.261097 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c974b35c-a9e0-441a-b5d4-4cf4868471ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:20.269706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13928f-3b3d-49bd-85a6-285df18c73c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:20.270262 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13928f-3b3d-49bd-85a6-285df18c73c2 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:20.270537 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13928f-3b3d-49bd-85a6-285df18c73c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:20.270807 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13928f-3b3d-49bd-85a6-285df18c73c2 None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:20.271492 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d13928f-3b3d-49bd-85a6-285df18c73c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:20.271796 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d13928f-3b3d-49bd-85a6-285df18c73c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:20.273255 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d13928f-3b3d-49bd-85a6-285df18c73c2 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:20.286367 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:20.291489 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 243/501] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 25 13:12:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:20.299874 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13928f-3b3d-49bd-85a6-285df18c73c2 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:20.313954 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:20.392761 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 259/502] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 25 13:12:20.472330 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13928f-3b3d-49bd-85a6-285df18c73c2 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:20.524872 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7911b-0fd1-4ace-bfe7-59bd634aff49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:20.525807 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7911b-0fd1-4ace-bfe7-59bd634aff49 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:20.526281 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7911b-0fd1-4ace-bfe7-59bd634aff49 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:20.526788 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7911b-0fd1-4ace-bfe7-59bd634aff49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:20.527721 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7911b-0fd1-4ace-bfe7-59bd634aff49 None admin] RBAC: Adding query filter params (role.id=b3a463dfc621439eaee93c0551a4e296, scope.project.id=616ecfe8d2c74aad9386720718392e81, user.id=07413369b0c14e878d04ee528487801d) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:20.528243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7911b-0fd1-4ace-bfe7-59bd634aff49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:20.529922 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7911b-0fd1-4ace-bfe7-59bd634aff49 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:20.543477 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 244/503] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 25 13:12:20 2022] GET /identity/v3/role_assignments?user.id=07413369b0c14e878d04ee528487801d&scope.project.id=616ecfe8d2c74aad9386720718392e81&role.id=b3a463dfc621439eaee93c0551a4e296 => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:12:20.602341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f54e4c-99f4-4d21-aca1-a80f1aa79927 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:20.602856 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f54e4c-99f4-4d21-aca1-a80f1aa79927 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:20.602932 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f54e4c-99f4-4d21-aca1-a80f1aa79927 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:20.604269 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 260/504] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:20.610299 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85ebce-54af-4731-8d78-73f700da5692 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:20.610617 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85ebce-54af-4731-8d78-73f700da5692 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:20.610850 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85ebce-54af-4731-8d78-73f700da5692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:20.620780 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e177b-b6b5-4251-99af-a27ecb0af1ef None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:20.621083 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e177b-b6b5-4251-99af-a27ecb0af1ef None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:20.621333 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e177b-b6b5-4251-99af-a27ecb0af1ef None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:20.622676 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 261/505] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 13:12:20.629066 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeac8ef-582a-4bd9-94c5-50f90083771f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:20.629344 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeac8ef-582a-4bd9-94c5-50f90083771f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:20.629614 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeac8ef-582a-4bd9-94c5-50f90083771f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:20.650144 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-bc85ebce-54af-4731-8d78-73f700da5692 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:20.651395 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-bc85ebce-54af-4731-8d78-73f700da5692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:20.659282 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-5eeac8ef-582a-4bd9-94c5-50f90083771f None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:20.660515 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5eeac8ef-582a-4bd9-94c5-50f90083771f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:20.784426 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 245/506] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:12:20.785670 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85ebce-54af-4731-8d78-73f700da5692 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:20.792199 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:20.800630 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 262/507] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 25 13:12:20.900894 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85ebce-54af-4731-8d78-73f700da5692 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:20.940673 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45795f-9e7c-4265-9e4d-f5806213dab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:20.941714 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45795f-9e7c-4265-9e4d-f5806213dab2 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:20.942186 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45795f-9e7c-4265-9e4d-f5806213dab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:20.942650 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45795f-9e7c-4265-9e4d-f5806213dab2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:20.954382 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45795f-9e7c-4265-9e4d-f5806213dab2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:12:20.959472 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-8c45795f-9e7c-4265-9e4d-f5806213dab2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 13:12:20.959472 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:20.959472 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:20.959472 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:20.959472 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:20.959472 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:20.959472 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:20.959472 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:20.959472 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:20.959472 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:20.959472 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:20.959472 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:20.959472 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:12:20.959472 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:12:20.959472 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:12:20.959472 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:12:20.960423 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:12:20.960423 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:12:20.960423 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:12:20.960423 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:12:20.960423 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:20.960423 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:20.960423 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:20.960423 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:20.960423 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:20.960423 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:20.960423 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:20.960423 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:20.960423 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:20.960423 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:20.960423 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:20.960423 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:20.961325 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:20.961325 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:20.961325 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:20.961325 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:20.961325 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:12:20.961325 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:12:20.961325 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:12:20.961325 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:12:20.961325 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:12:20.961325 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:12:20.961325 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 13:12:20.961325 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:20.963976 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 246/508] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 25 13:12:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:20.973265 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeac8ef-582a-4bd9-94c5-50f90083771f None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:21.069147 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:21.079569 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45795f-9e7c-4265-9e4d-f5806213dab2 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:21.088199 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeac8ef-582a-4bd9-94c5-50f90083771f None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:21.148139 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:21.154605 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2be91-ecfd-40a1-98c2-4e72a157e86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:21.155219 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2be91-ecfd-40a1-98c2-4e72a157e86d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:21.155495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2be91-ecfd-40a1-98c2-4e72a157e86d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:21.155912 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2be91-ecfd-40a1-98c2-4e72a157e86d None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:21.157323 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a2be91-ecfd-40a1-98c2-4e72a157e86d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:21.157626 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a2be91-ecfd-40a1-98c2-4e72a157e86d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:21.158991 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a2be91-ecfd-40a1-98c2-4e72a157e86d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:21.181856 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 263/509] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 25 13:12:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:21.182574 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2be91-ecfd-40a1-98c2-4e72a157e86d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:21.196761 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45795f-9e7c-4265-9e4d-f5806213dab2 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:21.233647 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33145a5e-03fc-4d0d-9833-2b30c5007c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:21.235425 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33145a5e-03fc-4d0d-9833-2b30c5007c7f None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:21.236007 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33145a5e-03fc-4d0d-9833-2b30c5007c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:21.236140 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33145a5e-03fc-4d0d-9833-2b30c5007c7f None admin] PATH_INFO: `/v3/services/network` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:21.236670 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33145a5e-03fc-4d0d-9833-2b30c5007c7f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:21.238035 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33145a5e-03fc-4d0d-9833-2b30c5007c7f None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:21.253090 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-33145a5e-03fc-4d0d-9833-2b30c5007c7f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 25 13:12:21.253090 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:21.253090 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 13:12:21.253090 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 13:12:21.253090 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 13:12:21.253090 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 13:12:21.253090 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 13:12:21.253090 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:21.253090 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 25 13:12:21.253090 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:21.253090 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 13:12:21.253090 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:21.253090 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:21.253090 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:21.253090 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:21.253090 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:21.253090 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:21.254169 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:21.254169 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:21.254169 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:21.254169 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:21.254169 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:21.254169 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:21.254169 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 13:12:21.254169 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 13:12:21.254169 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 13:12:21.254169 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 13:12:21.254169 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:21.254169 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:21.254169 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:21.254169 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:21.254169 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:21.254169 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:21.255045 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:21.255045 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:21.255045 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:21.255045 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:21.255045 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:21.255045 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:21.255045 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:21.255045 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:21.255045 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:21.255045 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:21.255045 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 13:12:21.255045 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:21.255045 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 25 13:12:21.255045 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:21.255045 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 247/510] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 25 13:12:21 2022] GET /identity/v3/services/network => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 13:12:21.255873 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33145a5e-03fc-4d0d-9833-2b30c5007c7f None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:21.310599 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2be91-ecfd-40a1-98c2-4e72a157e86d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:21.349486 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a4696-83b8-4964-ae43-70a0cc8facdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:21.350097 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a4696-83b8-4964-ae43-70a0cc8facdf None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:21.350395 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a4696-83b8-4964-ae43-70a0cc8facdf None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:21.350657 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a4696-83b8-4964-ae43-70a0cc8facdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:21.360559 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:21.363544 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a4696-83b8-4964-ae43-70a0cc8facdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:21.365306 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a4696-83b8-4964-ae43-70a0cc8facdf None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:21.387017 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-3c0a4696-83b8-4964-ae43-70a0cc8facdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:21.387017 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:21.387017 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:21.387017 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:21.387017 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:21.387017 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:21.387017 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:21.387017 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:21.387017 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:21.387017 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:21.387017 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:21.387017 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:21.387017 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:12:21.387017 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:12:21.387017 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:12:21.387017 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:12:21.388249 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:21.388249 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:21.388249 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:21.388249 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:21.388249 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:21.388249 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:21.388249 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:21.388249 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:21.388249 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:21.388249 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:21.388249 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:21.388249 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:21.388249 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:21.388249 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:21.388249 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:21.388249 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:21.388249 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:12:21.389360 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:12:21.389360 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:21.389360 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:21.392388 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 264/511] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:21.393403 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a4696-83b8-4964-ae43-70a0cc8facdf None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:21.406767 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33145a5e-03fc-4d0d-9833-2b30c5007c7f None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:21.444516 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:21.456534 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de15fb-f880-4f88-9534-4f15badc5301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:21.457255 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de15fb-f880-4f88-9534-4f15badc5301 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:21.457740 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de15fb-f880-4f88-9534-4f15badc5301 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:21.458218 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de15fb-f880-4f88-9534-4f15badc5301 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:21.473915 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de15fb-f880-4f88-9534-4f15badc5301 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:21.475399 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de15fb-f880-4f88-9534-4f15badc5301 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:21.493666 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-31de15fb-f880-4f88-9534-4f15badc5301 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:21.493666 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:21.493666 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:21.493666 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:21.493666 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:21.493666 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:21.493666 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:21.493666 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:21.493666 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:21.493666 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:21.493666 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:21.493666 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:21.493666 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:12:21.493666 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:12:21.493666 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:12:21.493666 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:12:21.494886 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:21.494886 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:21.494886 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:21.494886 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:21.494886 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:21.494886 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:21.494886 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:21.494886 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:21.494886 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:21.494886 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:21.494886 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:21.494886 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:21.494886 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:21.494886 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:21.494886 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:21.494886 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:21.494886 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:12:21.496074 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:12:21.496074 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:21.496074 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:21.496724 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 248/512] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:21.497949 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de15fb-f880-4f88-9534-4f15badc5301 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:21.524498 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a4696-83b8-4964-ae43-70a0cc8facdf None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:21.564909 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a1ae5-d2c0-4c24-9457-20f8a1bd83ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:21.565523 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a1ae5-d2c0-4c24-9457-20f8a1bd83ad None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:21.565808 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a1ae5-d2c0-4c24-9457-20f8a1bd83ad None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:21.566068 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a1ae5-d2c0-4c24-9457-20f8a1bd83ad None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:21.566697 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a1ae5-d2c0-4c24-9457-20f8a1bd83ad None admin] RBAC: Adding query filter params (name=network) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:21.566998 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a1ae5-d2c0-4c24-9457-20f8a1bd83ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:21.568409 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a1ae5-d2c0-4c24-9457-20f8a1bd83ad None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:21.573056 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 265/513] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Oct 25 13:12:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:21.573830 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a1ae5-d2c0-4c24-9457-20f8a1bd83ad None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:21.618284 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de15fb-f880-4f88-9534-4f15badc5301 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:21.638511 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:21.654313 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b193b3-3440-40b4-920c-a883d08e1dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:21.654916 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b193b3-3440-40b4-920c-a883d08e1dd5 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:21.655199 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b193b3-3440-40b4-920c-a883d08e1dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:21.655475 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b193b3-3440-40b4-920c-a883d08e1dd5 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:21.656330 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b193b3-3440-40b4-920c-a883d08e1dd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:21.656643 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b193b3-3440-40b4-920c-a883d08e1dd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:21.658005 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b193b3-3440-40b4-920c-a883d08e1dd5 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:21.670221 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 249/514] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:21.672040 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d97461-ef4c-4a79-a080-00251457d066 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:21.672538 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d97461-ef4c-4a79-a080-00251457d066 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:21.673023 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d97461-ef4c-4a79-a080-00251457d066 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:21.674558 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 250/515] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:21.675097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d97461-ef4c-4a79-a080-00251457d066 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:21.698942 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a1ae5-d2c0-4c24-9457-20f8a1bd83ad None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:21.723976 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:21.738627 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4253fe-c7fc-4446-b718-e5076ab1c2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:21.739233 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4253fe-c7fc-4446-b718-e5076ab1c2d7 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:21.739511 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4253fe-c7fc-4446-b718-e5076ab1c2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:21.739781 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4253fe-c7fc-4446-b718-e5076ab1c2d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:21.740504 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4253fe-c7fc-4446-b718-e5076ab1c2d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:21.740750 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4253fe-c7fc-4446-b718-e5076ab1c2d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:21.742097 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4253fe-c7fc-4446-b718-e5076ab1c2d7 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:21.759574 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 266/516] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:21.760456 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4253fe-c7fc-4446-b718-e5076ab1c2d7 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:21.790836 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d97461-ef4c-4a79-a080-00251457d066 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:21.831328 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b334a03-88ff-45ca-bbd0-62b98e3b1074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:21.831972 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b334a03-88ff-45ca-bbd0-62b98e3b1074 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:21.832258 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b334a03-88ff-45ca-bbd0-62b98e3b1074 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:21.832533 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b334a03-88ff-45ca-bbd0-62b98e3b1074 None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:21.833164 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b334a03-88ff-45ca-bbd0-62b98e3b1074 None admin] RBAC: Adding query filter params (type=network) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:21.833472 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b334a03-88ff-45ca-bbd0-62b98e3b1074 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:21.834828 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b334a03-88ff-45ca-bbd0-62b98e3b1074 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:21.840383 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 251/517] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Oct 25 13:12:21 2022] GET /identity/v3/services?type=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:21.841518 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de617bf5-cbfc-4d00-9a69-430672c810da None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:21.841801 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de617bf5-cbfc-4d00-9a69-430672c810da None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:21.842077 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de617bf5-cbfc-4d00-9a69-430672c810da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:21.868570 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-de617bf5-cbfc-4d00-9a69-430672c810da None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:21.869993 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-de617bf5-cbfc-4d00-9a69-430672c810da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:21.878376 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4253fe-c7fc-4446-b718-e5076ab1c2d7 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:21.901588 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:21.927676 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6a855-f528-4fa0-a4f0-721e7b4decaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:21.928697 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6a855-f528-4fa0-a4f0-721e7b4decaf None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:21.929186 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6a855-f528-4fa0-a4f0-721e7b4decaf None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:21.929685 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6a855-f528-4fa0-a4f0-721e7b4decaf None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:21.931271 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6a855-f528-4fa0-a4f0-721e7b4decaf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:21.933553 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6a855-f528-4fa0-a4f0-721e7b4decaf None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:21.963273 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 267/518] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 25 13:12:21 2022] POST /identity/v3/users => generated 254 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:12:21.964534 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6a855-f528-4fa0-a4f0-721e7b4decaf None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:21.983924 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 252/519] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:12:22.107484 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6a855-f528-4fa0-a4f0-721e7b4decaf None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:22.146827 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb23a0-bb08-4879-8fca-497ed1a727b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:22.147485 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb23a0-bb08-4879-8fca-497ed1a727b9 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:22.147768 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb23a0-bb08-4879-8fca-497ed1a727b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:22.148088 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb23a0-bb08-4879-8fca-497ed1a727b9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:22.157602 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb23a0-bb08-4879-8fca-497ed1a727b9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:22.159087 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb23a0-bb08-4879-8fca-497ed1a727b9 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:22.172484 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-edbb23a0-bb08-4879-8fca-497ed1a727b9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 25 13:12:22.172484 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:22.172484 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:22.172484 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:22.172484 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:22.172484 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:22.172484 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:22.172484 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:22.172484 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:22.172484 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:22.172484 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:22.172484 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:22.172484 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 25 13:12:22.172484 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 25 13:12:22.172484 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 25 13:12:22.172484 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 25 13:12:22.173518 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:22.173518 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:22.173518 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 25 13:12:22.173518 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:12:22.173518 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 25 13:12:22.173518 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:12:22.173518 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:22.173518 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:22.173518 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:22.173518 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:22.173518 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:22.173518 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:22.173518 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:22.173518 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:22.173518 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:22.173518 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:22.173518 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:22.173518 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:22.174488 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:22.174488 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:22.174488 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 25 13:12:22.174488 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 25 13:12:22.174488 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 25 13:12:22.174488 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 25 13:12:22.174488 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 25 13:12:22.174488 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 25 13:12:22.174488 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 25 13:12:22.174488 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:22.174488 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 268/520] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Oct 25 13:12:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:22.179512 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de617bf5-cbfc-4d00-9a69-430672c810da None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:22.225866 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:22.293354 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb23a0-bb08-4879-8fca-497ed1a727b9 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:22.294753 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de617bf5-cbfc-4d00-9a69-430672c810da None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:22.329939 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:22.348690 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf1ab2-ab0d-48f4-8b64-4bf7f4c65003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:22.349706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf1ab2-ab0d-48f4-8b64-4bf7f4c65003 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:22.350007 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf1ab2-ab0d-48f4-8b64-4bf7f4c65003 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:22.350263 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf1ab2-ab0d-48f4-8b64-4bf7f4c65003 None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:22.351152 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf1ab2-ab0d-48f4-8b64-4bf7f4c65003 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:22.351593 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf1ab2-ab0d-48f4-8b64-4bf7f4c65003 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:22.353077 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf1ab2-ab0d-48f4-8b64-4bf7f4c65003 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:22.379733 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 253/521] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Oct 25 13:12:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:22.385193 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf1ab2-ab0d-48f4-8b64-4bf7f4c65003 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:22.416903 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb23a0-bb08-4879-8fca-497ed1a727b9 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:22.453322 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d351404-32ee-48f3-a0fc-c16afcc9e8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:22.454620 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d351404-32ee-48f3-a0fc-c16afcc9e8c5 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:22.455111 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d351404-32ee-48f3-a0fc-c16afcc9e8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:22.455582 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d351404-32ee-48f3-a0fc-c16afcc9e8c5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:22.456484 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d351404-32ee-48f3-a0fc-c16afcc9e8c5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:22.458068 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d351404-32ee-48f3-a0fc-c16afcc9e8c5 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:22.470069 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-6d351404-32ee-48f3-a0fc-c16afcc9e8c5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 25 13:12:22.470069 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:22.470069 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 13:12:22.470069 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 13:12:22.470069 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 13:12:22.470069 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 13:12:22.470069 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 13:12:22.470069 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:22.470069 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 25 13:12:22.470069 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:22.470069 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 13:12:22.470069 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:22.470069 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:22.470069 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:22.470069 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:22.470069 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:22.470069 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:22.471103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:22.471103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:22.471103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:22.471103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:22.471103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:22.471103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:22.471103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 13:12:22.471103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 13:12:22.471103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 13:12:22.471103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 13:12:22.471103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:22.471103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:22.471103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:22.471103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:22.471103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:22.471103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:22.471984 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:22.471984 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:22.471984 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:22.471984 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:22.471984 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:22.471984 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:22.471984 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:22.471984 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:22.471984 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:22.471984 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:22.471984 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 13:12:22.471984 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:22.471984 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 25 13:12:22.471984 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:22.474866 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 269/522] 10.222.0.25 () {56 vars in 1129 bytes} [Tue Oct 25 13:12:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:22.480772 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d351404-32ee-48f3-a0fc-c16afcc9e8c5 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:22.581423 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:22.584275 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:22.592808 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d351404-32ee-48f3-a0fc-c16afcc9e8c5 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:22.604539 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf1ab2-ab0d-48f4-8b64-4bf7f4c65003 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:22.643537 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d31ed-0569-4e0f-8ebc-3b7e68037366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:22.645049 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d31ed-0569-4e0f-8ebc-3b7e68037366 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:22.645577 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d31ed-0569-4e0f-8ebc-3b7e68037366 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:22.646121 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d31ed-0569-4e0f-8ebc-3b7e68037366 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:22.646951 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d31ed-0569-4e0f-8ebc-3b7e68037366 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:22.647468 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d31ed-0569-4e0f-8ebc-3b7e68037366 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:22.649212 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d31ed-0569-4e0f-8ebc-3b7e68037366 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:22.654409 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 270/523] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Oct 25 13:12:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:22.660483 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d31ed-0569-4e0f-8ebc-3b7e68037366 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:22.676889 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5ef60-9dfa-4bde-9920-07c48c4e196a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:22.677499 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5ef60-9dfa-4bde-9920-07c48c4e196a None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:22.677780 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5ef60-9dfa-4bde-9920-07c48c4e196a None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:22.678049 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5ef60-9dfa-4bde-9920-07c48c4e196a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:22.700985 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5ef60-9dfa-4bde-9920-07c48c4e196a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:22.701931 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5ef60-9dfa-4bde-9920-07c48c4e196a None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:22.728474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-d6e5ef60-9dfa-4bde-9920-07c48c4e196a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:22.728474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:22.728474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:22.728474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:22.728474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:22.728474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:22.728474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:22.728474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:22.728474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:22.728474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:22.728474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:22.728474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:22.728474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:12:22.728474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:12:22.728474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:12:22.728474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:12:22.729474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:22.729474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:22.729474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:22.729474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:22.729474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:22.729474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:22.729474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:22.729474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:22.729474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:22.729474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:22.729474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:22.729474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:22.729474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:22.729474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:22.729474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:22.729474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:22.729474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:12:22.730356 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:12:22.730356 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:22.730356 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:22.730356 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 254/524] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:22.737146 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5ef60-9dfa-4bde-9920-07c48c4e196a None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:22.788821 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d31ed-0569-4e0f-8ebc-3b7e68037366 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:22.825367 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa716e7-f9f9-4db0-a340-24a5f0960717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:22.826347 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa716e7-f9f9-4db0-a340-24a5f0960717 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:22.826825 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa716e7-f9f9-4db0-a340-24a5f0960717 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:22.827298 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa716e7-f9f9-4db0-a340-24a5f0960717 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:22.828289 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa716e7-f9f9-4db0-a340-24a5f0960717 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:22.828794 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa716e7-f9f9-4db0-a340-24a5f0960717 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:22.830364 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa716e7-f9f9-4db0-a340-24a5f0960717 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:22.836368 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 271/525] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Oct 25 13:12:22 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:12:22.919195 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5ef60-9dfa-4bde-9920-07c48c4e196a None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:22.972802 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60468f-2bed-4890-8e84-636aa1965229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:22.973806 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60468f-2bed-4890-8e84-636aa1965229 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:22.974361 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60468f-2bed-4890-8e84-636aa1965229 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:22.974837 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60468f-2bed-4890-8e84-636aa1965229 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:22.975697 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee60468f-2bed-4890-8e84-636aa1965229 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:22.976222 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee60468f-2bed-4890-8e84-636aa1965229 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:22.977839 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee60468f-2bed-4890-8e84-636aa1965229 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:22.997214 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 255/526] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:23.003742 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa716e7-f9f9-4db0-a340-24a5f0960717 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:23.033071 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:23.116776 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa716e7-f9f9-4db0-a340-24a5f0960717 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:23.152952 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22a4be-5005-4a3a-8a86-ade48302e10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:23.153614 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22a4be-5005-4a3a-8a86-ade48302e10a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:23.153890 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22a4be-5005-4a3a-8a86-ade48302e10a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:23.154162 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22a4be-5005-4a3a-8a86-ade48302e10a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:23.162797 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22a4be-5005-4a3a-8a86-ade48302e10a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:23.164346 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22a4be-5005-4a3a-8a86-ade48302e10a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:23.177879 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-6e22a4be-5005-4a3a-8a86-ade48302e10a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:12:23.177879 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:23.177879 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:23.177879 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:23.177879 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:23.177879 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:23.177879 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:23.177879 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:23.177879 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:23.177879 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:23.177879 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:23.177879 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:23.177879 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 25 13:12:23.177879 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 25 13:12:23.177879 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 25 13:12:23.178925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 25 13:12:23.178925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:23.178925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:23.178925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:23.178925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:23.178925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:23.178925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:23.178925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:23.178925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:23.178925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:23.178925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:23.178925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:23.178925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:23.178925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:23.178925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:23.178925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:23.178925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:23.179809 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 25 13:12:23.179809 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 25 13:12:23.179809 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 25 13:12:23.179809 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 25 13:12:23.179809 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 25 13:12:23.179809 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 25 13:12:23.179809 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:12:23.179809 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:23.179809 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 272/527] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 25 13:12:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:23.186030 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60468f-2bed-4890-8e84-636aa1965229 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:23.190266 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:23.288417 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d7583-3e4e-4402-91e9-d7052f542881 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:23.288713 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d7583-3e4e-4402-91e9-d7052f542881 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:23.288895 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d7583-3e4e-4402-91e9-d7052f542881 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:23.290449 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 273/528] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:23.295848 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4b86d-db8e-4632-8a54-c4499a86ae79 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:23.297224 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4b86d-db8e-4632-8a54-c4499a86ae79 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:23.297990 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4b86d-db8e-4632-8a54-c4499a86ae79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:23.323853 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-b2d4b86d-db8e-4632-8a54-c4499a86ae79 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:23.325069 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b2d4b86d-db8e-4632-8a54-c4499a86ae79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:23.337049 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60468f-2bed-4890-8e84-636aa1965229 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:23.393983 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 274/529] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 25 13:12:23.408011 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fd98d-a246-42e5-b7c0-72b87c4fa7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:23.408655 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fd98d-a246-42e5-b7c0-72b87c4fa7bc None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:23.408940 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fd98d-a246-42e5-b7c0-72b87c4fa7bc None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:23.409217 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fd98d-a246-42e5-b7c0-72b87c4fa7bc None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:23.409915 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672fd98d-a246-42e5-b7c0-72b87c4fa7bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:23.410225 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672fd98d-a246-42e5-b7c0-72b87c4fa7bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:23.411710 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672fd98d-a246-42e5-b7c0-72b87c4fa7bc None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:23.435200 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 256/530] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 25 13:12:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:23.440921 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4b86d-db8e-4632-8a54-c4499a86ae79 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:23.467178 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:23.593827 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4b86d-db8e-4632-8a54-c4499a86ae79 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:23.635480 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4e4a9-3dd1-4e1e-8c19-2039e2c4bc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:23.636518 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4e4a9-3dd1-4e1e-8c19-2039e2c4bc00 None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:23.637027 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4e4a9-3dd1-4e1e-8c19-2039e2c4bc00 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:23.637524 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4e4a9-3dd1-4e1e-8c19-2039e2c4bc00 None admin] PATH_INFO: `/v3/projects/616ecfe8d2c74aad9386720718392e81/users/63e73c00cadb4deea934db6111ed76d5/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:23.639663 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e4e4a9-3dd1-4e1e-8c19-2039e2c4bc00 None admin] RBAC: Authorizing `identity:create_grant(project_id=616ecfe8d2c74aad9386720718392e81, user_id=63e73c00cadb4deea934db6111ed76d5, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:23.641663 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e4e4a9-3dd1-4e1e-8c19-2039e2c4bc00 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:23.664453 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 275/531] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 25 13:12:23 2022] PUT /identity/v3/projects/616ecfe8d2c74aad9386720718392e81/users/63e73c00cadb4deea934db6111ed76d5/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:12:23.848210 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fd98d-a246-42e5-b7c0-72b87c4fa7bc None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:23.930676 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:23.986407 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fd98d-a246-42e5-b7c0-72b87c4fa7bc None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:24.033354 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd6e10-fc74-4b37-8071-181032368f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:24.034376 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd6e10-fc74-4b37-8071-181032368f97 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:24.034856 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd6e10-fc74-4b37-8071-181032368f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:24.035327 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd6e10-fc74-4b37-8071-181032368f97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:24.054267 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd6e10-fc74-4b37-8071-181032368f97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:12:24.059863 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-2ddd6e10-fc74-4b37-8071-181032368f97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 13:12:24.059863 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:24.059863 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:24.059863 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:24.059863 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:24.059863 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:24.059863 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:24.059863 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:24.059863 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:24.059863 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:24.059863 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:24.059863 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:24.059863 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:12:24.059863 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:12:24.059863 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:12:24.059863 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:12:24.060804 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:12:24.060804 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:12:24.060804 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:12:24.060804 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:12:24.060804 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:24.060804 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:24.060804 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:24.060804 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:24.060804 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:24.060804 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:24.060804 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:24.060804 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:24.060804 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:24.060804 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:24.060804 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:24.060804 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:24.061647 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:24.061647 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:24.061647 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:24.061647 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:24.061647 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:12:24.061647 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:12:24.061647 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:12:24.061647 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:12:24.061647 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:12:24.061647 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:12:24.061647 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 13:12:24.061647 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:24.064013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 257/532] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 25 13:12:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:24.069811 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4e4a9-3dd1-4e1e-8c19-2039e2c4bc00 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:24.183508 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:24.217880 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4e4a9-3dd1-4e1e-8c19-2039e2c4bc00 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:24.266784 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eff047-7ede-454e-ae06-918ca3d83abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:24.267396 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eff047-7ede-454e-ae06-918ca3d83abd None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:24.267680 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eff047-7ede-454e-ae06-918ca3d83abd None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:24.267976 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eff047-7ede-454e-ae06-918ca3d83abd None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:24.268640 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eff047-7ede-454e-ae06-918ca3d83abd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:24.268942 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eff047-7ede-454e-ae06-918ca3d83abd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:24.270309 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eff047-7ede-454e-ae06-918ca3d83abd None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:24.283941 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 276/533] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 25 13:12:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:24.289353 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd6e10-fc74-4b37-8071-181032368f97 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:24.434652 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd6e10-fc74-4b37-8071-181032368f97 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:24.466468 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:24.484869 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab99bc1-6c94-47fc-bc86-d472ba37aef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:24.485491 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab99bc1-6c94-47fc-bc86-d472ba37aef3 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:24.485771 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab99bc1-6c94-47fc-bc86-d472ba37aef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:24.486041 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab99bc1-6c94-47fc-bc86-d472ba37aef3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:24.503073 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab99bc1-6c94-47fc-bc86-d472ba37aef3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:24.504556 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab99bc1-6c94-47fc-bc86-d472ba37aef3 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:24.523046 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-bab99bc1-6c94-47fc-bc86-d472ba37aef3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:24.523046 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:24.523046 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:24.523046 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:24.523046 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:24.523046 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:24.523046 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:24.523046 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:24.523046 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:24.523046 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:24.523046 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:24.523046 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:24.523046 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:12:24.523046 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:12:24.523046 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:12:24.523046 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:12:24.524065 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:24.524065 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:24.524065 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:24.524065 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:24.524065 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:24.524065 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:24.524065 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:24.524065 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:24.524065 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:24.524065 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:24.524065 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:24.524065 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:24.524065 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:24.524065 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:24.524065 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:24.524065 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:24.524065 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:12:24.524958 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:12:24.524958 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:24.524958 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:24.528554 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 258/534] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:24.534022 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eff047-7ede-454e-ae06-918ca3d83abd None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:24.694477 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585acdf1-788c-4844-9798-86f1e49ce11a None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:24.694827 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585acdf1-788c-4844-9798-86f1e49ce11a None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:24.695002 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585acdf1-788c-4844-9798-86f1e49ce11a None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:24.696689 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 259/535] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:24.702068 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87c5ef-295c-4283-b84c-3e5f158e79b1 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:24.702424 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87c5ef-295c-4283-b84c-3e5f158e79b1 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:24.703150 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87c5ef-295c-4283-b84c-3e5f158e79b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:24.732170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-2e87c5ef-295c-4283-b84c-3e5f158e79b1 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:24.735696 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2e87c5ef-295c-4283-b84c-3e5f158e79b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:24.743447 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eff047-7ede-454e-ae06-918ca3d83abd None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:24.813901 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 260/536] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 25 13:12:24.836619 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6578afb-0e8e-4bb8-ad33-238faf89d541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:24.837249 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6578afb-0e8e-4bb8-ad33-238faf89d541 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:24.837534 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6578afb-0e8e-4bb8-ad33-238faf89d541 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:24.837812 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6578afb-0e8e-4bb8-ad33-238faf89d541 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:24.838464 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6578afb-0e8e-4bb8-ad33-238faf89d541 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:24.838770 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6578afb-0e8e-4bb8-ad33-238faf89d541 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:24.840180 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6578afb-0e8e-4bb8-ad33-238faf89d541 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:24.852223 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:24.861848 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 277/537] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:24.866934 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87c5ef-295c-4283-b84c-3e5f158e79b1 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:24.883413 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ac553-4138-4e1b-b413-5107061a5760 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:24.883413 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ac553-4138-4e1b-b413-5107061a5760 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:24.883413 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ac553-4138-4e1b-b413-5107061a5760 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:24.883413 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 278/538] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 13:12:24.885294 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a9db1-67cd-47b2-a605-d571f9042c7b None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:24.885579 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a9db1-67cd-47b2-a605-d571f9042c7b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:24.885857 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a9db1-67cd-47b2-a605-d571f9042c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:24.905278 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-fc5a9db1-67cd-47b2-a605-d571f9042c7b None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:24.907467 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fc5a9db1-67cd-47b2-a605-d571f9042c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:25.028832 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87c5ef-295c-4283-b84c-3e5f158e79b1 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:25.054299 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:25.057016 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 279/539] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:12:25.091319 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2adc78-31cf-4244-b2b4-27603cb1c961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:25.091969 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2adc78-31cf-4244-b2b4-27603cb1c961 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:25.092253 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2adc78-31cf-4244-b2b4-27603cb1c961 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:25.092528 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2adc78-31cf-4244-b2b4-27603cb1c961 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:25.104987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2adc78-31cf-4244-b2b4-27603cb1c961 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:25.106495 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2adc78-31cf-4244-b2b4-27603cb1c961 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:25.118523 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-dd2adc78-31cf-4244-b2b4-27603cb1c961 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 25 13:12:25.118523 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:25.118523 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:25.118523 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:25.118523 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:25.118523 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:25.118523 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:25.118523 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:25.118523 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:25.118523 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:25.118523 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:25.118523 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:25.118523 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 25 13:12:25.118523 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 25 13:12:25.118523 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 25 13:12:25.118523 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 25 13:12:25.119466 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:25.119466 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:25.119466 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 25 13:12:25.119466 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:12:25.119466 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 25 13:12:25.119466 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:12:25.119466 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:25.119466 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:25.119466 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:25.119466 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:25.119466 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:25.119466 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:25.119466 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:25.119466 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:25.119466 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:25.119466 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:25.119466 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:25.119466 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:25.120448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:25.120448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:25.120448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 25 13:12:25.120448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 25 13:12:25.120448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 25 13:12:25.120448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 25 13:12:25.120448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 25 13:12:25.120448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 25 13:12:25.120448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 25 13:12:25.120448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:25.120448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 261/540] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 25 13:12:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:25.126929 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a9db1-67cd-47b2-a605-d571f9042c7b None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:25.199092 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2adc78-31cf-4244-b2b4-27603cb1c961 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:25.273781 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a9db1-67cd-47b2-a605-d571f9042c7b None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:25.335122 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2adc78-31cf-4244-b2b4-27603cb1c961 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:25.345481 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:25.372213 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09cfd65-2bd8-4fd7-a824-5811a4f22abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:25.372826 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09cfd65-2bd8-4fd7-a824-5811a4f22abf None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:25.373106 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09cfd65-2bd8-4fd7-a824-5811a4f22abf None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:25.373380 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09cfd65-2bd8-4fd7-a824-5811a4f22abf None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:25.374111 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09cfd65-2bd8-4fd7-a824-5811a4f22abf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:25.375135 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09cfd65-2bd8-4fd7-a824-5811a4f22abf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:25.376386 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09cfd65-2bd8-4fd7-a824-5811a4f22abf None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:25.387806 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4edf4b4-378c-4724-8879-3418a2cfc1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:25.388448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edf4b4-378c-4724-8879-3418a2cfc1ff None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:25.388726 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edf4b4-378c-4724-8879-3418a2cfc1ff None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:25.388997 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edf4b4-378c-4724-8879-3418a2cfc1ff None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:25.389674 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4edf4b4-378c-4724-8879-3418a2cfc1ff None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:25.391410 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4edf4b4-378c-4724-8879-3418a2cfc1ff None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:25.395272 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 280/541] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Oct 25 13:12:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:25.400747 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09cfd65-2bd8-4fd7-a824-5811a4f22abf None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:25.413737 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 262/542] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Oct 25 13:12:25 2022] POST /identity/v3/services => generated 240 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:12:25.415126 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4edf4b4-378c-4724-8879-3418a2cfc1ff None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:25.478592 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:25.553820 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09cfd65-2bd8-4fd7-a824-5811a4f22abf None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:25.614850 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b5c4e-8b01-4040-8ed6-9e838c8f7f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:25.615566 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b5c4e-8b01-4040-8ed6-9e838c8f7f9e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:25.615965 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b5c4e-8b01-4040-8ed6-9e838c8f7f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:25.616335 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b5c4e-8b01-4040-8ed6-9e838c8f7f9e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:25.617594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4edf4b4-378c-4724-8879-3418a2cfc1ff None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:25.630087 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b5c4e-8b01-4040-8ed6-9e838c8f7f9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:12:25.635564 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-a06b5c4e-8b01-4040-8ed6-9e838c8f7f9e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 13:12:25.635564 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:25.635564 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:25.635564 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:25.635564 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:25.635564 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:25.635564 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:25.635564 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:25.635564 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:25.635564 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:25.635564 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:25.635564 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:25.635564 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:12:25.635564 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:12:25.635564 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:12:25.635564 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:12:25.636791 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:12:25.636791 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:12:25.636791 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:12:25.636791 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:12:25.636791 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:25.636791 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:25.636791 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:25.636791 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:25.636791 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:25.636791 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:25.636791 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:25.636791 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:25.636791 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:25.636791 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:25.636791 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:25.636791 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:25.637840 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:25.637840 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:25.637840 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:25.637840 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:25.637840 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:12:25.637840 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:12:25.637840 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:12:25.637840 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:12:25.637840 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:12:25.637840 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:12:25.637840 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 25 13:12:25.637840 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:25.644057 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 281/543] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 25 13:12:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 13:12:25.646230 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd3e72-888d-4056-96de-aab148266412 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:25.646230 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd3e72-888d-4056-96de-aab148266412 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:25.646230 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd3e72-888d-4056-96de-aab148266412 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:25.648171 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 282/544] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:25.648861 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd3e72-888d-4056-96de-aab148266412 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:25.663818 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65848eae-f1e6-4712-b649-4b891a24687e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:25.664754 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65848eae-f1e6-4712-b649-4b891a24687e None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:25.665033 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65848eae-f1e6-4712-b649-4b891a24687e None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:25.665305 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65848eae-f1e6-4712-b649-4b891a24687e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:25.680525 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65848eae-f1e6-4712-b649-4b891a24687e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:25.682421 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65848eae-f1e6-4712-b649-4b891a24687e None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:25.699935 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:25.701702 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-65848eae-f1e6-4712-b649-4b891a24687e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:25.701702 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:25.701702 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:25.701702 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:25.701702 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:25.701702 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:25.701702 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:25.701702 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:25.701702 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:25.701702 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:25.701702 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:25.701702 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:25.701702 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:12:25.701702 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:12:25.701702 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:12:25.701702 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:12:25.705285 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:25.705285 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:25.705285 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:25.705285 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:25.705285 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:25.705285 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:25.705285 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:25.705285 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:25.705285 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:25.705285 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:25.705285 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:25.705285 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:25.705285 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:25.705285 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:25.705285 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:25.705285 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:25.705285 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:12:25.706319 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:12:25.706319 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:25.706319 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:25.706319 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 263/545] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:25.706319 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3761c-53a6-4c44-a822-3564097b37b3 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:25.706319 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3761c-53a6-4c44-a822-3564097b37b3 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:25.706319 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3761c-53a6-4c44-a822-3564097b37b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:25.734463 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-f5e3761c-53a6-4c44-a822-3564097b37b3 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:25.735021 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-f5e3761c-53a6-4c44-a822-3564097b37b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:25.808261 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd3e72-888d-4056-96de-aab148266412 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:25.816162 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 264/546] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:25 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 25 13:12:25.817171 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3761c-53a6-4c44-a822-3564097b37b3 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:25.828976 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:25.852865 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5e283-ea28-411a-afdb-844a21bc1ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:25.856395 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5e283-ea28-411a-afdb-844a21bc1ceb None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:25.856832 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5e283-ea28-411a-afdb-844a21bc1ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:25.857288 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5e283-ea28-411a-afdb-844a21bc1ceb None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:25.858233 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5e283-ea28-411a-afdb-844a21bc1ceb None admin] RBAC: Adding query filter params (name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:25.858769 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5e283-ea28-411a-afdb-844a21bc1ceb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:25.863443 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5e283-ea28-411a-afdb-844a21bc1ceb None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:25.876077 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 283/547] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 25 13:12:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:12:25.881460 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5e283-ea28-411a-afdb-844a21bc1ceb None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:26.023671 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5e283-ea28-411a-afdb-844a21bc1ceb None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:26.032316 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:26.047629 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3761c-53a6-4c44-a822-3564097b37b3 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:26.066220 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bace3cb-0dba-4fff-8d1b-c97af0e32811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:26.067390 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bace3cb-0dba-4fff-8d1b-c97af0e32811 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:26.067846 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bace3cb-0dba-4fff-8d1b-c97af0e32811 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:26.068425 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bace3cb-0dba-4fff-8d1b-c97af0e32811 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:26.080190 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bace3cb-0dba-4fff-8d1b-c97af0e32811 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:26.082161 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bace3cb-0dba-4fff-8d1b-c97af0e32811 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:26.098683 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-3bace3cb-0dba-4fff-8d1b-c97af0e32811 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:26.098683 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:26.098683 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:26.098683 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:26.098683 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:26.098683 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:26.098683 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:26.098683 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:26.098683 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:26.098683 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:26.098683 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:26.098683 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:26.098683 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:12:26.098683 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:12:26.098683 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:12:26.098683 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:12:26.099855 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:26.099855 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:26.099855 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:26.099855 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:26.099855 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:26.099855 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:26.099855 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:26.099855 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:26.099855 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:26.099855 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:26.099855 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:26.099855 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:26.099855 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:26.099855 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:26.099855 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:26.099855 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:26.099855 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:12:26.100780 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:12:26.100780 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:26.100780 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:26.102689 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 284/548] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:26.110317 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bace3cb-0dba-4fff-8d1b-c97af0e32811 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:26.118074 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3108a-2d0f-48ad-9ec7-e426b2068bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:26.118492 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3108a-2d0f-48ad-9ec7-e426b2068bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:26.118765 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3108a-2d0f-48ad-9ec7-e426b2068bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:26.119038 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3108a-2d0f-48ad-9ec7-e426b2068bc2 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:26.119668 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3108a-2d0f-48ad-9ec7-e426b2068bc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:26.119998 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3108a-2d0f-48ad-9ec7-e426b2068bc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:26.121359 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3108a-2d0f-48ad-9ec7-e426b2068bc2 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:26.137600 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 265/549] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:26.138386 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3108a-2d0f-48ad-9ec7-e426b2068bc2 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:26.208959 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:26.239911 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bace3cb-0dba-4fff-8d1b-c97af0e32811 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:26.244779 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3108a-2d0f-48ad-9ec7-e426b2068bc2 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:26.283646 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de140c91-d755-4cc4-abee-93cd5eba3d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:26.284282 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de140c91-d755-4cc4-abee-93cd5eba3d6f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:26.284572 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de140c91-d755-4cc4-abee-93cd5eba3d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:26.284829 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de140c91-d755-4cc4-abee-93cd5eba3d6f None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:26.285525 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de140c91-d755-4cc4-abee-93cd5eba3d6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:26.285757 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de140c91-d755-4cc4-abee-93cd5eba3d6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:26.287339 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de140c91-d755-4cc4-abee-93cd5eba3d6f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:26.293748 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8477e93-1e5c-4f6c-89d0-9e1157575b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:26.294598 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8477e93-1e5c-4f6c-89d0-9e1157575b22 None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:26.295096 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8477e93-1e5c-4f6c-89d0-9e1157575b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:26.296082 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8477e93-1e5c-4f6c-89d0-9e1157575b22 None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:26.297635 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8477e93-1e5c-4f6c-89d0-9e1157575b22 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:26.300014 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8477e93-1e5c-4f6c-89d0-9e1157575b22 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:26.306124 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 285/550] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:26.307290 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de140c91-d755-4cc4-abee-93cd5eba3d6f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:26.323925 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 266/551] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Oct 25 13:12:26 2022] POST /identity/v3/services => generated 251 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:12:26.325453 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8477e93-1e5c-4f6c-89d0-9e1157575b22 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:26.326379 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:26.428646 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de140c91-d755-4cc4-abee-93cd5eba3d6f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:26.460831 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8477e93-1e5c-4f6c-89d0-9e1157575b22 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:26.466786 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b23be0-c7da-4176-9d73-498e52cf237c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:26.467415 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b23be0-c7da-4176-9d73-498e52cf237c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:26.467695 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b23be0-c7da-4176-9d73-498e52cf237c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:26.468010 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b23be0-c7da-4176-9d73-498e52cf237c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:26.476270 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b23be0-c7da-4176-9d73-498e52cf237c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:26.477862 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b23be0-c7da-4176-9d73-498e52cf237c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:26.489820 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:26.492332 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-32b23be0-c7da-4176-9d73-498e52cf237c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:12:26.492332 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:26.492332 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:26.492332 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:26.492332 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:26.492332 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:26.492332 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:26.492332 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:26.492332 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:26.492332 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:26.492332 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:26.492332 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:26.492332 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 25 13:12:26.492332 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 25 13:12:26.492332 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 25 13:12:26.493624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 25 13:12:26.493624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:26.493624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:26.493624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:26.493624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:26.493624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:26.493624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:26.493624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:26.493624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:26.493624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:26.493624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:26.493624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:26.493624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:26.493624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:26.493624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:26.493624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:26.493624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:26.494519 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 25 13:12:26.494519 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 25 13:12:26.494519 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 25 13:12:26.494519 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 25 13:12:26.494519 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 25 13:12:26.494519 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 25 13:12:26.494519 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:12:26.494519 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:26.494519 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 286/552] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 25 13:12:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:26.495016 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c47b0-c4d3-421e-a491-cdb5df6d1fa5 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:26.495016 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c47b0-c4d3-421e-a491-cdb5df6d1fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:26.500131 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c47b0-c4d3-421e-a491-cdb5df6d1fa5 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:26.501316 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 287/553] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:26.502280 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c47b0-c4d3-421e-a491-cdb5df6d1fa5 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:26.518331 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d7ebb-0be7-4c31-8137-b1e0c6a8da26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:26.519326 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d7ebb-0be7-4c31-8137-b1e0c6a8da26 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:26.519788 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d7ebb-0be7-4c31-8137-b1e0c6a8da26 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:26.520505 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d7ebb-0be7-4c31-8137-b1e0c6a8da26 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:26.529429 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06d7ebb-0be7-4c31-8137-b1e0c6a8da26 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:26.531880 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06d7ebb-0be7-4c31-8137-b1e0c6a8da26 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:26.546300 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-d06d7ebb-0be7-4c31-8137-b1e0c6a8da26 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 25 13:12:26.546300 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:26.546300 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:26.546300 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:26.546300 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:26.546300 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:26.546300 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:26.546300 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:26.546300 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:26.546300 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:26.546300 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:26.546300 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:26.546300 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 25 13:12:26.546300 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 25 13:12:26.546300 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 25 13:12:26.546300 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 25 13:12:26.548228 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:26.548228 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:26.548228 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 25 13:12:26.548228 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:12:26.548228 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 25 13:12:26.548228 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:12:26.548228 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:26.548228 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:26.548228 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:26.548228 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:26.548228 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:26.548228 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:26.548228 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:26.548228 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:26.548228 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:26.548228 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:26.548228 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:26.548228 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:26.549161 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:26.549161 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:26.549161 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 25 13:12:26.549161 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 25 13:12:26.549161 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 25 13:12:26.549161 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 25 13:12:26.549161 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 25 13:12:26.549161 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 25 13:12:26.549161 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 25 13:12:26.549161 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:26.555165 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 267/554] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Oct 25 13:12:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:26.555165 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97126056-e10e-485b-8528-f62fa909a8bb None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:26.555165 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97126056-e10e-485b-8528-f62fa909a8bb None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:26.555165 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97126056-e10e-485b-8528-f62fa909a8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:26.577773 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-97126056-e10e-485b-8528-f62fa909a8bb None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:26.579263 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-97126056-e10e-485b-8528-f62fa909a8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:26.602971 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:26.630263 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c47b0-c4d3-421e-a491-cdb5df6d1fa5 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:26.664853 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 268/555] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 13:12:26.665763 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98712e80-95fe-4b59-85ba-33802d55a4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:26.666141 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97126056-e10e-485b-8528-f62fa909a8bb None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:26.666680 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98712e80-95fe-4b59-85ba-33802d55a4fb None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:26.667005 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98712e80-95fe-4b59-85ba-33802d55a4fb None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:26.667388 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98712e80-95fe-4b59-85ba-33802d55a4fb None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:26.668450 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98712e80-95fe-4b59-85ba-33802d55a4fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:26.668848 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98712e80-95fe-4b59-85ba-33802d55a4fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:26.670366 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98712e80-95fe-4b59-85ba-33802d55a4fb None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:26.684328 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 288/556] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 25 13:12:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:26.692382 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98712e80-95fe-4b59-85ba-33802d55a4fb None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:26.791310 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97126056-e10e-485b-8528-f62fa909a8bb None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:26.806071 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:26.829126 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e8dac-506f-457e-91f8-7d7485902943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:26.829865 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e8dac-506f-457e-91f8-7d7485902943 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:26.830143 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e8dac-506f-457e-91f8-7d7485902943 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:26.830416 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e8dac-506f-457e-91f8-7d7485902943 None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:26.831139 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e8dac-506f-457e-91f8-7d7485902943 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:26.831441 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e8dac-506f-457e-91f8-7d7485902943 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:26.833004 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e8dac-506f-457e-91f8-7d7485902943 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:26.856442 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 269/557] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Oct 25 13:12:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:26.857670 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e8dac-506f-457e-91f8-7d7485902943 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:26.957337 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98712e80-95fe-4b59-85ba-33802d55a4fb None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:26.962900 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e8dac-506f-457e-91f8-7d7485902943 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:27.001152 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dce27b-5de3-4be0-bbf4-549d5b68dcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:27.001779 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dce27b-5de3-4be0-bbf4-549d5b68dcc6 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:27.002053 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dce27b-5de3-4be0-bbf4-549d5b68dcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:27.002323 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dce27b-5de3-4be0-bbf4-549d5b68dcc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:27.012885 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dce27b-5de3-4be0-bbf4-549d5b68dcc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:27.013418 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874cb488-7e97-4815-b1ad-bb5c21f8da9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:27.014321 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dce27b-5de3-4be0-bbf4-549d5b68dcc6 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:27.014431 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874cb488-7e97-4815-b1ad-bb5c21f8da9b None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:27.015581 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874cb488-7e97-4815-b1ad-bb5c21f8da9b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:27.016206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874cb488-7e97-4815-b1ad-bb5c21f8da9b None admin] PATH_INFO: `/v3/projects/616ecfe8d2c74aad9386720718392e81/users/07413369b0c14e878d04ee528487801d/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:27.018836 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874cb488-7e97-4815-b1ad-bb5c21f8da9b None admin] RBAC: Authorizing `identity:create_grant(project_id=616ecfe8d2c74aad9386720718392e81, user_id=07413369b0c14e878d04ee528487801d, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:27.020551 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874cb488-7e97-4815-b1ad-bb5c21f8da9b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:27.023505 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:27.032062 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-55dce27b-5de3-4be0-bbf4-549d5b68dcc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:27.032062 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:27.032062 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:27.032062 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:27.032062 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:27.032062 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:27.032062 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:27.032062 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:27.032062 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:27.032062 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:27.032062 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:27.032062 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:27.032062 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:12:27.032062 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:12:27.032062 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:12:27.032062 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:12:27.033099 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:27.033099 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:27.033099 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:27.033099 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:27.033099 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:27.033099 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:27.033099 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:27.033099 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:27.033099 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:27.033099 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:27.033099 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:27.033099 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:27.033099 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:27.033099 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:27.033099 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:27.033099 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:27.033099 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:12:27.034029 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:12:27.034029 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:27.034029 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:27.037956 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 270/558] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:27.038754 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dce27b-5de3-4be0-bbf4-549d5b68dcc6 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:27.044832 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 289/559] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 25 13:12:26 2022] PUT /identity/v3/projects/616ecfe8d2c74aad9386720718392e81/users/07413369b0c14e878d04ee528487801d/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:12:27.045949 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874cb488-7e97-4815-b1ad-bb5c21f8da9b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:27.104270 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:27.166294 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dce27b-5de3-4be0-bbf4-549d5b68dcc6 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:27.178867 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874cb488-7e97-4815-b1ad-bb5c21f8da9b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:27.217368 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f40fa-2977-4460-bfdc-afe127cb7f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:27.217906 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f40fa-2977-4460-bfdc-afe127cb7f0e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:27.218323 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f40fa-2977-4460-bfdc-afe127cb7f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:27.218730 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f40fa-2977-4460-bfdc-afe127cb7f0e None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:27.219354 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f40fa-2977-4460-bfdc-afe127cb7f0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:27.219698 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f40fa-2977-4460-bfdc-afe127cb7f0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:27.220599 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2ef69-c937-4640-80e9-d996a08622d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:27.221104 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f40fa-2977-4460-bfdc-afe127cb7f0e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:27.221758 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2ef69-c937-4640-80e9-d996a08622d6 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:27.222258 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2ef69-c937-4640-80e9-d996a08622d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:27.223061 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2ef69-c937-4640-80e9-d996a08622d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:27.242998 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 290/560] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:27.249960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f40fa-2977-4460-bfdc-afe127cb7f0e None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:27.257262 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f2ef69-c937-4640-80e9-d996a08622d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:12:27.268604 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-00f2ef69-c937-4640-80e9-d996a08622d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 13:12:27.268604 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:27.268604 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:27.268604 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:27.268604 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:27.268604 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:27.268604 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:27.268604 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:27.268604 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:27.268604 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:27.268604 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:27.268604 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:27.268604 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:12:27.268604 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:12:27.268604 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:12:27.268604 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:12:27.269615 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:12:27.269615 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:12:27.269615 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:12:27.269615 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:12:27.269615 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:27.269615 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:27.269615 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:27.269615 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:27.269615 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:27.269615 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:27.269615 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:27.269615 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:27.269615 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:27.269615 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:27.269615 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:27.269615 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:27.270474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:27.270474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:27.270474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:27.270474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:27.270474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:12:27.270474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:12:27.270474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:12:27.270474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:12:27.270474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:12:27.270474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:12:27.270474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 13:12:27.270474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:27.270474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 271/561] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 25 13:12:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:27.278555 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2ef69-c937-4640-80e9-d996a08622d6 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:27.355844 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:27.408087 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:27.413875 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f40fa-2977-4460-bfdc-afe127cb7f0e None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:27.433997 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2ef69-c937-4640-80e9-d996a08622d6 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:27.460766 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a1cf4-9dcd-4922-a7f9-2a0e420f7f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:27.461411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a1cf4-9dcd-4922-a7f9-2a0e420f7f9c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:27.461696 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a1cf4-9dcd-4922-a7f9-2a0e420f7f9c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:27.461968 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a1cf4-9dcd-4922-a7f9-2a0e420f7f9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:27.470737 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a1cf4-9dcd-4922-a7f9-2a0e420f7f9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:27.472818 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a1cf4-9dcd-4922-a7f9-2a0e420f7f9c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:27.493005 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-a96a1cf4-9dcd-4922-a7f9-2a0e420f7f9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:12:27.493005 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:27.493005 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:27.493005 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:27.493005 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:27.493005 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:27.493005 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:27.493005 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:27.493005 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:27.493005 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:27.493005 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:27.493005 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:27.493005 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 25 13:12:27.493005 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 25 13:12:27.493005 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 25 13:12:27.494141 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 25 13:12:27.494141 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:27.494141 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:27.494141 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:27.494141 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:27.494141 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:27.494141 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:27.494141 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:27.494141 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:27.494141 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:27.494141 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:27.494141 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:27.494141 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:27.494141 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:27.494141 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:27.494141 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:27.494141 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:27.495267 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 25 13:12:27.495267 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 25 13:12:27.495267 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 25 13:12:27.495267 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 25 13:12:27.495267 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 25 13:12:27.495267 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 25 13:12:27.495267 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:12:27.495267 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:27.498836 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 291/562] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 25 13:12:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:27.500685 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a1cf4-9dcd-4922-a7f9-2a0e420f7f9c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:27.504622 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edc242-767b-4251-9789-c734c01f2fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:27.505250 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edc242-767b-4251-9789-c734c01f2fa8 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:27.505536 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edc242-767b-4251-9789-c734c01f2fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:27.505812 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edc242-767b-4251-9789-c734c01f2fa8 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:27.506490 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95edc242-767b-4251-9789-c734c01f2fa8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:27.506794 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95edc242-767b-4251-9789-c734c01f2fa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:27.508213 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95edc242-767b-4251-9789-c734c01f2fa8 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:27.530256 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 272/563] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 25 13:12:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:27.540921 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edc242-767b-4251-9789-c734c01f2fa8 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:27.628011 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a1cf4-9dcd-4922-a7f9-2a0e420f7f9c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:27.645883 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:27.667296 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb9790-6bd9-4813-a888-6c46d41fcf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:27.676359 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb9790-6bd9-4813-a888-6c46d41fcf6b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:27.676649 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb9790-6bd9-4813-a888-6c46d41fcf6b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:27.676929 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb9790-6bd9-4813-a888-6c46d41fcf6b None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:27.678521 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb9790-6bd9-4813-a888-6c46d41fcf6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:27.678837 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb9790-6bd9-4813-a888-6c46d41fcf6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:27.680335 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb9790-6bd9-4813-a888-6c46d41fcf6b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:27.709019 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 292/564] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 25 13:12:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:27.717931 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb9790-6bd9-4813-a888-6c46d41fcf6b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:27.791333 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edc242-767b-4251-9789-c734c01f2fa8 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:27.835484 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d339e4c-dba4-4ba1-8b8b-56655338208c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:27.836161 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d339e4c-dba4-4ba1-8b8b-56655338208c None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:27.836436 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d339e4c-dba4-4ba1-8b8b-56655338208c None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:27.836705 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d339e4c-dba4-4ba1-8b8b-56655338208c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:27.848813 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d339e4c-dba4-4ba1-8b8b-56655338208c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:27.849944 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d339e4c-dba4-4ba1-8b8b-56655338208c None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:27.854340 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:27.867801 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-4d339e4c-dba4-4ba1-8b8b-56655338208c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:27.867801 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:27.867801 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:27.867801 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:27.867801 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:27.867801 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:27.867801 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:27.867801 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:27.867801 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:27.867801 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:27.867801 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:27.867801 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:27.867801 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:12:27.867801 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:12:27.867801 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:12:27.867801 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:12:27.868845 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:27.868845 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:27.868845 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:27.868845 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:27.868845 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:27.868845 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:27.868845 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:27.868845 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:27.868845 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:27.868845 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:27.868845 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:27.868845 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:27.868845 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:27.868845 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:27.868845 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:27.868845 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:27.868845 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:12:27.872947 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:12:27.872947 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:27.872947 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:27.872947 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 273/565] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:27.875451 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d339e4c-dba4-4ba1-8b8b-56655338208c None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:27.893849 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb9790-6bd9-4813-a888-6c46d41fcf6b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:27.931788 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb56ff-aaac-4740-9c7f-99b1e1bdd7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:27.932583 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb56ff-aaac-4740-9c7f-99b1e1bdd7e1 None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:27.932867 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb56ff-aaac-4740-9c7f-99b1e1bdd7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:27.933140 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb56ff-aaac-4740-9c7f-99b1e1bdd7e1 None admin] PATH_INFO: `/v3/projects/616ecfe8d2c74aad9386720718392e81/users/9d5d4691dca848d58bd280d2fad79fbe/roles/b3a463dfc621439eaee93c0551a4e296` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:27.948672 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb56ff-aaac-4740-9c7f-99b1e1bdd7e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=616ecfe8d2c74aad9386720718392e81, user_id=9d5d4691dca848d58bd280d2fad79fbe, role_id=b3a463dfc621439eaee93c0551a4e296)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:27.950223 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb56ff-aaac-4740-9c7f-99b1e1bdd7e1 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:27.964935 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 293/566] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 25 13:12:27 2022] PUT /identity/v3/projects/616ecfe8d2c74aad9386720718392e81/users/9d5d4691dca848d58bd280d2fad79fbe/roles/b3a463dfc621439eaee93c0551a4e296 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:12:27.966253 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f21b1-2059-495f-8ba1-bd117ed09b23 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:27.966572 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f21b1-2059-495f-8ba1-bd117ed09b23 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:27.966967 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f21b1-2059-495f-8ba1-bd117ed09b23 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:27.972141 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 294/567] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:27.974927 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e75874-b9e1-4501-b0df-2b13e5c3bfc5 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:27.975146 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e75874-b9e1-4501-b0df-2b13e5c3bfc5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:27.975418 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e75874-b9e1-4501-b0df-2b13e5c3bfc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:27.995993 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d339e4c-dba4-4ba1-8b8b-56655338208c None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:27.996312 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d1e75874-b9e1-4501-b0df-2b13e5c3bfc5 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:27.997626 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d1e75874-b9e1-4501-b0df-2b13e5c3bfc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:28.024360 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:28.036450 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa159745-315c-4615-b2ca-37ec6a0d5747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:28.037062 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa159745-315c-4615-b2ca-37ec6a0d5747 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:28.037341 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa159745-315c-4615-b2ca-37ec6a0d5747 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:28.037615 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa159745-315c-4615-b2ca-37ec6a0d5747 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:28.038312 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa159745-315c-4615-b2ca-37ec6a0d5747 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:28.038615 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa159745-315c-4615-b2ca-37ec6a0d5747 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:28.040023 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa159745-315c-4615-b2ca-37ec6a0d5747 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:28.055217 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 274/568] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:28.060636 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa159745-315c-4615-b2ca-37ec6a0d5747 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:28.081270 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 295/569] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 25 13:12:28.141635 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:28.175148 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa159745-315c-4615-b2ca-37ec6a0d5747 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:28.212935 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4126b-7552-401a-a150-c056887feabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:28.213576 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4126b-7552-401a-a150-c056887feabf None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:28.213850 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4126b-7552-401a-a150-c056887feabf None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:28.214121 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4126b-7552-401a-a150-c056887feabf None admin] PATH_INFO: `/v3/users/nova` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:28.223173 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4126b-7552-401a-a150-c056887feabf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:28.224671 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4126b-7552-401a-a150-c056887feabf None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:28.238438 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-8aa4126b-7552-401a-a150-c056887feabf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 25 13:12:28.238438 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:28.238438 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:28.238438 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:28.238438 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:28.238438 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:28.238438 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:28.238438 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:28.238438 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:28.238438 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:28.238438 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:28.238438 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:28.238438 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 25 13:12:28.238438 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 25 13:12:28.238438 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 25 13:12:28.238438 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 25 13:12:28.239517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:28.239517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:28.239517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 25 13:12:28.239517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:12:28.239517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 25 13:12:28.239517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:12:28.239517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:28.239517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:28.239517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:28.239517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:28.239517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:28.239517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:28.239517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:28.239517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:28.239517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:28.239517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:28.239517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:28.239517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:28.240510 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:28.240510 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:28.240510 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 25 13:12:28.240510 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 25 13:12:28.240510 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 25 13:12:28.240510 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 25 13:12:28.240510 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 25 13:12:28.240510 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 25 13:12:28.240510 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 25 13:12:28.240510 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:28.240510 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 275/570] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Oct 25 13:12:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 13:12:28.245484 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e75874-b9e1-4501-b0df-2b13e5c3bfc5 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:28.364928 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e75874-b9e1-4501-b0df-2b13e5c3bfc5 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:28.401574 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39f8fe-077c-448d-a968-1c6d7dce536a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:28.402570 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39f8fe-077c-448d-a968-1c6d7dce536a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:28.403051 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39f8fe-077c-448d-a968-1c6d7dce536a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:28.403542 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39f8fe-077c-448d-a968-1c6d7dce536a None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:28.404491 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39f8fe-077c-448d-a968-1c6d7dce536a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:28.404783 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4126b-7552-401a-a150-c056887feabf None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:28.405221 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39f8fe-077c-448d-a968-1c6d7dce536a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:28.407509 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39f8fe-077c-448d-a968-1c6d7dce536a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:28.426359 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 296/571] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Oct 25 13:12:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:28.434957 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39f8fe-077c-448d-a968-1c6d7dce536a None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:28.456266 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:28.577401 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4126b-7552-401a-a150-c056887feabf None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:28.595883 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:28.600688 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39f8fe-077c-448d-a968-1c6d7dce536a None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:28.615118 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd9fba-52cf-4c54-ae34-7082a39ce4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:28.615747 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd9fba-52cf-4c54-ae34-7082a39ce4bc None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:28.616703 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd9fba-52cf-4c54-ae34-7082a39ce4bc None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:28.616703 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd9fba-52cf-4c54-ae34-7082a39ce4bc None admin] PATH_INFO: `/v3/services/network` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:28.616890 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd9fba-52cf-4c54-ae34-7082a39ce4bc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:28.618227 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd9fba-52cf-4c54-ae34-7082a39ce4bc None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:28.631934 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-c5cd9fba-52cf-4c54-ae34-7082a39ce4bc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 25 13:12:28.631934 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:28.631934 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 13:12:28.631934 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 13:12:28.631934 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 13:12:28.631934 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 13:12:28.631934 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 13:12:28.631934 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:28.631934 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 25 13:12:28.631934 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:28.631934 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 13:12:28.631934 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:28.631934 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:28.631934 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:28.631934 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:28.631934 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:28.631934 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:28.633172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:28.633172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:28.633172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:28.633172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:28.633172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:28.633172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:28.633172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 13:12:28.633172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 13:12:28.633172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 13:12:28.633172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 13:12:28.633172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:28.633172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:28.633172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:28.633172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:28.633172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:28.633172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:28.634214 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:28.634214 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:28.634214 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:28.634214 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:28.634214 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:28.634214 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:28.634214 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:28.634214 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:28.634214 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:28.634214 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:28.634214 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 13:12:28.634214 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:28.634214 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 25 13:12:28.634214 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:28.634214 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 276/572] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 25 13:12:28 2022] GET /identity/v3/services/network => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:28.637853 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd9fba-52cf-4c54-ae34-7082a39ce4bc None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:28.677149 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a5caa-7478-473e-9a75-60e03c134109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:28.678178 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a5caa-7478-473e-9a75-60e03c134109 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:28.679885 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a5caa-7478-473e-9a75-60e03c134109 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:28.681324 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a5caa-7478-473e-9a75-60e03c134109 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:28.822305 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a5caa-7478-473e-9a75-60e03c134109 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:28.823760 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a5caa-7478-473e-9a75-60e03c134109 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:28.842214 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:28.844128 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd9fba-52cf-4c54-ae34-7082a39ce4bc None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:28.899607 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f5c68-9e5f-4a09-b83f-e29a3239294c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:28.908414 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f5c68-9e5f-4a09-b83f-e29a3239294c None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:28.908702 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f5c68-9e5f-4a09-b83f-e29a3239294c None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:28.908977 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f5c68-9e5f-4a09-b83f-e29a3239294c None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:28.909612 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f5c68-9e5f-4a09-b83f-e29a3239294c None admin] RBAC: Adding query filter params (name=network) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:28.909912 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f5c68-9e5f-4a09-b83f-e29a3239294c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:28.911283 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f5c68-9e5f-4a09-b83f-e29a3239294c None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:28.923685 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 277/573] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Oct 25 13:12:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:28.929328 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f5c68-9e5f-4a09-b83f-e29a3239294c None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:28.957552 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 297/574] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 25 13:12:28 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 25 13:12:28.963595 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a5caa-7478-473e-9a75-60e03c134109 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:29.026421 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:29.095971 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a5caa-7478-473e-9a75-60e03c134109 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:29.111463 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:29.139319 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631902c-cd93-4037-a1fc-1f9a3ef56e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:29.140006 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631902c-cd93-4037-a1fc-1f9a3ef56e41 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:29.140282 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631902c-cd93-4037-a1fc-1f9a3ef56e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:29.140553 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631902c-cd93-4037-a1fc-1f9a3ef56e41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:29.159925 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f5c68-9e5f-4a09-b83f-e29a3239294c None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:29.162554 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3631902c-cd93-4037-a1fc-1f9a3ef56e41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:29.164935 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3631902c-cd93-4037-a1fc-1f9a3ef56e41 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:29.193742 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-3631902c-cd93-4037-a1fc-1f9a3ef56e41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:29.193742 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:29.193742 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:29.193742 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:29.193742 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:29.193742 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:29.193742 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:29.193742 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:29.193742 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:29.193742 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:29.193742 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:29.193742 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:29.193742 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:12:29.193742 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:12:29.193742 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:12:29.193742 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:12:29.194773 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:29.194773 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:29.194773 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:29.194773 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:29.194773 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:29.194773 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:29.194773 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:29.194773 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:29.194773 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:29.194773 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:29.194773 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:29.194773 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:29.194773 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:29.194773 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:29.194773 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:29.194773 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:29.194773 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:12:29.196304 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:12:29.196304 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:29.196304 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:29.196304 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 298/575] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:29.196549 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a6127-b643-4e15-9879-13ee0ff51648 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:29.196797 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a6127-b643-4e15-9879-13ee0ff51648 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:29.196958 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a6127-b643-4e15-9879-13ee0ff51648 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:29.198218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 299/576] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:29.203617 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a6127-b643-4e15-9879-13ee0ff51648 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:29.215878 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b440b3-7506-49c6-a9cf-136b211db3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:29.216629 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b440b3-7506-49c6-a9cf-136b211db3e4 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:29.216913 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b440b3-7506-49c6-a9cf-136b211db3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:29.217191 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b440b3-7506-49c6-a9cf-136b211db3e4 None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:29.217941 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b440b3-7506-49c6-a9cf-136b211db3e4 None admin] RBAC: Adding query filter params (type=network) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:29.218202 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b440b3-7506-49c6-a9cf-136b211db3e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:29.219826 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b440b3-7506-49c6-a9cf-136b211db3e4 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:29.230307 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 278/577] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Oct 25 13:12:28 2022] GET /identity/v3/services?type=network => generated 350 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:29.230307 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f58d6e-0457-47b7-af8e-1fc5768a06ae None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:29.230307 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f58d6e-0457-47b7-af8e-1fc5768a06ae None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:29.230307 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f58d6e-0457-47b7-af8e-1fc5768a06ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:29.248553 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-90f58d6e-0457-47b7-af8e-1fc5768a06ae None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:29.249812 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-90f58d6e-0457-47b7-af8e-1fc5768a06ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:29.324004 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 279/578] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 13:12:29.324838 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f58d6e-0457-47b7-af8e-1fc5768a06ae None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:29.341379 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a6127-b643-4e15-9879-13ee0ff51648 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:29.373304 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:29.385838 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d5f34-77fb-4586-81da-903b3ce9eec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:29.386799 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d5f34-77fb-4586-81da-903b3ce9eec6 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:29.387494 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d5f34-77fb-4586-81da-903b3ce9eec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:29.388669 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d5f34-77fb-4586-81da-903b3ce9eec6 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:29.389682 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d5f34-77fb-4586-81da-903b3ce9eec6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:29.392240 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d5f34-77fb-4586-81da-903b3ce9eec6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:29.393863 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d5f34-77fb-4586-81da-903b3ce9eec6 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:29.419135 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 300/579] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:29.431436 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d5f34-77fb-4586-81da-903b3ce9eec6 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:29.469307 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f58d6e-0457-47b7-af8e-1fc5768a06ae None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:29.475847 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:29.516616 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9380f55f-6eed-40b3-a2d2-34ade20a9b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:29.517239 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380f55f-6eed-40b3-a2d2-34ade20a9b84 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:29.517558 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380f55f-6eed-40b3-a2d2-34ade20a9b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:29.517842 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380f55f-6eed-40b3-a2d2-34ade20a9b84 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:29.518554 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9380f55f-6eed-40b3-a2d2-34ade20a9b84 None admin] RBAC: Adding query filter params (interface=public, service_id=133414385cb84ffe902c21dafdbc198c, region_id=RegionOne) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:29.518913 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9380f55f-6eed-40b3-a2d2-34ade20a9b84 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:29.520553 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9380f55f-6eed-40b3-a2d2-34ade20a9b84 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:29.536990 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 280/580] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Oct 25 13:12:29 2022] GET /identity/v3/endpoints?service_id=133414385cb84ffe902c21dafdbc198c&interface=public®ion_id=RegionOne => generated 194 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:29.558057 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9380f55f-6eed-40b3-a2d2-34ade20a9b84 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:29.566705 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d5f34-77fb-4586-81da-903b3ce9eec6 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:29.607934 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324e6b3-a64f-4508-a5a1-3ab691ff0cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:29.609283 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324e6b3-a64f-4508-a5a1-3ab691ff0cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:29.609779 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324e6b3-a64f-4508-a5a1-3ab691ff0cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:29.610262 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324e6b3-a64f-4508-a5a1-3ab691ff0cf9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:29.623615 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8324e6b3-a64f-4508-a5a1-3ab691ff0cf9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:29.627699 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8324e6b3-a64f-4508-a5a1-3ab691ff0cf9 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:29.641075 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-8324e6b3-a64f-4508-a5a1-3ab691ff0cf9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:12:29.641075 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:29.641075 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:29.641075 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:29.641075 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:29.641075 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:29.641075 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:29.641075 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:29.641075 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:29.641075 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:29.641075 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:29.641075 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:29.641075 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 25 13:12:29.641075 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 25 13:12:29.641075 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 25 13:12:29.642078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 25 13:12:29.642078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:29.642078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:29.642078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:29.642078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:29.642078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:29.642078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:29.642078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:29.642078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:29.642078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:29.642078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:29.642078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:29.642078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:29.642078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:29.642078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:29.642078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:29.642078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:29.643249 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 25 13:12:29.643249 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 25 13:12:29.643249 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 25 13:12:29.643249 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 25 13:12:29.643249 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 25 13:12:29.643249 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 25 13:12:29.643249 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:12:29.643249 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:29.646043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 301/581] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 25 13:12:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:29.652828 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324e6b3-a64f-4508-a5a1-3ab691ff0cf9 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:29.744904 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9380f55f-6eed-40b3-a2d2-34ade20a9b84 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:29.746609 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:29.760882 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:29.777853 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324e6b3-a64f-4508-a5a1-3ab691ff0cf9 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:29.784320 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127970e1-a1d0-4fb6-84be-ff99ddac678e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:29.784935 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127970e1-a1d0-4fb6-84be-ff99ddac678e None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:29.785218 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127970e1-a1d0-4fb6-84be-ff99ddac678e None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:29.785493 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127970e1-a1d0-4fb6-84be-ff99ddac678e None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:29.786103 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127970e1-a1d0-4fb6-84be-ff99ddac678e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:29.787465 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127970e1-a1d0-4fb6-84be-ff99ddac678e None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:29.793675 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 281/582] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Oct 25 13:12:29 2022] GET /identity/v3/services => generated 772 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:29.794693 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127970e1-a1d0-4fb6-84be-ff99ddac678e None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:29.822928 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416cfac-857d-4fa1-bbac-64ee86bd4235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:29.823592 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416cfac-857d-4fa1-bbac-64ee86bd4235 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:29.823967 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416cfac-857d-4fa1-bbac-64ee86bd4235 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:29.824262 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416cfac-857d-4fa1-bbac-64ee86bd4235 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:29.825034 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7416cfac-857d-4fa1-bbac-64ee86bd4235 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:29.826055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7416cfac-857d-4fa1-bbac-64ee86bd4235 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:29.828078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7416cfac-857d-4fa1-bbac-64ee86bd4235 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:29.847084 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 302/583] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 25 13:12:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:29.848838 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bbcc2-2d36-4f2c-8a68-6a02c0c20c74 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:29.849317 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bbcc2-2d36-4f2c-8a68-6a02c0c20c74 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:29.849816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bbcc2-2d36-4f2c-8a68-6a02c0c20c74 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:29.851384 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 303/584] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:29.852079 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724bbcc2-2d36-4f2c-8a68-6a02c0c20c74 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:29.925286 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127970e1-a1d0-4fb6-84be-ff99ddac678e None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:29.963559 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6619554-7f11-4fda-a1f8-23af734b0ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:29.964254 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6619554-7f11-4fda-a1f8-23af734b0ff5 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:29.964584 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6619554-7f11-4fda-a1f8-23af734b0ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:29.964867 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6619554-7f11-4fda-a1f8-23af734b0ff5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:29.965458 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6619554-7f11-4fda-a1f8-23af734b0ff5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:29.966966 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6619554-7f11-4fda-a1f8-23af734b0ff5 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:29.977289 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-e6619554-7f11-4fda-a1f8-23af734b0ff5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 25 13:12:29.977289 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:29.977289 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 13:12:29.977289 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 13:12:29.977289 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 13:12:29.977289 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 13:12:29.977289 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 13:12:29.977289 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:29.977289 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 25 13:12:29.977289 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:29.977289 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 13:12:29.977289 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:29.977289 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:29.977289 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:29.977289 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:29.977289 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:29.977289 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:29.978425 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:29.978425 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:29.978425 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:29.978425 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:29.978425 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:29.978425 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:29.978425 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 13:12:29.978425 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 13:12:29.978425 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 13:12:29.978425 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 13:12:29.978425 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:29.978425 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:29.978425 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:29.978425 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:29.978425 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:29.978425 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:29.979712 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:29.979712 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:29.979712 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:29.979712 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:29.979712 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:29.979712 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:29.979712 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:29.979712 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:29.979712 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:29.979712 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:29.979712 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 13:12:29.979712 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:29.979712 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 25 13:12:29.979712 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:29.979712 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 282/585] 10.222.0.25 () {56 vars in 1129 bytes} [Tue Oct 25 13:12:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:29.980993 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f51fe-204e-487a-b60d-71a9d08a78ef None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:29.980993 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f51fe-204e-487a-b60d-71a9d08a78ef None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:29.980993 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f51fe-204e-487a-b60d-71a9d08a78ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:29.996332 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724bbcc2-2d36-4f2c-8a68-6a02c0c20c74 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:30.001356 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-9c8f51fe-204e-487a-b60d-71a9d08a78ef None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:30.002545 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-9c8f51fe-204e-487a-b60d-71a9d08a78ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:30.033885 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:30.038679 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bf92d-d88e-4222-afc7-f49f907cdcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:30.039202 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bf92d-d88e-4222-afc7-f49f907cdcc0 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:30.039659 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bf92d-d88e-4222-afc7-f49f907cdcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:30.039766 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bf92d-d88e-4222-afc7-f49f907cdcc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:30.040668 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5bf92d-d88e-4222-afc7-f49f907cdcc0 None admin] RBAC: Adding query filter params (role.id=4c7114fda3ec4652abed55516b5f4315, scope.project.id=616ecfe8d2c74aad9386720718392e81, user.id=63e73c00cadb4deea934db6111ed76d5) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:30.040825 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5bf92d-d88e-4222-afc7-f49f907cdcc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:30.042250 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5bf92d-d88e-4222-afc7-f49f907cdcc0 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:30.055928 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 304/586] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 25 13:12:29 2022] GET /identity/v3/role_assignments?user.id=63e73c00cadb4deea934db6111ed76d5&scope.project.id=616ecfe8d2c74aad9386720718392e81&role.id=4c7114fda3ec4652abed55516b5f4315 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:30.055928 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bf92d-d88e-4222-afc7-f49f907cdcc0 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:30.075299 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:30.123836 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 283/587] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 13:12:30.243158 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bf92d-d88e-4222-afc7-f49f907cdcc0 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:30.288346 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee902ce1-aa1c-45f6-8e2d-a79f716b46d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:30.289322 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee902ce1-aa1c-45f6-8e2d-a79f716b46d9 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:30.289830 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee902ce1-aa1c-45f6-8e2d-a79f716b46d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:30.290307 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee902ce1-aa1c-45f6-8e2d-a79f716b46d9 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:30.291162 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee902ce1-aa1c-45f6-8e2d-a79f716b46d9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:30.291669 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee902ce1-aa1c-45f6-8e2d-a79f716b46d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:30.293577 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee902ce1-aa1c-45f6-8e2d-a79f716b46d9 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:30.299790 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 305/588] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Oct 25 13:12:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:30.305113 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f51fe-204e-487a-b60d-71a9d08a78ef None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:30.406151 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee902ce1-aa1c-45f6-8e2d-a79f716b46d9 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:30.423702 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f51fe-204e-487a-b60d-71a9d08a78ef None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:30.463059 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991ff31-870d-4ef1-89f6-9052c836205a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:30.463672 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991ff31-870d-4ef1-89f6-9052c836205a None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:30.463973 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991ff31-870d-4ef1-89f6-9052c836205a None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:30.464252 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991ff31-870d-4ef1-89f6-9052c836205a None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:30.465066 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1991ff31-870d-4ef1-89f6-9052c836205a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:30.465374 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1991ff31-870d-4ef1-89f6-9052c836205a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:30.466751 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1991ff31-870d-4ef1-89f6-9052c836205a None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:30.474536 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 284/589] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Oct 25 13:12:30 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:30.479865 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991ff31-870d-4ef1-89f6-9052c836205a None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:30.490128 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:30.517327 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:30.532797 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee902ce1-aa1c-45f6-8e2d-a79f716b46d9 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:30.568802 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80487b66-768f-4caf-b62f-b71e853857be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:30.569463 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80487b66-768f-4caf-b62f-b71e853857be None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:30.569742 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80487b66-768f-4caf-b62f-b71e853857be None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:30.570019 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80487b66-768f-4caf-b62f-b71e853857be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:30.580509 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80487b66-768f-4caf-b62f-b71e853857be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:12:30.585812 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-80487b66-768f-4caf-b62f-b71e853857be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 13:12:30.585812 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:30.585812 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:30.585812 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:30.585812 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:30.585812 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:30.585812 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:30.585812 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:30.585812 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:30.585812 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:30.585812 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:30.585812 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:30.585812 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:12:30.585812 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:12:30.585812 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:12:30.585812 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:12:30.586749 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:12:30.586749 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:12:30.586749 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:12:30.586749 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:12:30.586749 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:30.586749 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:30.586749 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:30.586749 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:30.586749 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:30.586749 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:30.586749 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:30.586749 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:30.586749 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:30.586749 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:30.586749 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:30.586749 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:30.587620 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:30.587620 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:30.587620 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:30.587620 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:30.587620 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:12:30.587620 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:12:30.587620 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:12:30.587620 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:12:30.587620 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:12:30.587620 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:12:30.587620 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 13:12:30.587620 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:30.591830 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 306/590] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 25 13:12:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 13:12:30.593549 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80487b66-768f-4caf-b62f-b71e853857be None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:30.598919 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991ff31-870d-4ef1-89f6-9052c836205a None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:30.636745 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e7c58-6925-41b6-9c7e-d15b9d99ceca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:30.637517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e7c58-6925-41b6-9c7e-d15b9d99ceca None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:30.637952 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e7c58-6925-41b6-9c7e-d15b9d99ceca None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:30.638323 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e7c58-6925-41b6-9c7e-d15b9d99ceca None admin] PATH_INFO: `/v3/endpoints` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:30.639284 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e7c58-6925-41b6-9c7e-d15b9d99ceca None admin] RBAC: Adding query filter params (interface=public, service_id=f75b834082e24a87b9c3b63463ea0930, region_id=RegionOne) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:30.639694 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e7c58-6925-41b6-9c7e-d15b9d99ceca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:30.641609 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e7c58-6925-41b6-9c7e-d15b9d99ceca None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:30.647570 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 285/591] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Oct 25 13:12:30 2022] GET /identity/v3/endpoints?service_id=f75b834082e24a87b9c3b63463ea0930&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:12:30.652682 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e7c58-6925-41b6-9c7e-d15b9d99ceca None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:30.707263 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80487b66-768f-4caf-b62f-b71e853857be None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:30.749630 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:30.755685 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f8162-238b-431f-9268-2b9e591d77c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:30.756289 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f8162-238b-431f-9268-2b9e591d77c1 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:30.757082 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f8162-238b-431f-9268-2b9e591d77c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:30.757610 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f8162-238b-431f-9268-2b9e591d77c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:30.758369 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405f8162-238b-431f-9268-2b9e591d77c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:30.759118 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405f8162-238b-431f-9268-2b9e591d77c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:30.760953 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405f8162-238b-431f-9268-2b9e591d77c1 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:30.769701 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e7c58-6925-41b6-9c7e-d15b9d99ceca None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:30.776047 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 307/592] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 25 13:12:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:30.776370 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:30.779442 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f8162-238b-431f-9268-2b9e591d77c1 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:30.844358 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe80a6d8-54d8-40b6-b9a0-1183335779a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:30.846376 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80a6d8-54d8-40b6-b9a0-1183335779a0 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:30.847557 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80a6d8-54d8-40b6-b9a0-1183335779a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:30.848576 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80a6d8-54d8-40b6-b9a0-1183335779a0 None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:30.851193 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe80a6d8-54d8-40b6-b9a0-1183335779a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:30.852794 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe80a6d8-54d8-40b6-b9a0-1183335779a0 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:30.865027 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 286/593] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Oct 25 13:12:30 2022] GET /identity/v3/services => generated 772 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:12:30.920371 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a951a-0ef0-4dc9-bc8b-d869fd4d7a07 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:30.920915 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a951a-0ef0-4dc9-bc8b-d869fd4d7a07 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:30.921874 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a951a-0ef0-4dc9-bc8b-d869fd4d7a07 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:30.923500 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 287/594] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 13:12:30.929155 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece78c0-2d2a-4cde-8211-c052d2b998b1 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:30.929637 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece78c0-2d2a-4cde-8211-c052d2b998b1 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:30.930082 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece78c0-2d2a-4cde-8211-c052d2b998b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:30.958320 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-1ece78c0-2d2a-4cde-8211-c052d2b998b1 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:30.959986 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-1ece78c0-2d2a-4cde-8211-c052d2b998b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:30.988773 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f8162-238b-431f-9268-2b9e591d77c1 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:31.058187 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc1e2b-9a64-4ebb-9e34-24dc4a9d825e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:31.059213 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc1e2b-9a64-4ebb-9e34-24dc4a9d825e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:31.059701 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc1e2b-9a64-4ebb-9e34-24dc4a9d825e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:31.060369 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc1e2b-9a64-4ebb-9e34-24dc4a9d825e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:31.074469 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc1e2b-9a64-4ebb-9e34-24dc4a9d825e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:31.076438 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc1e2b-9a64-4ebb-9e34-24dc4a9d825e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:31.079874 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 288/595] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Oct 25 13:12:31.092206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-edfc1e2b-9a64-4ebb-9e34-24dc4a9d825e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:31.092206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:31.092206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:31.092206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:31.092206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:31.092206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:31.092206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:31.092206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:31.092206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:31.092206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:31.092206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:31.092206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:31.092206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:12:31.092206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:12:31.092206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:12:31.092206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:12:31.093738 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:31.093738 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:31.093738 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:31.093738 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:31.093738 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:31.093738 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:31.093738 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:31.093738 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:31.093738 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:31.093738 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:31.093738 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:31.093738 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:31.093738 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:31.093738 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:31.093738 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:31.093738 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:31.093738 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:12:31.094861 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:12:31.094861 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:31.094861 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:31.097126 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 308/596] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:31.102614 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece78c0-2d2a-4cde-8211-c052d2b998b1 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:31.190557 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:31.210430 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece78c0-2d2a-4cde-8211-c052d2b998b1 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:31.247480 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146190c-a195-4010-b35b-ad5803fd5ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:31.248123 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146190c-a195-4010-b35b-ad5803fd5ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:31.248404 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146190c-a195-4010-b35b-ad5803fd5ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:31.248680 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146190c-a195-4010-b35b-ad5803fd5ad0 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:31.249847 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4146190c-a195-4010-b35b-ad5803fd5ad0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:31.250150 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4146190c-a195-4010-b35b-ad5803fd5ad0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:31.251523 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4146190c-a195-4010-b35b-ad5803fd5ad0 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:31.264065 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 289/597] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:31.270966 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc1e2b-9a64-4ebb-9e34-24dc4a9d825e None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:31.332837 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:31.385934 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc1e2b-9a64-4ebb-9e34-24dc4a9d825e None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:31.403117 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146190c-a195-4010-b35b-ad5803fd5ad0 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:31.435969 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d661ad2-32cd-4b64-95b1-4938cdf42dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:31.437019 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d661ad2-32cd-4b64-95b1-4938cdf42dcc None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:31.437704 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d661ad2-32cd-4b64-95b1-4938cdf42dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:31.438947 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d661ad2-32cd-4b64-95b1-4938cdf42dcc None admin] PATH_INFO: `/v3/users/swift` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:31.456401 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d661ad2-32cd-4b64-95b1-4938cdf42dcc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:31.458507 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d661ad2-32cd-4b64-95b1-4938cdf42dcc None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:31.481177 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-1d661ad2-32cd-4b64-95b1-4938cdf42dcc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 25 13:12:31.481177 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:31.481177 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:31.481177 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:31.481177 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:31.481177 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:31.481177 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:31.481177 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:31.481177 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:31.481177 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:31.481177 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:31.481177 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:31.481177 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 25 13:12:31.481177 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 25 13:12:31.481177 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 25 13:12:31.481177 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 25 13:12:31.482246 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:31.482246 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:31.482246 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 25 13:12:31.482246 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:12:31.482246 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 25 13:12:31.482246 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:12:31.482246 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:31.482246 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:31.482246 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:31.482246 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:31.482246 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:31.482246 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:31.482246 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:31.482246 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:31.482246 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:31.482246 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:31.482246 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:31.482246 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:31.483253 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:31.483253 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:31.483253 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 25 13:12:31.483253 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 25 13:12:31.483253 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 25 13:12:31.483253 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 25 13:12:31.483253 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 25 13:12:31.483253 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 25 13:12:31.483253 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 25 13:12:31.483253 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:31.497030 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 309/598] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 25 13:12:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 13:12:31.502403 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d661ad2-32cd-4b64-95b1-4938cdf42dcc None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:31.622629 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146190c-a195-4010-b35b-ad5803fd5ad0 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:31.664845 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d661ad2-32cd-4b64-95b1-4938cdf42dcc None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:31.676999 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:31.678565 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1d7b8-4c20-4e79-834e-65525c0d4f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:31.679445 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1d7b8-4c20-4e79-834e-65525c0d4f98 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:31.679930 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1d7b8-4c20-4e79-834e-65525c0d4f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:31.680401 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1d7b8-4c20-4e79-834e-65525c0d4f98 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:31.704520 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9881b2b-a98b-4e2b-b899-a97358a9d38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:31.705330 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9881b2b-a98b-4e2b-b899-a97358a9d38d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:31.705753 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9881b2b-a98b-4e2b-b899-a97358a9d38d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:31.706089 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9881b2b-a98b-4e2b-b899-a97358a9d38d None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:31.706495 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1d7b8-4c20-4e79-834e-65525c0d4f98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:12:31.706933 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9881b2b-a98b-4e2b-b899-a97358a9d38d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:31.707299 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9881b2b-a98b-4e2b-b899-a97358a9d38d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:31.708827 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9881b2b-a98b-4e2b-b899-a97358a9d38d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:31.712932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-99a1d7b8-4c20-4e79-834e-65525c0d4f98 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 13:12:31.712932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:31.712932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:31.712932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:31.712932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:31.712932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:31.712932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:31.712932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:31.712932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:31.712932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:31.712932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:31.712932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:31.712932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:12:31.712932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:12:31.712932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:12:31.712932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:12:31.713873 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:12:31.713873 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:12:31.713873 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:12:31.713873 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:12:31.713873 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:31.713873 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:31.713873 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:31.713873 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:31.713873 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:31.713873 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:31.713873 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:31.713873 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:31.713873 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:31.713873 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:31.713873 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:31.713873 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:31.714756 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:31.714756 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:31.714756 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:31.714756 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:31.714756 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:12:31.714756 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:12:31.714756 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:12:31.714756 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:12:31.714756 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:12:31.714756 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:12:31.714756 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 25 13:12:31.714756 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:31.728217 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 290/599] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 25 13:12:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:31.734288 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1d7b8-4c20-4e79-834e-65525c0d4f98 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:31.737679 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:31.747743 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 310/600] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Oct 25 13:12:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:12:31.754121 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9881b2b-a98b-4e2b-b899-a97358a9d38d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:31.900311 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9881b2b-a98b-4e2b-b899-a97358a9d38d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:31.931305 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1d7b8-4c20-4e79-834e-65525c0d4f98 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:31.974137 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab0297-f765-401e-9b96-c1dfd424a177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:31.974751 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab0297-f765-401e-9b96-c1dfd424a177 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:31.975027 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab0297-f765-401e-9b96-c1dfd424a177 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:31.975710 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4c3c2-d177-491d-98f1-7c1cc292b676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:31.976342 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4c3c2-d177-491d-98f1-7c1cc292b676 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:31.976616 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4c3c2-d177-491d-98f1-7c1cc292b676 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:31.976880 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4c3c2-d177-491d-98f1-7c1cc292b676 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:31.977653 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab0297-f765-401e-9b96-c1dfd424a177 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:31.978309 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab0297-f765-401e-9b96-c1dfd424a177 None admin] RBAC: Adding query filter params (name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:31.978607 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab0297-f765-401e-9b96-c1dfd424a177 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:31.980005 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab0297-f765-401e-9b96-c1dfd424a177 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:32.007666 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 291/601] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 25 13:12:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:32.012079 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab0297-f765-401e-9b96-c1dfd424a177 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:32.054043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:32.098792 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e4c3c2-d177-491d-98f1-7c1cc292b676 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:32.100257 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e4c3c2-d177-491d-98f1-7c1cc292b676 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:32.201290 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:32.218274 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 311/602] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 25 13:12:31 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 25 13:12:32.223874 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4c3c2-d177-491d-98f1-7c1cc292b676 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:32.293366 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:32.322126 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab0297-f765-401e-9b96-c1dfd424a177 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:32.339423 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4c3c2-d177-491d-98f1-7c1cc292b676 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:32.386043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1becb735-5000-4f9e-8fd9-6a9d3219f157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:32.387083 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1becb735-5000-4f9e-8fd9-6a9d3219f157 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:32.387586 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1becb735-5000-4f9e-8fd9-6a9d3219f157 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:32.388094 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1becb735-5000-4f9e-8fd9-6a9d3219f157 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:32.402555 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1becb735-5000-4f9e-8fd9-6a9d3219f157 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:32.404961 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1becb735-5000-4f9e-8fd9-6a9d3219f157 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:32.418945 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b48874d-a47d-4560-adaa-3a37e32fa2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:32.420296 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48874d-a47d-4560-adaa-3a37e32fa2bc None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:32.420794 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48874d-a47d-4560-adaa-3a37e32fa2bc None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:32.421912 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48874d-a47d-4560-adaa-3a37e32fa2bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:32.434280 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b48874d-a47d-4560-adaa-3a37e32fa2bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:32.436021 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b48874d-a47d-4560-adaa-3a37e32fa2bc None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:32.438251 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-1becb735-5000-4f9e-8fd9-6a9d3219f157 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:32.438251 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:32.438251 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:32.438251 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:32.438251 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:32.438251 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:32.438251 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:32.438251 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:32.438251 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:32.438251 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:32.438251 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:32.438251 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:32.438251 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:12:32.438251 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:12:32.438251 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:12:32.438251 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:12:32.439182 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:32.439182 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:32.439182 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:32.439182 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:32.439182 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:32.439182 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:32.439182 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:32.439182 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:32.439182 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:32.439182 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:32.439182 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:32.439182 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:32.439182 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:32.439182 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:32.439182 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:32.439182 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:32.439182 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:12:32.440751 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:12:32.440751 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:32.440751 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:32.440751 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 312/603] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:32.445094 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1becb735-5000-4f9e-8fd9-6a9d3219f157 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:32.457667 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-5b48874d-a47d-4560-adaa-3a37e32fa2bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:32.457667 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:32.457667 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:32.457667 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:32.457667 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:32.457667 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:32.457667 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:32.457667 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:32.457667 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:32.457667 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:32.457667 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:32.457667 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:32.457667 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:12:32.457667 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:12:32.457667 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:12:32.457667 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:12:32.458642 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:32.458642 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:32.458642 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:32.458642 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:32.458642 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:32.458642 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:32.458642 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:32.458642 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:32.458642 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:32.458642 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:32.458642 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:32.458642 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:32.458642 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:32.458642 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:32.458642 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:32.458642 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:32.458642 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:12:32.459562 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:12:32.459562 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:32.459562 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:32.467190 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 292/604] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 457 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:32.471963 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b48874d-a47d-4560-adaa-3a37e32fa2bc None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:32.587511 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1becb735-5000-4f9e-8fd9-6a9d3219f157 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:32.597721 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b48874d-a47d-4560-adaa-3a37e32fa2bc None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:32.608180 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:32.615218 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:32.631969 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb6e25-d10c-4733-94fe-ca2f657718f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:32.632578 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb6e25-d10c-4733-94fe-ca2f657718f8 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:32.632855 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb6e25-d10c-4733-94fe-ca2f657718f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:32.633125 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb6e25-d10c-4733-94fe-ca2f657718f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:32.633764 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb6e25-d10c-4733-94fe-ca2f657718f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:32.634062 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb6e25-d10c-4733-94fe-ca2f657718f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:32.635438 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb6e25-d10c-4733-94fe-ca2f657718f8 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:32.635742 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b601b78-fb64-4c2b-9b9d-cc3af10aedb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:32.636471 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b601b78-fb64-4c2b-9b9d-cc3af10aedb2 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:32.636846 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b601b78-fb64-4c2b-9b9d-cc3af10aedb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:32.637223 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b601b78-fb64-4c2b-9b9d-cc3af10aedb2 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:32.637949 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b601b78-fb64-4c2b-9b9d-cc3af10aedb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:32.638344 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b601b78-fb64-4c2b-9b9d-cc3af10aedb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:32.639773 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b601b78-fb64-4c2b-9b9d-cc3af10aedb2 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:32.651991 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 313/605] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:12:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:32.653717 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bff22-219f-4049-82c9-b9b2e142cc89 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:32.654004 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bff22-219f-4049-82c9-b9b2e142cc89 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:32.654276 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bff22-219f-4049-82c9-b9b2e142cc89 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:32.655489 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 314/606] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:32.657884 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39bff22-219f-4049-82c9-b9b2e142cc89 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:32.660888 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 293/607] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:12:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:32.663705 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890500f-7de1-49fa-bd23-26a9ef40479b None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:32.663992 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890500f-7de1-49fa-bd23-26a9ef40479b None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:32.664266 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890500f-7de1-49fa-bd23-26a9ef40479b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:32.682847 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-a890500f-7de1-49fa-bd23-26a9ef40479b None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:32.684039 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a890500f-7de1-49fa-bd23-26a9ef40479b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:32.772044 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 294/608] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 13:12:32.775136 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890500f-7de1-49fa-bd23-26a9ef40479b None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:32.804630 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39bff22-219f-4049-82c9-b9b2e142cc89 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:32.883193 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8131231-c82b-4fc0-ad52-c6d4e714ac4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:32.883829 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8131231-c82b-4fc0-ad52-c6d4e714ac4a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:32.886783 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8131231-c82b-4fc0-ad52-c6d4e714ac4a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:32.887064 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8131231-c82b-4fc0-ad52-c6d4e714ac4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:32.900514 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8131231-c82b-4fc0-ad52-c6d4e714ac4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:32.905218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8131231-c82b-4fc0-ad52-c6d4e714ac4a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:32.928602 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-f8131231-c82b-4fc0-ad52-c6d4e714ac4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:12:32.928602 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:32.928602 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:32.928602 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:32.928602 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:32.928602 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:32.928602 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:32.928602 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:32.928602 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:32.928602 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:32.928602 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:32.928602 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:32.928602 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 25 13:12:32.928602 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 25 13:12:32.928602 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 25 13:12:32.929654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 25 13:12:32.929654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:32.929654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:32.929654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:32.929654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:32.929654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:32.929654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:32.929654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:32.929654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:32.929654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:32.929654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:32.929654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:32.929654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:32.929654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:32.929654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:32.929654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:32.929654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:32.930563 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 25 13:12:32.930563 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 25 13:12:32.930563 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 25 13:12:32.930563 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 25 13:12:32.930563 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 25 13:12:32.930563 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 25 13:12:32.930563 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:12:32.930563 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:32.930563 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 315/609] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 25 13:12:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:32.931074 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fdabb-a756-4321-8f76-43cabffbf56f None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:32.931342 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fdabb-a756-4321-8f76-43cabffbf56f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:32.931435 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fdabb-a756-4321-8f76-43cabffbf56f None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:32.938205 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 316/610] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:32.939176 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25fdabb-a756-4321-8f76-43cabffbf56f None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:32.969410 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890500f-7de1-49fa-bd23-26a9ef40479b None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:32.977897 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:32.984618 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:33.012156 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61fdcde-63fb-483c-a41f-4c70c7793f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:33.013067 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fdcde-63fb-483c-a41f-4c70c7793f42 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:33.013510 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fdcde-63fb-483c-a41f-4c70c7793f42 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:33.014034 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fdcde-63fb-483c-a41f-4c70c7793f42 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:33.022942 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61fdcde-63fb-483c-a41f-4c70c7793f42 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:33.024745 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61fdcde-63fb-483c-a41f-4c70c7793f42 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:33.037962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-b61fdcde-63fb-483c-a41f-4c70c7793f42 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 25 13:12:33.037962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:33.037962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:33.037962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:33.037962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:33.037962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:33.037962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:33.037962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:33.037962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:33.037962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:33.037962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:33.037962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:33.037962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 25 13:12:33.037962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 25 13:12:33.037962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 25 13:12:33.037962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 25 13:12:33.039176 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:33.039176 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:33.039176 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 25 13:12:33.039176 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:12:33.039176 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 25 13:12:33.039176 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:12:33.039176 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:33.039176 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:33.039176 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:33.039176 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:33.039176 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:33.039176 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:33.039176 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:33.039176 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:33.039176 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:33.039176 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:33.039176 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:33.039176 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:33.040371 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:33.040371 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:33.040371 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 25 13:12:33.040371 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 25 13:12:33.040371 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 25 13:12:33.040371 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 25 13:12:33.040371 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 25 13:12:33.040371 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 25 13:12:33.040371 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 25 13:12:33.040371 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:33.042324 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 295/611] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Oct 25 13:12:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:33.047928 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd09429-e9fc-40d8-9bb6-da3431a33a52 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:33.048559 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd09429-e9fc-40d8-9bb6-da3431a33a52 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:33.049073 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd09429-e9fc-40d8-9bb6-da3431a33a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:33.058833 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25fdabb-a756-4321-8f76-43cabffbf56f None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:33.070540 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-0dd09429-e9fc-40d8-9bb6-da3431a33a52 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:33.072138 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-0dd09429-e9fc-40d8-9bb6-da3431a33a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:33.100005 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08a134-1ca2-48e9-9904-79ea7e5dbad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:33.100620 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08a134-1ca2-48e9-9904-79ea7e5dbad0 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:33.100908 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08a134-1ca2-48e9-9904-79ea7e5dbad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:33.101181 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08a134-1ca2-48e9-9904-79ea7e5dbad0 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:33.101877 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08a134-1ca2-48e9-9904-79ea7e5dbad0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:33.102187 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08a134-1ca2-48e9-9904-79ea7e5dbad0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:33.103633 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08a134-1ca2-48e9-9904-79ea7e5dbad0 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:33.120910 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 317/612] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 25 13:12:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:33.120910 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08a134-1ca2-48e9-9904-79ea7e5dbad0 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:33.149980 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 296/613] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 13:12:33.150833 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd09429-e9fc-40d8-9bb6-da3431a33a52 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:33.227072 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:33.238274 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08a134-1ca2-48e9-9904-79ea7e5dbad0 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:33.256846 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:33.263563 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd09429-e9fc-40d8-9bb6-da3431a33a52 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:33.281447 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0064712-8f2b-4fe6-8329-4f06ddac7423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:33.281948 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0064712-8f2b-4fe6-8329-4f06ddac7423 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:33.282294 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0064712-8f2b-4fe6-8329-4f06ddac7423 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:33.282632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0064712-8f2b-4fe6-8329-4f06ddac7423 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:33.283691 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0064712-8f2b-4fe6-8329-4f06ddac7423 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:33.284114 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0064712-8f2b-4fe6-8329-4f06ddac7423 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:33.286370 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0064712-8f2b-4fe6-8329-4f06ddac7423 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:33.307948 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 318/614] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Oct 25 13:12:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:33.311396 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579fbaa8-c1b9-4a9d-ba67-0af8a12707c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:33.312962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579fbaa8-c1b9-4a9d-ba67-0af8a12707c5 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:33.313429 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579fbaa8-c1b9-4a9d-ba67-0af8a12707c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:33.313872 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579fbaa8-c1b9-4a9d-ba67-0af8a12707c5 None admin] PATH_INFO: `/v3/services/network` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:33.314457 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0064712-8f2b-4fe6-8329-4f06ddac7423 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:33.314808 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579fbaa8-c1b9-4a9d-ba67-0af8a12707c5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:33.316468 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579fbaa8-c1b9-4a9d-ba67-0af8a12707c5 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:33.329032 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-579fbaa8-c1b9-4a9d-ba67-0af8a12707c5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 25 13:12:33.329032 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:33.329032 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 13:12:33.329032 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 13:12:33.329032 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 13:12:33.329032 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 13:12:33.329032 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 13:12:33.329032 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:33.329032 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 25 13:12:33.329032 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:33.329032 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 13:12:33.329032 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:33.329032 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:33.329032 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:33.329032 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:33.329032 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:33.329032 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:33.330073 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:33.330073 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:33.330073 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:33.330073 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:33.330073 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:33.330073 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:33.330073 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 13:12:33.330073 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 13:12:33.330073 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 13:12:33.330073 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 13:12:33.330073 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:33.330073 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:33.330073 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:33.330073 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:33.330073 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:33.330073 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:33.330968 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:33.330968 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:33.330968 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:33.330968 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:33.330968 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:33.330968 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:33.330968 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:33.330968 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:33.330968 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:33.330968 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:33.330968 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 13:12:33.330968 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:33.330968 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 25 13:12:33.330968 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:33.333228 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 297/615] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 25 13:12:33 2022] GET /identity/v3/services/network => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:33.334442 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579fbaa8-c1b9-4a9d-ba67-0af8a12707c5 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:33.441634 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0064712-8f2b-4fe6-8329-4f06ddac7423 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:33.465441 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579fbaa8-c1b9-4a9d-ba67-0af8a12707c5 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:33.478399 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a62e0-2216-4618-a73d-475cc876b814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:33.479283 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a62e0-2216-4618-a73d-475cc876b814 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:33.479561 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a62e0-2216-4618-a73d-475cc876b814 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:33.479838 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a62e0-2216-4618-a73d-475cc876b814 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:33.480754 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a62e0-2216-4618-a73d-475cc876b814 None admin] RBAC: Adding query filter params (role.id=4c7114fda3ec4652abed55516b5f4315, scope.project.id=616ecfe8d2c74aad9386720718392e81, user.id=07413369b0c14e878d04ee528487801d) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:33.481425 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a62e0-2216-4618-a73d-475cc876b814 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:33.483103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a62e0-2216-4618-a73d-475cc876b814 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:33.496012 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 319/616] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 25 13:12:33 2022] GET /identity/v3/role_assignments?user.id=07413369b0c14e878d04ee528487801d&scope.project.id=616ecfe8d2c74aad9386720718392e81&role.id=4c7114fda3ec4652abed55516b5f4315 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:33.496012 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a62e0-2216-4618-a73d-475cc876b814 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:33.502898 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c90f5-3a5a-4edd-86c7-2896318c0b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:33.503522 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c90f5-3a5a-4edd-86c7-2896318c0b92 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:33.503797 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c90f5-3a5a-4edd-86c7-2896318c0b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:33.504092 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c90f5-3a5a-4edd-86c7-2896318c0b92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:33.520124 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:33.538354 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:33.589866 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c90f5-3a5a-4edd-86c7-2896318c0b92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:33.591351 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c90f5-3a5a-4edd-86c7-2896318c0b92 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:33.642511 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a62e0-2216-4618-a73d-475cc876b814 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:33.690418 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88be01f-65b3-4c1d-a451-d43d8cbd3d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:33.690877 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88be01f-65b3-4c1d-a451-d43d8cbd3d23 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:33.691813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88be01f-65b3-4c1d-a451-d43d8cbd3d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:33.691813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88be01f-65b3-4c1d-a451-d43d8cbd3d23 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:33.692116 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88be01f-65b3-4c1d-a451-d43d8cbd3d23 None admin] RBAC: Adding query filter params (name=network) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:33.692424 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88be01f-65b3-4c1d-a451-d43d8cbd3d23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:33.694379 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88be01f-65b3-4c1d-a451-d43d8cbd3d23 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:33.700953 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 320/617] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Oct 25 13:12:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:33.704120 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88be01f-65b3-4c1d-a451-d43d8cbd3d23 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:33.738417 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 298/618] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 25 13:12:33 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 25 13:12:33.738417 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccdbf8d-bcfc-4ba9-a3c6-adff11d9b167 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:33.738417 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccdbf8d-bcfc-4ba9-a3c6-adff11d9b167 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:33.738417 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccdbf8d-bcfc-4ba9-a3c6-adff11d9b167 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:33.738417 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 299/619] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:33.738417 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccdbf8d-bcfc-4ba9-a3c6-adff11d9b167 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:33.807849 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:33.830422 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88be01f-65b3-4c1d-a451-d43d8cbd3d23 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:33.833802 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:33.871302 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f44f8a-341e-4f6c-8c29-2c9e1f19faf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:33.872001 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f44f8a-341e-4f6c-8c29-2c9e1f19faf8 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:33.872286 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f44f8a-341e-4f6c-8c29-2c9e1f19faf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:33.872565 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f44f8a-341e-4f6c-8c29-2c9e1f19faf8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:33.873175 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f44f8a-341e-4f6c-8c29-2c9e1f19faf8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:33.874765 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f44f8a-341e-4f6c-8c29-2c9e1f19faf8 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:33.885244 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-80f44f8a-341e-4f6c-8c29-2c9e1f19faf8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 25 13:12:33.885244 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:33.885244 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 13:12:33.885244 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 13:12:33.885244 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 13:12:33.885244 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 13:12:33.885244 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 13:12:33.885244 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:33.885244 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 25 13:12:33.885244 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:33.885244 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 13:12:33.885244 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:33.885244 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:33.885244 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:33.885244 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:33.885244 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:33.886303 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:33.886303 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:33.886303 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:33.886303 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:33.886303 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:33.886303 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:33.886303 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:33.886303 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 13:12:33.886303 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 13:12:33.886303 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 13:12:33.886303 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 13:12:33.886303 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:33.886303 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:33.886303 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:33.886303 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:33.886303 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:33.886303 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:33.889127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:33.889127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:33.889127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:33.889127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:33.889127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:33.889127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:33.889127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:33.889127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:33.889127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:33.889127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:33.889127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 13:12:33.889127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:33.889127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 25 13:12:33.889127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:33.889127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 321/620] 10.222.0.25 () {56 vars in 1132 bytes} [Tue Oct 25 13:12:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:33.890515 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f44f8a-341e-4f6c-8c29-2c9e1f19faf8 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:33.901831 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccdbf8d-bcfc-4ba9-a3c6-adff11d9b167 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:33.941071 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7647b1-6d46-4c9f-88d7-0e7598e770f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:33.941677 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7647b1-6d46-4c9f-88d7-0e7598e770f4 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:33.941952 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7647b1-6d46-4c9f-88d7-0e7598e770f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:33.942222 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7647b1-6d46-4c9f-88d7-0e7598e770f4 None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:33.942848 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7647b1-6d46-4c9f-88d7-0e7598e770f4 None admin] RBAC: Adding query filter params (type=network) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:33.943144 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7647b1-6d46-4c9f-88d7-0e7598e770f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:33.944596 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7647b1-6d46-4c9f-88d7-0e7598e770f4 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:33.957375 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 300/621] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Oct 25 13:12:33 2022] GET /identity/v3/services?type=network => generated 350 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:33.957375 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b09c0-7a6d-4dcc-960b-77f812634d95 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:33.957647 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b09c0-7a6d-4dcc-960b-77f812634d95 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:33.958043 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b09c0-7a6d-4dcc-960b-77f812634d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:33.977311 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-172b09c0-7a6d-4dcc-960b-77f812634d95 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:33.978594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-172b09c0-7a6d-4dcc-960b-77f812634d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:34.029713 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f44f8a-341e-4f6c-8c29-2c9e1f19faf8 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:34.064003 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 301/622] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 13:12:34.064003 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b09c0-7a6d-4dcc-960b-77f812634d95 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:34.078678 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3fb780-cc20-4c4f-99a7-356058a0d25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:34.079395 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fb780-cc20-4c4f-99a7-356058a0d25b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:34.079741 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fb780-cc20-4c4f-99a7-356058a0d25b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:34.080103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fb780-cc20-4c4f-99a7-356058a0d25b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:34.094185 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3fb780-cc20-4c4f-99a7-356058a0d25b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:34.096079 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3fb780-cc20-4c4f-99a7-356058a0d25b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:34.104424 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:34.116158 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-9a3fb780-cc20-4c4f-99a7-356058a0d25b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:34.116158 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:34.116158 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:34.116158 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:34.116158 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:34.116158 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:34.116158 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:34.116158 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:34.116158 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:34.116158 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:34.116158 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:34.116158 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:34.116158 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:12:34.116158 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:12:34.116158 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:12:34.116158 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:12:34.117138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:34.117138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:34.117138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:34.117138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:34.117138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:34.117138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:34.117138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:34.117138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:34.117138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:34.117138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:34.117138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:34.117138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:34.117138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:34.117138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:34.117138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:34.117138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:34.117138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:12:34.118037 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:12:34.118037 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:34.118037 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:34.122271 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 322/623] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:34.123130 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3fb780-cc20-4c4f-99a7-356058a0d25b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:34.134870 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:34.199391 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b09c0-7a6d-4dcc-960b-77f812634d95 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:34.230744 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3fb780-cc20-4c4f-99a7-356058a0d25b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:34.244587 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4678c9d-36fa-4704-8738-051eec801b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:34.245453 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4678c9d-36fa-4704-8738-051eec801b19 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:34.245732 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4678c9d-36fa-4704-8738-051eec801b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:34.246004 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4678c9d-36fa-4704-8738-051eec801b19 None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:34.247098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4678c9d-36fa-4704-8738-051eec801b19 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:34.247401 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4678c9d-36fa-4704-8738-051eec801b19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:34.249108 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4678c9d-36fa-4704-8738-051eec801b19 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:34.261033 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 302/624] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Oct 25 13:12:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:34.262053 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4678c9d-36fa-4704-8738-051eec801b19 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:34.273793 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc3e0a-5491-4f1f-b542-118edaec42e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:34.275127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc3e0a-5491-4f1f-b542-118edaec42e5 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:34.275549 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc3e0a-5491-4f1f-b542-118edaec42e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:34.276018 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc3e0a-5491-4f1f-b542-118edaec42e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:34.277280 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc3e0a-5491-4f1f-b542-118edaec42e5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:34.279225 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc3e0a-5491-4f1f-b542-118edaec42e5 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:34.310170 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 323/625] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:12:34 2022] POST /identity/v3/endpoints => generated 337 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:12:34.312841 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc3e0a-5491-4f1f-b542-118edaec42e5 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:34.394080 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:34.394325 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4678c9d-36fa-4704-8738-051eec801b19 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:34.416501 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:34.445246 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8276c-40e9-426f-8082-8a8a3558f2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:34.445931 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8276c-40e9-426f-8082-8a8a3558f2bf None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:34.446216 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8276c-40e9-426f-8082-8a8a3558f2bf None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:34.446587 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8276c-40e9-426f-8082-8a8a3558f2bf None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:34.447241 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8276c-40e9-426f-8082-8a8a3558f2bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:34.447544 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8276c-40e9-426f-8082-8a8a3558f2bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:34.448991 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8276c-40e9-426f-8082-8a8a3558f2bf None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:34.460821 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc3e0a-5491-4f1f-b542-118edaec42e5 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:34.471146 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 303/626] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:34.473226 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8276c-40e9-426f-8082-8a8a3558f2bf None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:34.513860 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c6ed3-cf8f-48c1-9b70-03cf50f3e70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:34.515560 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c6ed3-cf8f-48c1-9b70-03cf50f3e70a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:34.516098 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c6ed3-cf8f-48c1-9b70-03cf50f3e70a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:34.516596 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c6ed3-cf8f-48c1-9b70-03cf50f3e70a None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:34.517558 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c6ed3-cf8f-48c1-9b70-03cf50f3e70a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:34.518086 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c6ed3-cf8f-48c1-9b70-03cf50f3e70a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:34.519754 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c6ed3-cf8f-48c1-9b70-03cf50f3e70a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:34.526057 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 324/627] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Oct 25 13:12:34 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:34.527736 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c6ed3-cf8f-48c1-9b70-03cf50f3e70a None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:34.592778 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8276c-40e9-426f-8082-8a8a3558f2bf None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:34.637712 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0209b-5a94-435f-a274-21b3e0be40bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:34.638255 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0209b-5a94-435f-a274-21b3e0be40bb None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:34.638539 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0209b-5a94-435f-a274-21b3e0be40bb None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:34.638814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0209b-5a94-435f-a274-21b3e0be40bb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:34.639410 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0209b-5a94-435f-a274-21b3e0be40bb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:34.641391 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0209b-5a94-435f-a274-21b3e0be40bb None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:34.651281 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-71f0209b-5a94-435f-a274-21b3e0be40bb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 25 13:12:34.651281 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:34.651281 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 13:12:34.651281 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 13:12:34.651281 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 13:12:34.651281 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 13:12:34.651281 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 13:12:34.651281 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:34.651281 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 25 13:12:34.651281 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:34.651281 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 13:12:34.651281 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:34.651281 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:34.651281 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:34.651281 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:34.651281 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:34.651281 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:34.652355 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:34.652355 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:34.652355 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:34.652355 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:34.652355 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:34.652355 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:34.652355 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 13:12:34.652355 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 13:12:34.652355 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 13:12:34.652355 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 13:12:34.652355 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:34.652355 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:34.652355 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:34.652355 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:34.652355 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:34.652355 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:34.653236 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:34.653236 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:34.653236 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:34.653236 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:34.653236 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:34.653236 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:34.653236 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:34.653236 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:34.653236 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:34.653236 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:34.653236 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 13:12:34.653236 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:34.653236 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 25 13:12:34.653236 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:34.653236 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 304/628] 10.222.0.25 () {56 vars in 1129 bytes} [Tue Oct 25 13:12:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:34.662158 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0209b-5a94-435f-a274-21b3e0be40bb None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:34.685543 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c6ed3-cf8f-48c1-9b70-03cf50f3e70a None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:34.712827 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:34.724892 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:34.742530 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c554e-b058-4679-a199-ae9146810837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:34.743181 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c554e-b058-4679-a199-ae9146810837 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:34.743464 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c554e-b058-4679-a199-ae9146810837 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:34.743746 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c554e-b058-4679-a199-ae9146810837 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:34.754015 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689c554e-b058-4679-a199-ae9146810837 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:34.756185 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689c554e-b058-4679-a199-ae9146810837 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:34.771818 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-689c554e-b058-4679-a199-ae9146810837 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:12:34.771818 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:34.771818 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:34.771818 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:34.771818 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:34.771818 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:34.771818 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:34.771818 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:34.771818 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:34.771818 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:34.771818 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:34.771818 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:34.771818 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 25 13:12:34.771818 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 25 13:12:34.771818 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 25 13:12:34.772862 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 25 13:12:34.772862 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:34.772862 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:34.772862 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:34.772862 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:34.772862 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:34.772862 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:34.772862 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:34.772862 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:34.772862 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:34.772862 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:34.772862 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:34.772862 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:34.772862 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:34.772862 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:34.772862 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:34.772862 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:34.773747 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 25 13:12:34.773747 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 25 13:12:34.773747 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 25 13:12:34.773747 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 25 13:12:34.773747 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 25 13:12:34.773747 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 25 13:12:34.773747 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:12:34.773747 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:34.776297 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 325/629] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 25 13:12:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:34.783156 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c554e-b058-4679-a199-ae9146810837 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:34.810299 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0209b-5a94-435f-a274-21b3e0be40bb None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:34.849716 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43433db4-eceb-4e37-9112-80f773b95e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:34.850476 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43433db4-eceb-4e37-9112-80f773b95e70 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:34.850824 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43433db4-eceb-4e37-9112-80f773b95e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:34.851189 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43433db4-eceb-4e37-9112-80f773b95e70 None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:34.851884 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43433db4-eceb-4e37-9112-80f773b95e70 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:34.852467 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43433db4-eceb-4e37-9112-80f773b95e70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:34.853705 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43433db4-eceb-4e37-9112-80f773b95e70 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:34.864039 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 305/630] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Oct 25 13:12:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:34.865426 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43433db4-eceb-4e37-9112-80f773b95e70 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:34.912511 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c554e-b058-4679-a199-ae9146810837 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:34.954514 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f68d3a-06f5-47a7-85b8-befdf0971e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:34.955530 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f68d3a-06f5-47a7-85b8-befdf0971e3f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:34.956025 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f68d3a-06f5-47a7-85b8-befdf0971e3f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:34.956510 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f68d3a-06f5-47a7-85b8-befdf0971e3f None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:34.957396 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f68d3a-06f5-47a7-85b8-befdf0971e3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:34.957882 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f68d3a-06f5-47a7-85b8-befdf0971e3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:34.959614 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f68d3a-06f5-47a7-85b8-befdf0971e3f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:34.971685 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43433db4-eceb-4e37-9112-80f773b95e70 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:34.973403 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:34.977085 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 326/631] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 25 13:12:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:34.987436 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f68d3a-06f5-47a7-85b8-befdf0971e3f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:35.009409 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d46abd-f36f-4106-ac57-275dd34f838b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:35.010101 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d46abd-f36f-4106-ac57-275dd34f838b None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:35.010486 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d46abd-f36f-4106-ac57-275dd34f838b None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:35.010850 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d46abd-f36f-4106-ac57-275dd34f838b None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:35.011545 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d46abd-f36f-4106-ac57-275dd34f838b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:35.011926 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d46abd-f36f-4106-ac57-275dd34f838b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:35.013367 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d46abd-f36f-4106-ac57-275dd34f838b None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:35.023199 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 306/632] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Oct 25 13:12:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:35.024451 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d46abd-f36f-4106-ac57-275dd34f838b None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:35.035629 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:35.115380 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f68d3a-06f5-47a7-85b8-befdf0971e3f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:35.132801 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d46abd-f36f-4106-ac57-275dd34f838b None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:35.164027 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019ab04-2bb0-4a93-ba76-b51a188611a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:35.164027 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019ab04-2bb0-4a93-ba76-b51a188611a5 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:35.164027 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019ab04-2bb0-4a93-ba76-b51a188611a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:35.164027 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019ab04-2bb0-4a93-ba76-b51a188611a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:35.164507 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019ab04-2bb0-4a93-ba76-b51a188611a5 None admin] RBAC: Adding query filter params (role.id=b3a463dfc621439eaee93c0551a4e296, scope.project.id=616ecfe8d2c74aad9386720718392e81, user.id=9d5d4691dca848d58bd280d2fad79fbe) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:35.164507 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019ab04-2bb0-4a93-ba76-b51a188611a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:35.164831 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019ab04-2bb0-4a93-ba76-b51a188611a5 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:35.171326 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dddbba0-f025-4db9-ad8b-f2a3c992834f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:35.172323 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddbba0-f025-4db9-ad8b-f2a3c992834f None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:35.172748 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddbba0-f025-4db9-ad8b-f2a3c992834f None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:35.173168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddbba0-f025-4db9-ad8b-f2a3c992834f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:35.173551 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 327/633] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 25 13:12:34 2022] GET /identity/v3/role_assignments?user.id=9d5d4691dca848d58bd280d2fad79fbe&scope.project.id=616ecfe8d2c74aad9386720718392e81&role.id=b3a463dfc621439eaee93c0551a4e296 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:35.174326 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dddbba0-f025-4db9-ad8b-f2a3c992834f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:35.175884 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dddbba0-f025-4db9-ad8b-f2a3c992834f None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:35.216103 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 307/634] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:12:35 2022] POST /identity/v3/endpoints => generated 346 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:12:35.759644 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33765881-8d9e-4706-b0eb-a8d384367485 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:35.760242 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33765881-8d9e-4706-b0eb-a8d384367485 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:35.760242 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33765881-8d9e-4706-b0eb-a8d384367485 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:35.761834 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 328/635] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:35.767298 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b185eee-7eaa-40af-8cc7-50d9105aa1af None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:35.767763 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b185eee-7eaa-40af-8cc7-50d9105aa1af None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:35.767856 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b185eee-7eaa-40af-8cc7-50d9105aa1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:35.787041 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-1b185eee-7eaa-40af-8cc7-50d9105aa1af None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:35.788551 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-1b185eee-7eaa-40af-8cc7-50d9105aa1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:35.807064 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:35.866253 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 308/636] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 13:12:36.132231 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33765881-8d9e-4706-b0eb-a8d384367485 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:36.242003 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33765881-8d9e-4706-b0eb-a8d384367485 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:36.243508 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:36.277971 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abe582-8463-4e57-9fa0-6e9e86bb7b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:36.278600 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abe582-8463-4e57-9fa0-6e9e86bb7b0d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:36.278879 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abe582-8463-4e57-9fa0-6e9e86bb7b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:36.279152 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abe582-8463-4e57-9fa0-6e9e86bb7b0d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:36.279729 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29abe582-8463-4e57-9fa0-6e9e86bb7b0d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:36.281754 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29abe582-8463-4e57-9fa0-6e9e86bb7b0d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:36.290771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-29abe582-8463-4e57-9fa0-6e9e86bb7b0d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 25 13:12:36.290771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:36.290771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 13:12:36.290771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 13:12:36.290771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 13:12:36.290771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 13:12:36.290771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 13:12:36.290771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:36.290771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 25 13:12:36.290771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:36.290771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 13:12:36.290771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:36.290771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:36.290771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:36.290771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:36.290771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:36.290771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:36.291744 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:36.291744 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:36.291744 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:36.291744 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:36.291744 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:36.291744 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:36.291744 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 13:12:36.291744 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 13:12:36.291744 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 13:12:36.291744 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 13:12:36.291744 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:36.291744 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:36.291744 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:36.291744 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:36.291744 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:36.291744 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:36.293266 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:36.293266 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:36.293266 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:36.293266 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:36.293266 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:36.293266 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:36.293266 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:36.293266 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:36.293266 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:36.293266 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:36.293266 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 13:12:36.293266 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:36.293266 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 25 13:12:36.293266 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:36.293266 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 329/637] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Oct 25 13:12:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:36.298530 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b185eee-7eaa-40af-8cc7-50d9105aa1af None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:36.398562 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b185eee-7eaa-40af-8cc7-50d9105aa1af None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:36.433953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff24f0-b301-4615-8337-73ff321acb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:36.434565 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff24f0-b301-4615-8337-73ff321acb2b None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:36.434842 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff24f0-b301-4615-8337-73ff321acb2b None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:36.435114 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff24f0-b301-4615-8337-73ff321acb2b None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:36.435791 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff24f0-b301-4615-8337-73ff321acb2b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:36.436119 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff24f0-b301-4615-8337-73ff321acb2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:36.438120 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff24f0-b301-4615-8337-73ff321acb2b None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:36.442942 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 309/638] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Oct 25 13:12:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:36.448590 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abe582-8463-4e57-9fa0-6e9e86bb7b0d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:36.556399 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abe582-8463-4e57-9fa0-6e9e86bb7b0d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:36.591732 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb0a33-dd86-440c-a374-bb622012967e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:36.592374 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb0a33-dd86-440c-a374-bb622012967e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:36.592654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb0a33-dd86-440c-a374-bb622012967e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:36.592925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb0a33-dd86-440c-a374-bb622012967e None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:36.594229 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb0a33-dd86-440c-a374-bb622012967e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:36.594532 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb0a33-dd86-440c-a374-bb622012967e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:36.595982 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb0a33-dd86-440c-a374-bb622012967e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:36.600958 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 330/639] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Oct 25 13:12:36 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:36.862424 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd612ca-3923-41b0-a93d-7a6126171057 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:36.862963 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd612ca-3923-41b0-a93d-7a6126171057 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:36.862963 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd612ca-3923-41b0-a93d-7a6126171057 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:36.864667 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 310/640] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:36.870186 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efa8e3-15e9-4800-aaf2-27ffd69e41c9 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:36.871019 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efa8e3-15e9-4800-aaf2-27ffd69e41c9 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:36.871494 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efa8e3-15e9-4800-aaf2-27ffd69e41c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:36.891720 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-54efa8e3-15e9-4800-aaf2-27ffd69e41c9 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:36.893364 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-54efa8e3-15e9-4800-aaf2-27ffd69e41c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:36.918758 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:36.965267 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 331/641] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:36 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 13:12:37.238785 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd612ca-3923-41b0-a93d-7a6126171057 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:37.254205 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:37.352164 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd612ca-3923-41b0-a93d-7a6126171057 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:37.390228 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c3e01-c86d-44bb-895e-4ec7952ecbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:37.390881 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c3e01-c86d-44bb-895e-4ec7952ecbcc None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:37.391227 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c3e01-c86d-44bb-895e-4ec7952ecbcc None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:37.391506 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c3e01-c86d-44bb-895e-4ec7952ecbcc None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:37.392252 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c3e01-c86d-44bb-895e-4ec7952ecbcc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:37.393704 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c3e01-c86d-44bb-895e-4ec7952ecbcc None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:37.414430 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 311/642] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Oct 25 13:12:37 2022] POST /identity/v3/services => generated 269 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:12:37.512901 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c86ab-85f0-4829-9d01-c417a7c0591c None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:37.513201 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c86ab-85f0-4829-9d01-c417a7c0591c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:37.513399 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c86ab-85f0-4829-9d01-c417a7c0591c None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:37.515685 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 332/643] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:37.521615 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8fecb0-fdfd-41a4-ba3d-5d5a8bfc1e26 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:37.521934 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8fecb0-fdfd-41a4-ba3d-5d5a8bfc1e26 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:37.522180 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8fecb0-fdfd-41a4-ba3d-5d5a8bfc1e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:37.533908 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6c0f9-bfe9-4a07-a308-f1478a42c73b None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:37.534243 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6c0f9-bfe9-4a07-a308-f1478a42c73b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:37.534474 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6c0f9-bfe9-4a07-a308-f1478a42c73b None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:37.535814 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 333/644] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 13:12:37.542403 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5d62f-500e-4102-92f6-d4971c7069c0 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:37.542968 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5d62f-500e-4102-92f6-d4971c7069c0 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:37.543214 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5d62f-500e-4102-92f6-d4971c7069c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:37.549008 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-5a8fecb0-fdfd-41a4-ba3d-5d5a8bfc1e26 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:37.550241 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-5a8fecb0-fdfd-41a4-ba3d-5d5a8bfc1e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:37.563269 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-eda5d62f-500e-4102-92f6-d4971c7069c0 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:37.564541 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-eda5d62f-500e-4102-92f6-d4971c7069c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:37.632200 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:37.641035 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 312/645] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:37 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 13:12:37.651929 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 334/646] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:37 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 25 13:12:37.915587 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8fecb0-fdfd-41a4-ba3d-5d5a8bfc1e26 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:37.926368 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5d62f-500e-4102-92f6-d4971c7069c0 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:38.033079 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8fecb0-fdfd-41a4-ba3d-5d5a8bfc1e26 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:38.043928 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:38.057634 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5d62f-500e-4102-92f6-d4971c7069c0 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:38.076467 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a51eb-7dba-4ed9-8750-842d3f230bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:38.077668 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a51eb-7dba-4ed9-8750-842d3f230bac None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:38.078097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a51eb-7dba-4ed9-8750-842d3f230bac None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:38.078507 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a51eb-7dba-4ed9-8750-842d3f230bac None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:38.091286 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a51eb-7dba-4ed9-8750-842d3f230bac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:12:38.097915 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-c63a51eb-7dba-4ed9-8750-842d3f230bac None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 25 13:12:38.097915 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:38.097915 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:38.097915 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:38.097915 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:38.097915 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:38.097915 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:38.097915 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:38.097915 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:38.097915 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:38.097915 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:38.097915 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:38.097915 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:12:38.097915 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:12:38.097915 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:12:38.097915 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:12:38.099023 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:12:38.099023 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:12:38.099023 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:12:38.099023 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:12:38.099023 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:38.099023 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:38.099023 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:38.099023 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:38.099023 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:38.099023 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:38.099023 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:38.099023 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:38.099023 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:38.099023 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:38.099023 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:38.099023 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:38.100088 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:38.100088 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:38.100088 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:38.100088 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:38.100088 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:12:38.100088 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:12:38.100088 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:12:38.100088 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:12:38.100088 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:12:38.100088 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:12:38.100088 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 25 13:12:38.100088 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:38.100900 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183514e-3c52-42e9-9c93-4029a97b88f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:38.101498 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183514e-3c52-42e9-9c93-4029a97b88f3 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:38.101848 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183514e-3c52-42e9-9c93-4029a97b88f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:38.102189 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183514e-3c52-42e9-9c93-4029a97b88f3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:38.102902 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183514e-3c52-42e9-9c93-4029a97b88f3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:38.103056 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 313/647] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Oct 25 13:12:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:38.108105 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183514e-3c52-42e9-9c93-4029a97b88f3 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:38.109007 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a51eb-7dba-4ed9-8750-842d3f230bac None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:38.118632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-e183514e-3c52-42e9-9c93-4029a97b88f3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 25 13:12:38.118632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:38.118632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 13:12:38.118632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 13:12:38.118632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 13:12:38.118632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 13:12:38.118632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 13:12:38.118632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:38.118632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 25 13:12:38.118632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:38.118632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 13:12:38.118632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:38.118632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:38.118632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:38.118632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:38.118632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:38.118632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:38.119670 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:38.119670 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:38.119670 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:38.119670 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:38.119670 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:38.119670 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:38.119670 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 13:12:38.119670 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 13:12:38.119670 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 13:12:38.119670 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 13:12:38.119670 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:38.119670 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:38.119670 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:38.119670 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:38.119670 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:38.119670 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:38.120549 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:38.120549 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:38.120549 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:38.120549 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:38.120549 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:38.120549 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:38.120549 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:38.120549 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:38.120549 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:38.120549 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:38.120549 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 13:12:38.120549 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:38.120549 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 25 13:12:38.120549 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:38.128424 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 335/648] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 25 13:12:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:38.129882 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183514e-3c52-42e9-9c93-4029a97b88f3 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:38.204392 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:38.215973 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a51eb-7dba-4ed9-8750-842d3f230bac None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:38.238649 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183514e-3c52-42e9-9c93-4029a97b88f3 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:38.253441 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b8298-3271-4835-801f-84f2b6ca6f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:38.254190 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b8298-3271-4835-801f-84f2b6ca6f6f None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:38.254590 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b8298-3271-4835-801f-84f2b6ca6f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:38.255072 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b8298-3271-4835-801f-84f2b6ca6f6f None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:38.255704 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b8298-3271-4835-801f-84f2b6ca6f6f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:38.256225 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b8298-3271-4835-801f-84f2b6ca6f6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:38.257635 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b8298-3271-4835-801f-84f2b6ca6f6f None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:38.271328 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 314/649] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Oct 25 13:12:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:38.273069 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b8298-3271-4835-801f-84f2b6ca6f6f None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:38.282859 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9532185-a78c-4c01-af78-d0ddc2c90857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:38.283600 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9532185-a78c-4c01-af78-d0ddc2c90857 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:38.284050 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9532185-a78c-4c01-af78-d0ddc2c90857 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:38.284792 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9532185-a78c-4c01-af78-d0ddc2c90857 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:38.285502 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9532185-a78c-4c01-af78-d0ddc2c90857 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:38.285894 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9532185-a78c-4c01-af78-d0ddc2c90857 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:38.287705 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9532185-a78c-4c01-af78-d0ddc2c90857 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:38.299729 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 336/650] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 25 13:12:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:12:38.301131 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9532185-a78c-4c01-af78-d0ddc2c90857 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:38.326829 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:38.410795 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b8298-3271-4835-801f-84f2b6ca6f6f None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:38.432342 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:38.448277 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084a2cc-37d5-41f7-a101-6ad6a88b8a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:38.448907 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084a2cc-37d5-41f7-a101-6ad6a88b8a66 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:38.449185 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084a2cc-37d5-41f7-a101-6ad6a88b8a66 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:38.449461 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084a2cc-37d5-41f7-a101-6ad6a88b8a66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:38.455282 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9532185-a78c-4c01-af78-d0ddc2c90857 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:38.461291 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084a2cc-37d5-41f7-a101-6ad6a88b8a66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:38.463144 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084a2cc-37d5-41f7-a101-6ad6a88b8a66 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:38.478333 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-3084a2cc-37d5-41f7-a101-6ad6a88b8a66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:38.478333 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:38.478333 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:38.478333 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:38.478333 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:38.478333 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:38.478333 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:38.478333 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:38.478333 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:38.478333 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:38.478333 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:38.478333 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:38.478333 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:12:38.478333 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:12:38.478333 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:12:38.478333 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:12:38.479311 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:38.479311 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:38.479311 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:38.479311 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:38.479311 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:38.479311 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:38.479311 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:38.479311 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:38.479311 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:38.479311 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:38.479311 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:38.479311 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:38.479311 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:38.479311 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:38.479311 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:38.479311 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:38.479311 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:12:38.480248 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:12:38.480248 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:38.480248 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:38.484301 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 315/651] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 13:12:38.485832 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084a2cc-37d5-41f7-a101-6ad6a88b8a66 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:38.502005 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52844e-528d-4cb2-9b69-34df3b292a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:38.503342 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52844e-528d-4cb2-9b69-34df3b292a1b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:38.504050 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52844e-528d-4cb2-9b69-34df3b292a1b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:38.504542 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52844e-528d-4cb2-9b69-34df3b292a1b None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:38.505644 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52844e-528d-4cb2-9b69-34df3b292a1b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:38.506107 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52844e-528d-4cb2-9b69-34df3b292a1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:38.507982 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52844e-528d-4cb2-9b69-34df3b292a1b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:38.520204 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 337/652] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 25 13:12:38 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:38.611425 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084a2cc-37d5-41f7-a101-6ad6a88b8a66 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:38.651779 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0da30-6dc8-48e7-8308-2224dc9f406b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:38.652826 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0da30-6dc8-48e7-8308-2224dc9f406b None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:38.653306 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0da30-6dc8-48e7-8308-2224dc9f406b None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:38.653774 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0da30-6dc8-48e7-8308-2224dc9f406b None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:38.654641 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0da30-6dc8-48e7-8308-2224dc9f406b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:38.655168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0da30-6dc8-48e7-8308-2224dc9f406b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:38.657495 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0da30-6dc8-48e7-8308-2224dc9f406b None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:38.672423 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 316/653] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:38.677654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52844e-528d-4cb2-9b69-34df3b292a1b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:38.782238 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:38.809264 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52844e-528d-4cb2-9b69-34df3b292a1b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:38.829746 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a1d72-236f-45e4-9823-b708d522b559 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:38.830035 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a1d72-236f-45e4-9823-b708d522b559 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:38.832898 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a1d72-236f-45e4-9823-b708d522b559 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:38.832898 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 317/654] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:38.837129 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030db2a-b840-40bc-87b5-cbfbdb541b7d None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:38.837411 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030db2a-b840-40bc-87b5-cbfbdb541b7d None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:38.837692 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030db2a-b840-40bc-87b5-cbfbdb541b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:38.848597 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef62e2-4a9b-4f07-a1bf-2e0e76928c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:38.849454 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef62e2-4a9b-4f07-a1bf-2e0e76928c32 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:38.849887 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef62e2-4a9b-4f07-a1bf-2e0e76928c32 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:38.850410 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef62e2-4a9b-4f07-a1bf-2e0e76928c32 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:38.857078 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-b030db2a-b840-40bc-87b5-cbfbdb541b7d None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:38.858286 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b030db2a-b840-40bc-87b5-cbfbdb541b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:38.859317 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef62e2-4a9b-4f07-a1bf-2e0e76928c32 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:38.860964 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef62e2-4a9b-4f07-a1bf-2e0e76928c32 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:38.873259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-5cef62e2-4a9b-4f07-a1bf-2e0e76928c32 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 25 13:12:38.873259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:38.873259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:38.873259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:38.873259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:38.873259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:38.873259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:38.873259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:38.873259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:38.873259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:38.873259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:38.873259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:38.873259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 25 13:12:38.873259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 25 13:12:38.873259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 25 13:12:38.873259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 25 13:12:38.874917 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:38.874917 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:38.874917 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 25 13:12:38.874917 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:12:38.874917 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 25 13:12:38.874917 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:12:38.874917 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:38.874917 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:38.874917 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:38.874917 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:38.874917 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:38.874917 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:38.874917 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:38.874917 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:38.874917 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:38.874917 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:38.874917 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:38.874917 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:38.876061 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:38.876061 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:38.876061 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 25 13:12:38.876061 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 25 13:12:38.876061 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 25 13:12:38.876061 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 25 13:12:38.876061 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 25 13:12:38.876061 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 25 13:12:38.876061 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 25 13:12:38.876061 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:38.877310 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 338/655] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Oct 25 13:12:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:38.882962 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef62e2-4a9b-4f07-a1bf-2e0e76928c32 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:38.886855 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:38.952043 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 318/656] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:38 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 25 13:12:38.997697 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef62e2-4a9b-4f07-a1bf-2e0e76928c32 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:39.034173 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1898a1-7da2-4bfd-92d7-75891b1ae8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:39.035136 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1898a1-7da2-4bfd-92d7-75891b1ae8f8 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:39.035639 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1898a1-7da2-4bfd-92d7-75891b1ae8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:39.036143 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1898a1-7da2-4bfd-92d7-75891b1ae8f8 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:39.037097 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1898a1-7da2-4bfd-92d7-75891b1ae8f8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:39.037616 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1898a1-7da2-4bfd-92d7-75891b1ae8f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:39.039239 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1898a1-7da2-4bfd-92d7-75891b1ae8f8 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:39.054981 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:39.059479 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 339/657] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Oct 25 13:12:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:12:39.066232 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030db2a-b840-40bc-87b5-cbfbdb541b7d None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:39.174416 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030db2a-b840-40bc-87b5-cbfbdb541b7d None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:39.211617 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c9ec0-d24c-438e-90f1-cf8eca8a0bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:39.212571 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c9ec0-d24c-438e-90f1-cf8eca8a0bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:39.213040 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c9ec0-d24c-438e-90f1-cf8eca8a0bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:39.213521 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c9ec0-d24c-438e-90f1-cf8eca8a0bc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:39.224186 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1898a1-7da2-4bfd-92d7-75891b1ae8f8 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:39.225787 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c9ec0-d24c-438e-90f1-cf8eca8a0bc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:39.227245 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c9ec0-d24c-438e-90f1-cf8eca8a0bc8 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:39.245001 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-829c9ec0-d24c-438e-90f1-cf8eca8a0bc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:39.245001 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:39.245001 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:39.245001 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:39.245001 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:39.245001 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:39.245001 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:39.245001 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:39.245001 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:39.245001 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:39.245001 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:39.245001 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:39.245001 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:12:39.245001 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:12:39.245001 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:12:39.245001 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:12:39.246047 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:39.246047 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:39.246047 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:39.246047 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:39.246047 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:39.246047 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:39.246047 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:39.246047 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:39.246047 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:39.246047 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:39.246047 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:39.246047 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:39.246047 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:39.246047 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:39.246047 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:39.246047 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:39.246047 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:12:39.246943 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:12:39.246943 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:39.246943 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:39.246943 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 319/658] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:39.254004 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c9ec0-d24c-438e-90f1-cf8eca8a0bc8 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:39.271822 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:39.360755 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1898a1-7da2-4bfd-92d7-75891b1ae8f8 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:39.376095 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c9ec0-d24c-438e-90f1-cf8eca8a0bc8 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:39.409647 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feccc82-0f78-4d8c-8537-09ce4c6b251b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:39.410707 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feccc82-0f78-4d8c-8537-09ce4c6b251b None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:39.411171 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feccc82-0f78-4d8c-8537-09ce4c6b251b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:39.411618 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feccc82-0f78-4d8c-8537-09ce4c6b251b None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:39.412600 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feccc82-0f78-4d8c-8537-09ce4c6b251b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:39.412708 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0df30-9c71-42fe-b4b2-9ae45a9a63fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:39.413281 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0df30-9c71-42fe-b4b2-9ae45a9a63fe None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:39.413626 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0df30-9c71-42fe-b4b2-9ae45a9a63fe None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:39.413980 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0df30-9c71-42fe-b4b2-9ae45a9a63fe None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:39.414693 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0df30-9c71-42fe-b4b2-9ae45a9a63fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:39.415027 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feccc82-0f78-4d8c-8537-09ce4c6b251b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:39.415130 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0df30-9c71-42fe-b4b2-9ae45a9a63fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:39.416522 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0df30-9c71-42fe-b4b2-9ae45a9a63fe None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:39.435119 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 320/659] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:12:39.437256 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0df30-9c71-42fe-b4b2-9ae45a9a63fe None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:39.439557 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 340/660] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Oct 25 13:12:39 2022] POST /identity/v3/services => generated 241 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:12:39.535367 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:39.569598 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0df30-9c71-42fe-b4b2-9ae45a9a63fe None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:39.614433 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cef727-dbb2-4049-ae8e-be47004d354c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:39.615485 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cef727-dbb2-4049-ae8e-be47004d354c None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:39.616006 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cef727-dbb2-4049-ae8e-be47004d354c None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:39.616483 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cef727-dbb2-4049-ae8e-be47004d354c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:39.625364 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cef727-dbb2-4049-ae8e-be47004d354c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:39.627306 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cef727-dbb2-4049-ae8e-be47004d354c None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:39.640831 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-d3cef727-dbb2-4049-ae8e-be47004d354c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:12:39.640831 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:39.640831 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:39.640831 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:39.640831 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:39.640831 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:39.640831 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:39.640831 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:39.640831 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:39.640831 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:39.640831 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:39.640831 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:39.640831 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 25 13:12:39.640831 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 25 13:12:39.640831 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 25 13:12:39.641789 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 25 13:12:39.641789 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:39.641789 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:39.641789 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:39.641789 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:39.641789 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:39.641789 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:39.641789 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:39.641789 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:39.641789 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:39.641789 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:39.641789 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:39.641789 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:39.641789 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:39.641789 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:39.641789 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:39.641789 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:39.642699 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 25 13:12:39.642699 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 25 13:12:39.642699 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 25 13:12:39.642699 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 25 13:12:39.642699 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 25 13:12:39.642699 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 25 13:12:39.642699 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:12:39.642699 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:39.645305 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 321/661] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 25 13:12:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:39.651239 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feccc82-0f78-4d8c-8537-09ce4c6b251b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:39.720247 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:39.756291 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde8946-efac-4bf1-9610-0bedfd57b439 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:39.756578 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde8946-efac-4bf1-9610-0bedfd57b439 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:39.756863 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde8946-efac-4bf1-9610-0bedfd57b439 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:39.758451 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 322/662] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 13:12:39.763912 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d004c-921f-4ba8-81c6-8d3396c8ec89 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:39.764216 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d004c-921f-4ba8-81c6-8d3396c8ec89 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:39.764493 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d004c-921f-4ba8-81c6-8d3396c8ec89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:39.772509 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feccc82-0f78-4d8c-8537-09ce4c6b251b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:39.787245 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-fa7d004c-921f-4ba8-81c6-8d3396c8ec89 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:39.788558 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-fa7d004c-921f-4ba8-81c6-8d3396c8ec89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:39.812688 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f6be5-1c55-4538-8161-d2f7ea56cbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:39.813725 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f6be5-1c55-4538-8161-d2f7ea56cbb8 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:39.814008 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f6be5-1c55-4538-8161-d2f7ea56cbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:39.814280 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f6be5-1c55-4538-8161-d2f7ea56cbb8 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:39.814982 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f6be5-1c55-4538-8161-d2f7ea56cbb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:39.815273 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f6be5-1c55-4538-8161-d2f7ea56cbb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:39.816733 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f6be5-1c55-4538-8161-d2f7ea56cbb8 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:39.832379 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 341/663] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 25 13:12:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:39.838273 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f6be5-1c55-4538-8161-d2f7ea56cbb8 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:39.875941 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 323/664] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:39 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 13:12:39.954502 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f6be5-1c55-4538-8161-d2f7ea56cbb8 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:39.975260 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:39.990282 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4961202c-1fb6-45f6-93ee-864d0a7639e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:39.990953 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4961202c-1fb6-45f6-93ee-864d0a7639e9 None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:39.991227 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4961202c-1fb6-45f6-93ee-864d0a7639e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:39.991495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4961202c-1fb6-45f6-93ee-864d0a7639e9 None admin] PATH_INFO: `/v3/projects/616ecfe8d2c74aad9386720718392e81/users/9d5d4691dca848d58bd280d2fad79fbe/roles/3e0f611d78184eac9855bafdbdd78a7c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:39.993683 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4961202c-1fb6-45f6-93ee-864d0a7639e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=616ecfe8d2c74aad9386720718392e81, user_id=9d5d4691dca848d58bd280d2fad79fbe, role_id=3e0f611d78184eac9855bafdbdd78a7c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:39.995115 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4961202c-1fb6-45f6-93ee-864d0a7639e9 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:40.016093 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 342/665] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 25 13:12:39 2022] PUT /identity/v3/projects/616ecfe8d2c74aad9386720718392e81/users/9d5d4691dca848d58bd280d2fad79fbe/roles/3e0f611d78184eac9855bafdbdd78a7c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:12:40.153826 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d004c-921f-4ba8-81c6-8d3396c8ec89 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:40.220445 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:40.264395 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d004c-921f-4ba8-81c6-8d3396c8ec89 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:40.301484 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c481a3-8e77-4ca4-ae43-f5ff98307b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:40.302491 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c481a3-8e77-4ca4-ae43-f5ff98307b5c None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:40.302968 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c481a3-8e77-4ca4-ae43-f5ff98307b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:40.303437 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c481a3-8e77-4ca4-ae43-f5ff98307b5c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:40.304316 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c481a3-8e77-4ca4-ae43-f5ff98307b5c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:40.305924 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c481a3-8e77-4ca4-ae43-f5ff98307b5c None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:40.316251 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-59c481a3-8e77-4ca4-ae43-f5ff98307b5c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 25 13:12:40.316251 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:40.316251 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 13:12:40.316251 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 13:12:40.316251 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 13:12:40.316251 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 13:12:40.316251 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 13:12:40.316251 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:40.316251 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 25 13:12:40.316251 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:40.316251 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 13:12:40.316251 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:40.316251 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:40.316251 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:40.316251 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:40.316251 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:40.317473 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:40.317473 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:40.317473 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:40.317473 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:40.317473 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:40.317473 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:40.317473 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:40.317473 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 13:12:40.317473 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 13:12:40.317473 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 13:12:40.317473 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 13:12:40.317473 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:40.317473 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:40.317473 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:40.317473 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:40.317473 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:40.317473 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:40.318551 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:40.318551 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:40.318551 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:40.318551 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:40.318551 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:40.318551 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:40.318551 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:40.318551 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:40.318551 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:40.318551 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:40.318551 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 13:12:40.318551 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:40.318551 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 25 13:12:40.318551 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:40.321295 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 324/666] 10.222.0.25 () {56 vars in 1132 bytes} [Tue Oct 25 13:12:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:40.330837 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4961202c-1fb6-45f6-93ee-864d0a7639e9 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:40.432133 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4961202c-1fb6-45f6-93ee-864d0a7639e9 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:40.470124 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b472735-692e-45ce-8caf-dd97cdee5906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:40.470742 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b472735-692e-45ce-8caf-dd97cdee5906 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:40.471102 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b472735-692e-45ce-8caf-dd97cdee5906 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:40.471436 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b472735-692e-45ce-8caf-dd97cdee5906 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:40.472098 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b472735-692e-45ce-8caf-dd97cdee5906 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:40.472454 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b472735-692e-45ce-8caf-dd97cdee5906 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:40.473823 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b472735-692e-45ce-8caf-dd97cdee5906 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:40.483316 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 343/667] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Oct 25 13:12:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:40.488973 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c481a3-8e77-4ca4-ae43-f5ff98307b5c None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:40.597049 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c481a3-8e77-4ca4-ae43-f5ff98307b5c None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:40.628263 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:40.633190 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c519911-dbf2-48a1-8205-9d8114a7d55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:40.633798 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c519911-dbf2-48a1-8205-9d8114a7d55c None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:40.634118 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c519911-dbf2-48a1-8205-9d8114a7d55c None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:40.634366 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c519911-dbf2-48a1-8205-9d8114a7d55c None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:40.634994 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c519911-dbf2-48a1-8205-9d8114a7d55c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:40.635355 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c519911-dbf2-48a1-8205-9d8114a7d55c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:40.637218 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c519911-dbf2-48a1-8205-9d8114a7d55c None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:40.647539 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 325/668] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Oct 25 13:12:40 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:40.649061 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b472735-692e-45ce-8caf-dd97cdee5906 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:40.708379 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:40.761545 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b472735-692e-45ce-8caf-dd97cdee5906 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:40.798536 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ea0aa-0e5c-49a9-a500-c5cc9dd97faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:40.799155 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ea0aa-0e5c-49a9-a500-c5cc9dd97faa None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:40.799439 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ea0aa-0e5c-49a9-a500-c5cc9dd97faa None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:40.799713 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ea0aa-0e5c-49a9-a500-c5cc9dd97faa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:40.800452 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ea0aa-0e5c-49a9-a500-c5cc9dd97faa None admin] RBAC: Adding query filter params (interface=public, service_id=0b60baace1ca411288e3c78ae32d3bea, region_id=RegionOne) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:40.800763 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ea0aa-0e5c-49a9-a500-c5cc9dd97faa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:40.802134 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ea0aa-0e5c-49a9-a500-c5cc9dd97faa None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:40.815002 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 344/669] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Oct 25 13:12:40 2022] GET /identity/v3/endpoints?service_id=0b60baace1ca411288e3c78ae32d3bea&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:12:40.816484 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c519911-dbf2-48a1-8205-9d8114a7d55c None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:40.818814 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317d0f7-cfb1-46d2-878a-bef9991c15e3 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:40.819099 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317d0f7-cfb1-46d2-878a-bef9991c15e3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:40.819378 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317d0f7-cfb1-46d2-878a-bef9991c15e3 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:40.822221 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 345/670] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:40.828552 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c60148-f313-4dac-986f-f667ff29876e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:40.828843 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c60148-f313-4dac-986f-f667ff29876e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:40.829129 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c60148-f313-4dac-986f-f667ff29876e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:40.848151 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-66c60148-f313-4dac-986f-f667ff29876e None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:40.849330 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-66c60148-f313-4dac-986f-f667ff29876e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:40.929630 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 346/671] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:40 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 25 13:12:40.942260 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c519911-dbf2-48a1-8205-9d8114a7d55c None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:40.978198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0eea48-be77-4b06-9b28-2c428ca5e86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:40.978723 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0eea48-be77-4b06-9b28-2c428ca5e86f None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:40.979064 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0eea48-be77-4b06-9b28-2c428ca5e86f None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:40.979342 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0eea48-be77-4b06-9b28-2c428ca5e86f None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:40.980012 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0eea48-be77-4b06-9b28-2c428ca5e86f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:40.981510 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0eea48-be77-4b06-9b28-2c428ca5e86f None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:40.988682 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 326/672] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Oct 25 13:12:40 2022] GET /identity/v3/services => generated 1258 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:12:41.214914 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c60148-f313-4dac-986f-f667ff29876e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:41.256552 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:41.320298 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c60148-f313-4dac-986f-f667ff29876e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:41.356677 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25d311-7888-46f7-8b7d-cdc40904d2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:41.357293 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25d311-7888-46f7-8b7d-cdc40904d2b1 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:41.357573 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25d311-7888-46f7-8b7d-cdc40904d2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:41.357848 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25d311-7888-46f7-8b7d-cdc40904d2b1 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:41.359026 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25d311-7888-46f7-8b7d-cdc40904d2b1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:41.360452 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25d311-7888-46f7-8b7d-cdc40904d2b1 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:41.378973 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 347/673] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Oct 25 13:12:41 2022] POST /identity/v3/services => generated 251 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:12:41.753141 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbedec5-d4e2-4cfd-ac8b-95d1ddb09e6c None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:41.753644 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbedec5-d4e2-4cfd-ac8b-95d1ddb09e6c None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:41.753746 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbedec5-d4e2-4cfd-ac8b-95d1ddb09e6c None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:41.755024 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 327/674] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:41.760507 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c959c-203c-4bcd-872f-e9eada056a0c None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:41.760801 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c959c-203c-4bcd-872f-e9eada056a0c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:41.761084 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c959c-203c-4bcd-872f-e9eada056a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:41.781372 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-342c959c-203c-4bcd-872f-e9eada056a0c None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:41.782577 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-342c959c-203c-4bcd-872f-e9eada056a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:41.861910 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 348/675] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 13:12:42.131933 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbedec5-d4e2-4cfd-ac8b-95d1ddb09e6c None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:42.190981 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:42.246501 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbedec5-d4e2-4cfd-ac8b-95d1ddb09e6c None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:42.284816 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79b089-736a-407d-8cd0-be49dc2f52ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:42.285450 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79b089-736a-407d-8cd0-be49dc2f52ba None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:42.285729 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79b089-736a-407d-8cd0-be49dc2f52ba None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:42.286001 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79b089-736a-407d-8cd0-be49dc2f52ba None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:42.286582 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79b089-736a-407d-8cd0-be49dc2f52ba None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:42.288051 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79b089-736a-407d-8cd0-be49dc2f52ba None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:42.297901 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-af79b089-736a-407d-8cd0-be49dc2f52ba None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 25 13:12:42.297901 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:42.297901 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 13:12:42.297901 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 13:12:42.297901 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 13:12:42.297901 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 13:12:42.297901 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 13:12:42.297901 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:42.297901 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 25 13:12:42.297901 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:42.297901 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 13:12:42.297901 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:42.297901 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:42.297901 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:42.297901 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:42.297901 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:42.297901 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:42.298932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:42.298932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:42.298932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:42.298932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:42.298932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:42.298932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:42.298932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 13:12:42.298932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 13:12:42.298932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 13:12:42.298932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 13:12:42.298932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:42.298932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:42.298932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:42.298932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:42.298932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:42.298932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:42.299779 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:42.299779 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:42.299779 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:42.299779 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:42.299779 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:42.299779 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:42.299779 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:42.299779 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:42.299779 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:42.299779 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:42.299779 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 13:12:42.299779 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:42.299779 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 25 13:12:42.299779 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:42.299779 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 328/676] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Oct 25 13:12:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:42.305457 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c959c-203c-4bcd-872f-e9eada056a0c None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:42.315381 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aadc8d-1d65-4b3a-aa67-b51b84fd82c2 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:42.315882 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aadc8d-1d65-4b3a-aa67-b51b84fd82c2 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:42.316332 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aadc8d-1d65-4b3a-aa67-b51b84fd82c2 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:42.318076 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 329/677] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 13:12:42.323510 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b744e-5e69-4c1c-9905-90d404442495 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:42.324047 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b744e-5e69-4c1c-9905-90d404442495 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:42.324476 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b744e-5e69-4c1c-9905-90d404442495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:42.335443 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:42.347273 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-9e7b744e-5e69-4c1c-9905-90d404442495 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:42.348749 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-9e7b744e-5e69-4c1c-9905-90d404442495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:42.428667 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c959c-203c-4bcd-872f-e9eada056a0c None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:42.436049 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 330/678] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 25 13:12:42.471049 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571eb8dc-34ef-4afb-b565-302b1310bc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:42.472006 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571eb8dc-34ef-4afb-b565-302b1310bc99 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:42.472560 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571eb8dc-34ef-4afb-b565-302b1310bc99 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:42.473056 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571eb8dc-34ef-4afb-b565-302b1310bc99 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:42.473972 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571eb8dc-34ef-4afb-b565-302b1310bc99 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:42.474478 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571eb8dc-34ef-4afb-b565-302b1310bc99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:42.476063 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571eb8dc-34ef-4afb-b565-302b1310bc99 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:42.481433 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 349/679] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Oct 25 13:12:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:42.489475 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b744e-5e69-4c1c-9905-90d404442495 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:42.535382 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:42.591692 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b744e-5e69-4c1c-9905-90d404442495 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:42.627798 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e340d6b-648e-4327-b7ad-ac000c3bc65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:42.628474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e340d6b-648e-4327-b7ad-ac000c3bc65e None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:42.628751 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e340d6b-648e-4327-b7ad-ac000c3bc65e None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:42.629031 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e340d6b-648e-4327-b7ad-ac000c3bc65e None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:42.629666 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e340d6b-648e-4327-b7ad-ac000c3bc65e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:42.629966 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e340d6b-648e-4327-b7ad-ac000c3bc65e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:42.631331 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e340d6b-648e-4327-b7ad-ac000c3bc65e None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:42.636497 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 331/680] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Oct 25 13:12:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:42.642662 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571eb8dc-34ef-4afb-b565-302b1310bc99 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:42.706422 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e340d6b-648e-4327-b7ad-ac000c3bc65e None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:42.737800 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:42.752549 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571eb8dc-34ef-4afb-b565-302b1310bc99 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:42.794887 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a036c4e-0d44-4f4e-9985-3e65c082f6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:42.795510 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a036c4e-0d44-4f4e-9985-3e65c082f6ac None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:42.795890 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a036c4e-0d44-4f4e-9985-3e65c082f6ac None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:42.796785 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a036c4e-0d44-4f4e-9985-3e65c082f6ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:42.797499 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a036c4e-0d44-4f4e-9985-3e65c082f6ac None admin] RBAC: Adding query filter params (interface=public, service_id=e3cadb2fba1a443dae789b59d4f34bcc, region_id=RegionOne) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:42.797809 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a036c4e-0d44-4f4e-9985-3e65c082f6ac None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:42.799402 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a036c4e-0d44-4f4e-9985-3e65c082f6ac None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:42.805317 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 350/681] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Oct 25 13:12:42 2022] GET /identity/v3/endpoints?service_id=e3cadb2fba1a443dae789b59d4f34bcc&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:42.811081 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a036c4e-0d44-4f4e-9985-3e65c082f6ac None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:42.835565 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e340d6b-648e-4327-b7ad-ac000c3bc65e None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:42.848470 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:42.874536 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345f16c-6ac9-48ee-88fe-3bb0cc28bd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:42.875216 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345f16c-6ac9-48ee-88fe-3bb0cc28bd8b None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:42.875530 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345f16c-6ac9-48ee-88fe-3bb0cc28bd8b None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:42.875772 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345f16c-6ac9-48ee-88fe-3bb0cc28bd8b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:42.886790 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3345f16c-6ac9-48ee-88fe-3bb0cc28bd8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:12:42.892459 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-3345f16c-6ac9-48ee-88fe-3bb0cc28bd8b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 25 13:12:42.892459 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:42.892459 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:42.892459 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:42.892459 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:42.892459 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:42.892459 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:42.892459 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:42.892459 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:42.892459 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:42.892459 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:42.892459 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:42.892459 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:12:42.892459 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:12:42.892459 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:12:42.892459 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:12:42.893373 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:12:42.893373 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:12:42.893373 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:12:42.893373 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:12:42.893373 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:42.893373 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:42.893373 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:42.893373 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:42.893373 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:42.893373 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:42.893373 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:42.893373 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:42.893373 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:42.893373 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:42.893373 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:42.893373 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:42.894215 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:42.894215 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:42.894215 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:42.894215 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:42.894215 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:12:42.894215 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:12:42.894215 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:12:42.894215 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:12:42.894215 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:12:42.894215 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:12:42.894215 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 25 13:12:42.894215 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:42.894215 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 332/682] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Oct 25 13:12:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 13:12:42.901237 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345f16c-6ac9-48ee-88fe-3bb0cc28bd8b None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:42.925420 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a036c4e-0d44-4f4e-9985-3e65c082f6ac None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:42.964060 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e804704-da63-4499-8ccf-6dcc89143649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:42.964593 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e804704-da63-4499-8ccf-6dcc89143649 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:42.964878 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e804704-da63-4499-8ccf-6dcc89143649 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:42.965154 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e804704-da63-4499-8ccf-6dcc89143649 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:42.965750 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e804704-da63-4499-8ccf-6dcc89143649 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:42.967232 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e804704-da63-4499-8ccf-6dcc89143649 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:42.979992 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 351/683] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Oct 25 13:12:42 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:12:43.016405 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345f16c-6ac9-48ee-88fe-3bb0cc28bd8b None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:43.059796 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc0aa0-b528-4a5c-b7a7-3f378a32ccb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:43.060452 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc0aa0-b528-4a5c-b7a7-3f378a32ccb0 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:43.060732 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc0aa0-b528-4a5c-b7a7-3f378a32ccb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:43.061006 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc0aa0-b528-4a5c-b7a7-3f378a32ccb0 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:43.061781 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc0aa0-b528-4a5c-b7a7-3f378a32ccb0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:43.062155 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc0aa0-b528-4a5c-b7a7-3f378a32ccb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:43.063571 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc0aa0-b528-4a5c-b7a7-3f378a32ccb0 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:43.073535 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 333/684] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Oct 25 13:12:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:43.081335 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e804704-da63-4499-8ccf-6dcc89143649 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:43.103273 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:43.201098 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e804704-da63-4499-8ccf-6dcc89143649 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:43.237858 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc03ca-9af5-4aeb-b0e2-fa5e6aea0f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:43.238844 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc03ca-9af5-4aeb-b0e2-fa5e6aea0f96 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:43.239326 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc03ca-9af5-4aeb-b0e2-fa5e6aea0f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:43.239820 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc03ca-9af5-4aeb-b0e2-fa5e6aea0f96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:43.251061 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc03ca-9af5-4aeb-b0e2-fa5e6aea0f96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:43.252859 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc03ca-9af5-4aeb-b0e2-fa5e6aea0f96 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:43.269634 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-94fc03ca-9af5-4aeb-b0e2-fa5e6aea0f96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:43.269634 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:43.269634 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:43.269634 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:43.269634 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:43.269634 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:43.269634 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:43.269634 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:43.269634 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:43.269634 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:43.269634 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:43.269634 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:43.269634 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:12:43.269634 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:12:43.269634 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:12:43.269634 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:12:43.270619 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:43.270619 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:43.270619 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:43.270619 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:43.270619 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:43.270619 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:43.270619 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:43.270619 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:43.270619 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:43.270619 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:43.270619 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:43.270619 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:43.270619 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:43.270619 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:43.270619 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:43.270619 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:43.270619 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:12:43.271553 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:12:43.271553 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:43.271553 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:43.273717 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 352/685] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:43.279634 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc0aa0-b528-4a5c-b7a7-3f378a32ccb0 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:43.293712 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c78fe-130f-4ce8-9844-939c50dfd24a None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:43.294324 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c78fe-130f-4ce8-9844-939c50dfd24a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:43.294799 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c78fe-130f-4ce8-9844-939c50dfd24a None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:43.296714 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 353/686] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 13:12:43.301680 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967781a-2d28-42cd-ad68-ce6a80249beb None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:43.301958 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967781a-2d28-42cd-ad68-ce6a80249beb None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:43.302242 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967781a-2d28-42cd-ad68-ce6a80249beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:43.320719 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:43.323020 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e967781a-2d28-42cd-ad68-ce6a80249beb None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:43.324307 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e967781a-2d28-42cd-ad68-ce6a80249beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:43.403205 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:43.412373 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc0aa0-b528-4a5c-b7a7-3f378a32ccb0 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:43.418973 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 354/687] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 25 13:12:43.453341 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b8bea-753d-4ca9-929c-e48011b140cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:43.454003 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b8bea-753d-4ca9-929c-e48011b140cc None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:43.454290 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b8bea-753d-4ca9-929c-e48011b140cc None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:43.454614 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b8bea-753d-4ca9-929c-e48011b140cc None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:43.455255 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b8bea-753d-4ca9-929c-e48011b140cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:43.455555 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b8bea-753d-4ca9-929c-e48011b140cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:43.456955 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b8bea-753d-4ca9-929c-e48011b140cc None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:43.470109 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 334/688] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:12:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:43.475661 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967781a-2d28-42cd-ad68-ce6a80249beb None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:43.581835 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967781a-2d28-42cd-ad68-ce6a80249beb None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:43.618130 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a02b7-e3d1-4790-bdca-6c7ff94f869c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:43.619093 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a02b7-e3d1-4790-bdca-6c7ff94f869c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:43.619575 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a02b7-e3d1-4790-bdca-6c7ff94f869c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:43.620093 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a02b7-e3d1-4790-bdca-6c7ff94f869c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:43.627765 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a02b7-e3d1-4790-bdca-6c7ff94f869c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:43.629450 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a02b7-e3d1-4790-bdca-6c7ff94f869c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:43.643157 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-ed3a02b7-e3d1-4790-bdca-6c7ff94f869c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 25 13:12:43.643157 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:43.643157 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:43.643157 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:43.643157 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:43.643157 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:43.643157 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:43.643157 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:43.643157 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:43.643157 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:43.643157 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:43.643157 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:43.643157 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 25 13:12:43.643157 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 25 13:12:43.643157 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 25 13:12:43.643157 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 25 13:12:43.644259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:43.644259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:43.644259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 25 13:12:43.644259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:12:43.644259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 25 13:12:43.644259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:12:43.644259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:43.644259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:43.644259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:43.644259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:43.644259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:43.644259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:43.644259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:43.644259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:43.644259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:43.644259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:43.644259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:43.644259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:43.645202 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:43.645202 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:43.645202 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 25 13:12:43.645202 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 25 13:12:43.645202 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 25 13:12:43.645202 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 25 13:12:43.645202 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 25 13:12:43.645202 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 25 13:12:43.645202 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 25 13:12:43.645202 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:43.652127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 355/689] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Oct 25 13:12:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:43.654474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b8bea-753d-4ca9-929c-e48011b140cc None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:43.724192 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a02b7-e3d1-4790-bdca-6c7ff94f869c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:43.767296 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:43.777239 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b8bea-753d-4ca9-929c-e48011b140cc None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:43.798118 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:43.814924 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0964e-a2e7-47a7-a158-6ab211a51892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:43.815532 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0964e-a2e7-47a7-a158-6ab211a51892 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:43.815810 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0964e-a2e7-47a7-a158-6ab211a51892 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:43.816113 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0964e-a2e7-47a7-a158-6ab211a51892 None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:43.817272 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0964e-a2e7-47a7-a158-6ab211a51892 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:43.817583 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0964e-a2e7-47a7-a158-6ab211a51892 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:43.819394 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0964e-a2e7-47a7-a158-6ab211a51892 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:43.838447 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 335/690] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Oct 25 13:12:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:43.839627 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e27ef-1abb-4b24-b0fb-4864ae683d7c None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:43.839969 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e27ef-1abb-4b24-b0fb-4864ae683d7c None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:43.840210 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e27ef-1abb-4b24-b0fb-4864ae683d7c None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:43.841536 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 336/691] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:43.847061 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e27ef-1abb-4b24-b0fb-4864ae683d7c None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:43.847312 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a02b7-e3d1-4790-bdca-6c7ff94f869c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:43.883083 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e25b0-5804-4dea-b15a-b07ef902ca93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:43.883711 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e25b0-5804-4dea-b15a-b07ef902ca93 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:43.884018 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e25b0-5804-4dea-b15a-b07ef902ca93 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:43.884364 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e25b0-5804-4dea-b15a-b07ef902ca93 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:43.884871 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e25b0-5804-4dea-b15a-b07ef902ca93 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:43.886498 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e25b0-5804-4dea-b15a-b07ef902ca93 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:43.898800 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-7c9e25b0-5804-4dea-b15a-b07ef902ca93 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 25 13:12:43.898800 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:43.898800 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 13:12:43.898800 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 13:12:43.898800 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 13:12:43.898800 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 13:12:43.898800 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 13:12:43.898800 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:43.898800 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 25 13:12:43.898800 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:43.898800 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 13:12:43.898800 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:43.898800 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:43.898800 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:43.898800 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:43.898800 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:43.904063 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:43.904063 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:43.904063 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:43.904063 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:43.904063 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:43.904063 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:43.904063 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:43.904063 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 13:12:43.904063 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 13:12:43.904063 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 13:12:43.904063 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 13:12:43.904063 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:43.904063 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:43.904063 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:43.904063 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:43.904063 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:43.904063 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:43.905186 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:43.905186 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:43.905186 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:43.905186 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:43.905186 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:43.905186 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:43.905186 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:43.905186 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:43.905186 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:43.905186 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:43.905186 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 13:12:43.905186 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:43.905186 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 25 13:12:43.905186 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:43.905186 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 356/692] 10.222.0.25 () {56 vars in 1132 bytes} [Tue Oct 25 13:12:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:43.906118 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25241901-22d6-4232-bd0c-f00fd9ba3f42 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:43.906118 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25241901-22d6-4232-bd0c-f00fd9ba3f42 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:43.906118 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25241901-22d6-4232-bd0c-f00fd9ba3f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:43.926545 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-25241901-22d6-4232-bd0c-f00fd9ba3f42 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:43.927776 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-25241901-22d6-4232-bd0c-f00fd9ba3f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:43.967147 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e27ef-1abb-4b24-b0fb-4864ae683d7c None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:44.001111 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 357/693] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 13:12:44.001948 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25241901-22d6-4232-bd0c-f00fd9ba3f42 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:44.016730 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59359635-81b6-48d6-a3c6-05f54332c940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:44.017452 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59359635-81b6-48d6-a3c6-05f54332c940 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:44.017733 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59359635-81b6-48d6-a3c6-05f54332c940 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:44.018010 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59359635-81b6-48d6-a3c6-05f54332c940 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:44.066196 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:44.067460 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:44.099939 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59359635-81b6-48d6-a3c6-05f54332c940 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:44.101410 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59359635-81b6-48d6-a3c6-05f54332c940 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:44.118687 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25241901-22d6-4232-bd0c-f00fd9ba3f42 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:44.158755 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52f588-7a42-47d9-b7bd-9eda3c335980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:44.159732 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52f588-7a42-47d9-b7bd-9eda3c335980 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:44.160248 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52f588-7a42-47d9-b7bd-9eda3c335980 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:44.160719 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52f588-7a42-47d9-b7bd-9eda3c335980 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:44.161567 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52f588-7a42-47d9-b7bd-9eda3c335980 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:44.162120 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52f588-7a42-47d9-b7bd-9eda3c335980 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:44.163679 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52f588-7a42-47d9-b7bd-9eda3c335980 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:44.169492 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 358/694] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Oct 25 13:12:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:44.175150 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52f588-7a42-47d9-b7bd-9eda3c335980 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:44.220668 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 337/695] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 25 13:12:43 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 25 13:12:44.225910 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59359635-81b6-48d6-a3c6-05f54332c940 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:44.296642 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52f588-7a42-47d9-b7bd-9eda3c335980 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:44.301623 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:44.317745 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:44.336087 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59359635-81b6-48d6-a3c6-05f54332c940 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:44.338369 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b9d54-5040-464b-bf41-6cec11e908da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:44.338975 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b9d54-5040-464b-bf41-6cec11e908da None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:44.339251 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b9d54-5040-464b-bf41-6cec11e908da None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:44.339521 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b9d54-5040-464b-bf41-6cec11e908da None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:44.340168 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b9d54-5040-464b-bf41-6cec11e908da None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:44.340467 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b9d54-5040-464b-bf41-6cec11e908da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:44.341828 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b9d54-5040-464b-bf41-6cec11e908da None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:44.352366 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 359/696] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Oct 25 13:12:44 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:12:44.352366 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b9d54-5040-464b-bf41-6cec11e908da None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:44.377756 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad46b0-84de-4b16-8790-6be2ff79686e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:44.378544 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad46b0-84de-4b16-8790-6be2ff79686e None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:44.378818 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad46b0-84de-4b16-8790-6be2ff79686e None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:44.379087 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad46b0-84de-4b16-8790-6be2ff79686e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:44.390210 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad46b0-84de-4b16-8790-6be2ff79686e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:44.392334 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad46b0-84de-4b16-8790-6be2ff79686e None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:44.408629 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-d6ad46b0-84de-4b16-8790-6be2ff79686e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:44.408629 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:44.408629 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:44.408629 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:44.408629 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:44.408629 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:44.408629 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:44.408629 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:44.408629 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:44.408629 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:44.408629 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:44.408629 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:44.408629 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:12:44.408629 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:12:44.408629 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:12:44.408629 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:12:44.409598 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:44.409598 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:44.409598 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:44.409598 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:44.409598 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:44.409598 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:44.409598 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:44.409598 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:44.409598 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:44.409598 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:44.409598 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:44.409598 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:44.409598 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:44.409598 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:44.409598 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:44.409598 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:44.409598 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:12:44.411221 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:12:44.411221 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:12:44.411221 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:44.411221 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 338/697] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:44.415057 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad46b0-84de-4b16-8790-6be2ff79686e None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:44.458923 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b9d54-5040-464b-bf41-6cec11e908da None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:44.493541 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4039a4-a5ad-4558-92b3-669668338f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:44.494169 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4039a4-a5ad-4558-92b3-669668338f2f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:44.494448 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4039a4-a5ad-4558-92b3-669668338f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:44.494717 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4039a4-a5ad-4558-92b3-669668338f2f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:44.495292 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4039a4-a5ad-4558-92b3-669668338f2f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:44.497130 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4039a4-a5ad-4558-92b3-669668338f2f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:44.507391 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-ed4039a4-a5ad-4558-92b3-669668338f2f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 25 13:12:44.507391 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:44.507391 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 13:12:44.507391 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 13:12:44.507391 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 13:12:44.507391 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 13:12:44.507391 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 13:12:44.507391 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:44.507391 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 25 13:12:44.507391 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:44.507391 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 13:12:44.507391 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:44.507391 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:44.507391 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:44.507391 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:44.507391 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:44.507391 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:44.508421 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:44.508421 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:44.508421 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:44.508421 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:44.508421 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:44.508421 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:44.508421 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 13:12:44.508421 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 13:12:44.508421 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 13:12:44.508421 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 13:12:44.508421 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:44.508421 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:44.508421 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:44.508421 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:44.508421 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:44.508421 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:44.509274 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:44.509274 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:44.509274 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:44.509274 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:44.509274 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:44.509274 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:44.509274 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:44.509274 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:44.509274 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:44.509274 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:44.509274 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 13:12:44.509274 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:44.509274 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 25 13:12:44.509274 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:44.509274 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 360/698] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 25 13:12:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:44.510079 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4039a4-a5ad-4558-92b3-669668338f2f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:44.527347 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad46b0-84de-4b16-8790-6be2ff79686e None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:44.529057 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:44.558879 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:44.566645 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e868f1f8-eebc-4672-a69e-075e8d69f8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:44.567460 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868f1f8-eebc-4672-a69e-075e8d69f8be None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:44.567736 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868f1f8-eebc-4672-a69e-075e8d69f8be None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:44.568034 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868f1f8-eebc-4672-a69e-075e8d69f8be None admin] PATH_INFO: `/v3/endpoints` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:44.568686 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e868f1f8-eebc-4672-a69e-075e8d69f8be None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:44.570042 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e868f1f8-eebc-4672-a69e-075e8d69f8be None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:44.589466 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 339/699] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:12:44 2022] POST /identity/v3/endpoints => generated 347 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:12:44.600099 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e868f1f8-eebc-4672-a69e-075e8d69f8be None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:44.638305 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4039a4-a5ad-4558-92b3-669668338f2f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:44.695722 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85afef-0055-44c8-a494-4e38f52f10f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:44.696537 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85afef-0055-44c8-a494-4e38f52f10f8 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:44.696811 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85afef-0055-44c8-a494-4e38f52f10f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:44.697089 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85afef-0055-44c8-a494-4e38f52f10f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:44.697789 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df85afef-0055-44c8-a494-4e38f52f10f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:44.698202 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df85afef-0055-44c8-a494-4e38f52f10f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:44.699667 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df85afef-0055-44c8-a494-4e38f52f10f8 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:44.728505 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 361/700] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:44.731164 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85afef-0055-44c8-a494-4e38f52f10f8 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:44.743883 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e868f1f8-eebc-4672-a69e-075e8d69f8be None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:44.784679 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb337ca-7ed9-4054-85a1-cbdedfc22eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:44.785298 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb337ca-7ed9-4054-85a1-cbdedfc22eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:44.785575 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb337ca-7ed9-4054-85a1-cbdedfc22eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:44.785846 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb337ca-7ed9-4054-85a1-cbdedfc22eb4 None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:44.786486 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb337ca-7ed9-4054-85a1-cbdedfc22eb4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:44.786786 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb337ca-7ed9-4054-85a1-cbdedfc22eb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:44.788189 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb337ca-7ed9-4054-85a1-cbdedfc22eb4 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:44.794233 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 340/701] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 25 13:12:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:44.800883 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb337ca-7ed9-4054-85a1-cbdedfc22eb4 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:44.830335 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:44.871447 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:44.876180 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85afef-0055-44c8-a494-4e38f52f10f8 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:44.916052 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df18a718-111b-44d4-b8ed-bdf0197478bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:44.916709 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18a718-111b-44d4-b8ed-bdf0197478bf None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:44.916970 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18a718-111b-44d4-b8ed-bdf0197478bf None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:44.917266 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18a718-111b-44d4-b8ed-bdf0197478bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:44.925056 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df18a718-111b-44d4-b8ed-bdf0197478bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:44.926620 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df18a718-111b-44d4-b8ed-bdf0197478bf None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:44.931582 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb337ca-7ed9-4054-85a1-cbdedfc22eb4 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:44.938586 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-df18a718-111b-44d4-b8ed-bdf0197478bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:12:44.938586 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:44.938586 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:44.938586 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:44.938586 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:44.938586 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:44.938586 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:44.938586 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:44.938586 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:44.938586 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:44.938586 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:44.938586 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:44.938586 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 25 13:12:44.938586 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 25 13:12:44.938586 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 25 13:12:44.939493 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 25 13:12:44.939493 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:44.939493 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:44.939493 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:44.939493 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:44.939493 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:44.939493 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:44.939493 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:44.939493 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:44.939493 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:44.939493 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:44.939493 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:44.939493 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:44.939493 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:44.939493 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:44.939493 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:44.939493 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:44.940406 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 25 13:12:44.940406 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 25 13:12:44.940406 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 25 13:12:44.940406 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 25 13:12:44.940406 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 25 13:12:44.940406 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 25 13:12:44.940406 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:12:44.940406 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:44.940406 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 362/702] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 25 13:12:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:44.948240 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df18a718-111b-44d4-b8ed-bdf0197478bf None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:44.972788 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b43650-dbfe-4f48-953c-fb2300823f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:44.973401 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b43650-dbfe-4f48-953c-fb2300823f1b None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:44.973678 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b43650-dbfe-4f48-953c-fb2300823f1b None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:44.973949 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b43650-dbfe-4f48-953c-fb2300823f1b None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:44.974585 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b43650-dbfe-4f48-953c-fb2300823f1b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:44.974886 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b43650-dbfe-4f48-953c-fb2300823f1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:44.976542 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b43650-dbfe-4f48-953c-fb2300823f1b None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:44.981799 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 341/703] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 25 13:12:44 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:12:44.988200 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b43650-dbfe-4f48-953c-fb2300823f1b None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:45.067026 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df18a718-111b-44d4-b8ed-bdf0197478bf None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:45.080906 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:45.097534 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b43650-dbfe-4f48-953c-fb2300823f1b None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:45.104468 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceabcb4-d1e8-495d-84d4-4a2a35240cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:45.105253 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceabcb4-d1e8-495d-84d4-4a2a35240cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:45.105744 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceabcb4-d1e8-495d-84d4-4a2a35240cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:45.106160 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceabcb4-d1e8-495d-84d4-4a2a35240cb7 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:45.106998 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceabcb4-d1e8-495d-84d4-4a2a35240cb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:45.107452 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceabcb4-d1e8-495d-84d4-4a2a35240cb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:45.109629 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceabcb4-d1e8-495d-84d4-4a2a35240cb7 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:45.128501 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 363/704] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 25 13:12:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:45.129805 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceabcb4-d1e8-495d-84d4-4a2a35240cb7 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:45.139062 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feddb262-5133-498a-b57a-202482c09060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:45.140256 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feddb262-5133-498a-b57a-202482c09060 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:45.140579 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feddb262-5133-498a-b57a-202482c09060 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:45.140855 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feddb262-5133-498a-b57a-202482c09060 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:45.142206 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feddb262-5133-498a-b57a-202482c09060 None admin] RBAC: Adding query filter params (interface=public, service_id=ecdb748f1f464246a23aa5efcac74752, region_id=RegionOne) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:45.142206 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feddb262-5133-498a-b57a-202482c09060 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:45.143478 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feddb262-5133-498a-b57a-202482c09060 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:45.151018 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 342/705] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Oct 25 13:12:44 2022] GET /identity/v3/endpoints?service_id=ecdb748f1f464246a23aa5efcac74752&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:12:45.158024 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feddb262-5133-498a-b57a-202482c09060 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:45.163665 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:45.250174 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceabcb4-d1e8-495d-84d4-4a2a35240cb7 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:45.286552 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feddb262-5133-498a-b57a-202482c09060 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:45.286867 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39efeb6f-ce89-4dba-a114-2704c85ef64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:45.287426 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39efeb6f-ce89-4dba-a114-2704c85ef64d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:45.287714 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39efeb6f-ce89-4dba-a114-2704c85ef64d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:45.288033 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39efeb6f-ce89-4dba-a114-2704c85ef64d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:45.288738 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39efeb6f-ce89-4dba-a114-2704c85ef64d None admin] RBAC: Adding query filter params (role.id=3e0f611d78184eac9855bafdbdd78a7c, scope.project.id=616ecfe8d2c74aad9386720718392e81, user.id=9d5d4691dca848d58bd280d2fad79fbe) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:45.289043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39efeb6f-ce89-4dba-a114-2704c85ef64d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:45.290472 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39efeb6f-ce89-4dba-a114-2704c85ef64d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:45.301671 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 364/706] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 25 13:12:45 2022] GET /identity/v3/role_assignments?user.id=9d5d4691dca848d58bd280d2fad79fbe&scope.project.id=616ecfe8d2c74aad9386720718392e81&role.id=3e0f611d78184eac9855bafdbdd78a7c => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:45.301671 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf0561-38c8-4151-86fa-f6d4c33426b3 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:45.301671 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf0561-38c8-4151-86fa-f6d4c33426b3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:45.301671 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf0561-38c8-4151-86fa-f6d4c33426b3 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:45.304387 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 365/707] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:45.306645 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509aeb4-0755-4ca6-bba3-816f39f855de None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:45.306645 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509aeb4-0755-4ca6-bba3-816f39f855de None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:45.306645 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509aeb4-0755-4ca6-bba3-816f39f855de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:45.328265 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a509aeb4-0755-4ca6-bba3-816f39f855de None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:45.329471 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a509aeb4-0755-4ca6-bba3-816f39f855de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:45.337170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368d108-d523-4b12-9dfb-70364c05f592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:45.337948 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368d108-d523-4b12-9dfb-70364c05f592 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:45.338420 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368d108-d523-4b12-9dfb-70364c05f592 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:45.338772 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368d108-d523-4b12-9dfb-70364c05f592 None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:45.339467 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368d108-d523-4b12-9dfb-70364c05f592 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:45.341013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368d108-d523-4b12-9dfb-70364c05f592 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:45.348827 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 343/708] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Oct 25 13:12:45 2022] GET /identity/v3/services => generated 1497 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:12:45.409670 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 366/709] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 25 13:12:45.686171 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368d108-d523-4b12-9dfb-70364c05f592 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:45.704028 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:45.796878 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368d108-d523-4b12-9dfb-70364c05f592 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:45.832396 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72482619-6dd1-44cf-8648-2c250ca3c5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:45.833023 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72482619-6dd1-44cf-8648-2c250ca3c5c0 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:45.833297 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72482619-6dd1-44cf-8648-2c250ca3c5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:45.833570 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72482619-6dd1-44cf-8648-2c250ca3c5c0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:45.834146 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72482619-6dd1-44cf-8648-2c250ca3c5c0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:45.835492 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72482619-6dd1-44cf-8648-2c250ca3c5c0 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:45.845013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-72482619-6dd1-44cf-8648-2c250ca3c5c0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 25 13:12:45.845013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:45.845013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 13:12:45.845013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 13:12:45.845013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 13:12:45.845013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 13:12:45.845013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 13:12:45.845013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:45.845013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 25 13:12:45.845013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:45.845013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 13:12:45.845013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:45.845013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:45.845013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:45.845013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:45.845013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:45.845013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:45.846042 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:45.846042 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:45.846042 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:45.846042 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:45.846042 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:45.846042 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:45.846042 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 13:12:45.846042 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 13:12:45.846042 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 13:12:45.846042 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 13:12:45.846042 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:45.846042 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:45.846042 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:45.846042 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:45.846042 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:45.846042 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:45.846892 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:45.846892 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:45.846892 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:45.846892 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:45.846892 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:45.846892 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:45.846892 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:45.846892 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:45.846892 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:45.846892 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:45.846892 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 13:12:45.846892 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:45.846892 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 25 13:12:45.846892 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:45.846892 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 344/710] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Oct 25 13:12:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:45.852357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509aeb4-0755-4ca6-bba3-816f39f855de None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:45.869980 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:45.959850 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509aeb4-0755-4ca6-bba3-816f39f855de None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:45.999928 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35877b47-8e0b-4e10-ae41-cc758ee15325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:46.000545 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35877b47-8e0b-4e10-ae41-cc758ee15325 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:46.000824 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35877b47-8e0b-4e10-ae41-cc758ee15325 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:46.001092 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35877b47-8e0b-4e10-ae41-cc758ee15325 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:46.001722 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35877b47-8e0b-4e10-ae41-cc758ee15325 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:46.002022 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35877b47-8e0b-4e10-ae41-cc758ee15325 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:46.003376 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35877b47-8e0b-4e10-ae41-cc758ee15325 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:46.008781 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 367/711] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Oct 25 13:12:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:46.014234 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72482619-6dd1-44cf-8648-2c250ca3c5c0 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:46.102809 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:46.127889 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72482619-6dd1-44cf-8648-2c250ca3c5c0 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:46.164217 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50130628-6683-422d-b814-04c753d74f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:46.164828 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50130628-6683-422d-b814-04c753d74f2a None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:46.165102 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50130628-6683-422d-b814-04c753d74f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:46.165372 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50130628-6683-422d-b814-04c753d74f2a None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:46.165990 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50130628-6683-422d-b814-04c753d74f2a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:46.166291 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50130628-6683-422d-b814-04c753d74f2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:46.167641 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50130628-6683-422d-b814-04c753d74f2a None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:46.173551 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 345/712] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Oct 25 13:12:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:46.178942 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35877b47-8e0b-4e10-ae41-cc758ee15325 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:46.264260 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:46.289082 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35877b47-8e0b-4e10-ae41-cc758ee15325 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:46.326636 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686d11a-a2d6-488e-b8bb-b2093052c9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:46.327325 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686d11a-a2d6-488e-b8bb-b2093052c9fe None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:46.327635 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686d11a-a2d6-488e-b8bb-b2093052c9fe None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:46.327883 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686d11a-a2d6-488e-b8bb-b2093052c9fe None admin] PATH_INFO: `/v3/endpoints` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:46.328645 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e686d11a-a2d6-488e-b8bb-b2093052c9fe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:46.330039 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e686d11a-a2d6-488e-b8bb-b2093052c9fe None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:46.354137 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 368/713] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:12:46 2022] POST /identity/v3/endpoints => generated 349 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:12:46.924530 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad98918-1bcd-4dd1-a005-f4bd98906935 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:46.924901 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad98918-1bcd-4dd1-a005-f4bd98906935 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:46.925081 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad98918-1bcd-4dd1-a005-f4bd98906935 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:46.926704 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 346/714] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:46.931909 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333024a5-cdd9-414c-84ad-c3bac7353a87 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:46.932760 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333024a5-cdd9-414c-84ad-c3bac7353a87 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:46.933257 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333024a5-cdd9-414c-84ad-c3bac7353a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:46.955447 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-333024a5-cdd9-414c-84ad-c3bac7353a87 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:46.956991 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-333024a5-cdd9-414c-84ad-c3bac7353a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:47.032091 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 369/715] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 13:12:47.301182 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad98918-1bcd-4dd1-a005-f4bd98906935 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:47.410024 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad98918-1bcd-4dd1-a005-f4bd98906935 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:47.444571 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d6dde-e2dd-4ae5-92bc-db7a45059342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:47.445188 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d6dde-e2dd-4ae5-92bc-db7a45059342 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:47.445461 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d6dde-e2dd-4ae5-92bc-db7a45059342 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:47.445729 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d6dde-e2dd-4ae5-92bc-db7a45059342 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:47.446302 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d6dde-e2dd-4ae5-92bc-db7a45059342 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:47.447651 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d6dde-e2dd-4ae5-92bc-db7a45059342 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:47.457448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-130d6dde-e2dd-4ae5-92bc-db7a45059342 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 25 13:12:47.457448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:47.457448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 13:12:47.457448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 13:12:47.457448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 13:12:47.457448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 13:12:47.457448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 13:12:47.457448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:47.457448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 25 13:12:47.457448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:47.457448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 13:12:47.457448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:47.457448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:47.457448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:47.457448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:47.457448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:47.457448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:47.458432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:47.458432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:47.458432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:47.458432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:47.458432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:47.458432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:47.458432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 13:12:47.458432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 13:12:47.458432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 13:12:47.458432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 13:12:47.458432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:47.458432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:47.458432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:47.458432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:47.458432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:47.458432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:47.459274 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:47.459274 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:47.459274 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:47.459274 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:47.459274 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:47.459274 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:47.459274 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:47.459274 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:47.459274 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:47.459274 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:47.459274 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 13:12:47.459274 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:47.459274 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 25 13:12:47.459274 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:47.459274 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 347/716] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 25 13:12:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:47.464575 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333024a5-cdd9-414c-84ad-c3bac7353a87 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:47.531825 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:47.578648 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333024a5-cdd9-414c-84ad-c3bac7353a87 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:47.619412 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75e886-c8a0-43d2-be23-29c56b002ff0 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:47.619734 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75e886-c8a0-43d2-be23-29c56b002ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:47.619990 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75e886-c8a0-43d2-be23-29c56b002ff0 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:47.620799 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e0280-b43e-4597-922e-be8018307358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:47.621416 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e0280-b43e-4597-922e-be8018307358 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:47.621531 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 348/717] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:47.621802 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e0280-b43e-4597-922e-be8018307358 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:47.622078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e0280-b43e-4597-922e-be8018307358 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:47.622774 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e0280-b43e-4597-922e-be8018307358 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:47.623083 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e0280-b43e-4597-922e-be8018307358 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:47.624642 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e0280-b43e-4597-922e-be8018307358 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:47.631919 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c065b1-8fd3-4e38-b201-5a9f99a80e1b None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:47.631919 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c065b1-8fd3-4e38-b201-5a9f99a80e1b None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:47.631919 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c065b1-8fd3-4e38-b201-5a9f99a80e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:47.632252 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 370/718] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Oct 25 13:12:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:47.636140 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e0280-b43e-4597-922e-be8018307358 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:47.644891 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:47.651164 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-34c065b1-8fd3-4e38-b201-5a9f99a80e1b None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:47.652648 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-34c065b1-8fd3-4e38-b201-5a9f99a80e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:47.732193 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 349/719] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 25 13:12:47.733362 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f81119-0085-49b7-abca-0443089a0321 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:47.733878 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f81119-0085-49b7-abca-0443089a0321 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:47.734167 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f81119-0085-49b7-abca-0443089a0321 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:47.735421 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 350/720] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:47.740647 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd08d84-ca39-44d5-824d-42db89f4463f None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:47.740929 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd08d84-ca39-44d5-824d-42db89f4463f None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:47.741200 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd08d84-ca39-44d5-824d-42db89f4463f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:47.746117 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e0280-b43e-4597-922e-be8018307358 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:47.764045 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-6cd08d84-ca39-44d5-824d-42db89f4463f None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:47.765898 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-6cd08d84-ca39-44d5-824d-42db89f4463f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:47.777729 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:47.789936 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c356bd9-5bbd-4fe3-9ca6-2a6824311ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:47.790744 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c356bd9-5bbd-4fe3-9ca6-2a6824311ae2 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:47.791130 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c356bd9-5bbd-4fe3-9ca6-2a6824311ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:47.791513 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c356bd9-5bbd-4fe3-9ca6-2a6824311ae2 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:47.792262 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c356bd9-5bbd-4fe3-9ca6-2a6824311ae2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:47.792661 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c356bd9-5bbd-4fe3-9ca6-2a6824311ae2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:47.794348 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c356bd9-5bbd-4fe3-9ca6-2a6824311ae2 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:47.805511 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 371/721] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Oct 25 13:12:47 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:12:47.850699 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 351/722] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 25 13:12:48.033760 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c356bd9-5bbd-4fe3-9ca6-2a6824311ae2 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:48.141457 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd08d84-ca39-44d5-824d-42db89f4463f None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:48.142228 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c356bd9-5bbd-4fe3-9ca6-2a6824311ae2 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:48.187717 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a68c55-a84a-4fe7-8ad9-088a7b8a038f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:48.188405 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a68c55-a84a-4fe7-8ad9-088a7b8a038f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:48.188686 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a68c55-a84a-4fe7-8ad9-088a7b8a038f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:48.188962 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a68c55-a84a-4fe7-8ad9-088a7b8a038f None admin] PATH_INFO: `/v3/services/image` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:48.189603 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a68c55-a84a-4fe7-8ad9-088a7b8a038f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:48.191083 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a68c55-a84a-4fe7-8ad9-088a7b8a038f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:48.201960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-81a68c55-a84a-4fe7-8ad9-088a7b8a038f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 25 13:12:48.201960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:48.201960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 13:12:48.201960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 13:12:48.201960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 13:12:48.201960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 13:12:48.201960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 13:12:48.201960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:48.201960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 25 13:12:48.201960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:48.201960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 13:12:48.201960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:48.201960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:48.201960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:48.201960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:48.201960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:48.201960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:48.203540 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:48.203540 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:48.203540 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:48.203540 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:48.203540 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:48.203540 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:48.203540 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 13:12:48.203540 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 13:12:48.203540 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 13:12:48.203540 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 13:12:48.203540 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:48.203540 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:48.203540 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:48.203540 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:48.203540 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:48.203540 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:48.204434 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:48.204434 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:48.204434 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:48.204434 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:48.204434 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:48.204434 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:48.204434 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:48.204434 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:48.204434 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:48.204434 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:48.204434 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 13:12:48.204434 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:48.204434 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 25 13:12:48.204434 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:48.204434 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 372/723] 10.222.0.25 () {56 vars in 1105 bytes} [Tue Oct 25 13:12:48 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:48.210688 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a68c55-a84a-4fe7-8ad9-088a7b8a038f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:48.220132 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:48.259179 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd08d84-ca39-44d5-824d-42db89f4463f None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:48.297451 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c98bb-d5dc-4e07-b434-b00bf5db795a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:48.298453 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c98bb-d5dc-4e07-b434-b00bf5db795a None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:48.298953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c98bb-d5dc-4e07-b434-b00bf5db795a None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:48.299438 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c98bb-d5dc-4e07-b434-b00bf5db795a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:48.300265 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c98bb-d5dc-4e07-b434-b00bf5db795a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:48.301874 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c98bb-d5dc-4e07-b434-b00bf5db795a None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:48.311932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-665c98bb-d5dc-4e07-b434-b00bf5db795a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 25 13:12:48.311932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:48.311932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 13:12:48.311932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 13:12:48.311932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 13:12:48.311932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 13:12:48.311932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 13:12:48.311932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:48.311932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 25 13:12:48.311932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:48.311932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 13:12:48.311932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:48.311932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:48.311932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:48.311932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:48.311932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:48.311932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:48.312987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:48.312987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:48.312987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:48.312987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:48.312987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:48.312987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:48.312987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 13:12:48.312987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 13:12:48.312987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 13:12:48.312987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 13:12:48.312987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:48.312987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:48.312987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:48.312987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:48.312987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:48.312987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:48.313832 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:48.313832 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:48.313832 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:48.313832 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:48.313832 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:48.313832 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:48.313832 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:48.313832 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:48.313832 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:48.313832 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:48.313832 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 13:12:48.313832 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:48.313832 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 25 13:12:48.313832 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:48.316670 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 352/724] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 25 13:12:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 13:12:48.317779 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:48.323145 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c98bb-d5dc-4e07-b434-b00bf5db795a None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:48.345176 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a68c55-a84a-4fe7-8ad9-088a7b8a038f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:48.382371 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a8508-d01f-4717-848f-c5f65ab5558b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:48.382983 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a8508-d01f-4717-848f-c5f65ab5558b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:48.383257 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a8508-d01f-4717-848f-c5f65ab5558b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:48.383533 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a8508-d01f-4717-848f-c5f65ab5558b None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:48.384309 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a8508-d01f-4717-848f-c5f65ab5558b None admin] RBAC: Adding query filter params (name=image) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:48.384619 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a8508-d01f-4717-848f-c5f65ab5558b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:48.386093 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a8508-d01f-4717-848f-c5f65ab5558b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:48.391757 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 373/725] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:48.397273 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a8508-d01f-4717-848f-c5f65ab5558b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:48.443624 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c98bb-d5dc-4e07-b434-b00bf5db795a None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:48.476298 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:48.483326 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed831e2e-76ff-45d7-9769-b49ae3a44eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:48.485569 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed831e2e-76ff-45d7-9769-b49ae3a44eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:48.486039 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed831e2e-76ff-45d7-9769-b49ae3a44eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:48.486492 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed831e2e-76ff-45d7-9769-b49ae3a44eb3 None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:48.487322 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed831e2e-76ff-45d7-9769-b49ae3a44eb3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:48.487911 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed831e2e-76ff-45d7-9769-b49ae3a44eb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:48.489514 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed831e2e-76ff-45d7-9769-b49ae3a44eb3 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:48.495373 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 353/726] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 25 13:12:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:48.505266 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed831e2e-76ff-45d7-9769-b49ae3a44eb3 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:48.518388 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a8508-d01f-4717-848f-c5f65ab5558b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:48.540911 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:48.572915 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579acde-4c0e-4140-828d-b3ca2c8fa201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:48.574189 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579acde-4c0e-4140-828d-b3ca2c8fa201 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:48.574887 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579acde-4c0e-4140-828d-b3ca2c8fa201 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:48.575311 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579acde-4c0e-4140-828d-b3ca2c8fa201 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:48.576139 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579acde-4c0e-4140-828d-b3ca2c8fa201 None admin] RBAC: Adding query filter params (type=image) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:48.576896 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579acde-4c0e-4140-828d-b3ca2c8fa201 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:48.579297 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579acde-4c0e-4140-828d-b3ca2c8fa201 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:48.591966 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 374/727] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:48 2022] GET /identity/v3/services?type=image => generated 122 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:48.647651 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed831e2e-76ff-45d7-9769-b49ae3a44eb3 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:48.654250 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba011ba-538b-4a62-bb39-7064b02954bc None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:48.654530 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba011ba-538b-4a62-bb39-7064b02954bc None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:48.654859 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba011ba-538b-4a62-bb39-7064b02954bc None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:48.657353 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 375/728] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 13:12:48.664491 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734b891-6c85-4a2c-82eb-497479e37337 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:48.664808 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734b891-6c85-4a2c-82eb-497479e37337 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:48.665057 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734b891-6c85-4a2c-82eb-497479e37337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:48.685847 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-2734b891-6c85-4a2c-82eb-497479e37337 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:48.687465 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2734b891-6c85-4a2c-82eb-497479e37337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:48.696141 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced0837-6559-4dc1-a12a-6f9f45e887ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:48.697954 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced0837-6559-4dc1-a12a-6f9f45e887ad None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:48.698458 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced0837-6559-4dc1-a12a-6f9f45e887ad None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:48.698910 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced0837-6559-4dc1-a12a-6f9f45e887ad None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:48.700509 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced0837-6559-4dc1-a12a-6f9f45e887ad None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:48.701033 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced0837-6559-4dc1-a12a-6f9f45e887ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:48.704349 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced0837-6559-4dc1-a12a-6f9f45e887ad None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:48.712422 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 354/729] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 25 13:12:48 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:48.719088 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced0837-6559-4dc1-a12a-6f9f45e887ad None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:48.784309 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 376/730] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 25 13:12:48.799251 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:48.844881 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced0837-6559-4dc1-a12a-6f9f45e887ad None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:48.880857 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9cdd0-2fb4-4d80-853a-dcc55c314c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:48.881455 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9cdd0-2fb4-4d80-853a-dcc55c314c1e None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:48.881727 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9cdd0-2fb4-4d80-853a-dcc55c314c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:48.881997 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9cdd0-2fb4-4d80-853a-dcc55c314c1e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:48.882714 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9cdd0-2fb4-4d80-853a-dcc55c314c1e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:48.884091 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9cdd0-2fb4-4d80-853a-dcc55c314c1e None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:48.906311 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 355/731] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:12:48 2022] POST /identity/v3/endpoints => generated 346 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:12:49.062229 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734b891-6c85-4a2c-82eb-497479e37337 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:49.169714 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734b891-6c85-4a2c-82eb-497479e37337 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:49.181644 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:49.212115 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b7edb-081d-4906-bf9f-eca78dd74a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:49.212754 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b7edb-081d-4906-bf9f-eca78dd74a0a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:49.213038 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b7edb-081d-4906-bf9f-eca78dd74a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:49.213315 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b7edb-081d-4906-bf9f-eca78dd74a0a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:49.213891 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b7edb-081d-4906-bf9f-eca78dd74a0a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:49.215245 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b7edb-081d-4906-bf9f-eca78dd74a0a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:49.224978 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-676b7edb-081d-4906-bf9f-eca78dd74a0a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 25 13:12:49.224978 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:49.224978 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 13:12:49.224978 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 13:12:49.224978 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 13:12:49.224978 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 13:12:49.224978 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 13:12:49.224978 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:49.224978 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 25 13:12:49.224978 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:49.224978 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 13:12:49.224978 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:49.224978 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:49.224978 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:49.224978 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:49.224978 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:49.224978 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:49.226015 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:49.226015 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:49.226015 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:49.226015 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:49.226015 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:49.226015 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:49.226015 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 13:12:49.226015 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 13:12:49.226015 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 13:12:49.226015 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 13:12:49.226015 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:49.226015 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:49.226015 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:49.226015 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:49.226015 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:49.226015 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:49.227242 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:49.227242 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:49.227242 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:49.227242 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:49.227242 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:49.227242 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:49.227242 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:49.227242 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:49.227242 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:49.227242 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:49.227242 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 13:12:49.227242 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:49.227242 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 25 13:12:49.227242 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:49.227242 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 377/732] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Oct 25 13:12:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:49.232293 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9cdd0-2fb4-4d80-853a-dcc55c314c1e None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:49.338070 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9cdd0-2fb4-4d80-853a-dcc55c314c1e None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:49.353390 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:49.375940 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b1f8a-1a87-4507-a14c-360f0b5397eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:49.377082 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b1f8a-1a87-4507-a14c-360f0b5397eb None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:49.377719 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b1f8a-1a87-4507-a14c-360f0b5397eb None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:49.377996 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b1f8a-1a87-4507-a14c-360f0b5397eb None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:49.378629 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b1f8a-1a87-4507-a14c-360f0b5397eb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:49.379377 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b1f8a-1a87-4507-a14c-360f0b5397eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:49.380791 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b1f8a-1a87-4507-a14c-360f0b5397eb None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:49.386078 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 356/733] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Oct 25 13:12:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:49.393276 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b7edb-081d-4906-bf9f-eca78dd74a0a None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:49.500636 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b7edb-081d-4906-bf9f-eca78dd74a0a None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:49.536066 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea1100-bcfc-4878-a670-ed0f7d3a1e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:49.536681 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea1100-bcfc-4878-a670-ed0f7d3a1e88 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:49.536960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea1100-bcfc-4878-a670-ed0f7d3a1e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:49.537234 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea1100-bcfc-4878-a670-ed0f7d3a1e88 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:49.537866 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea1100-bcfc-4878-a670-ed0f7d3a1e88 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:49.538169 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea1100-bcfc-4878-a670-ed0f7d3a1e88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:49.539534 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea1100-bcfc-4878-a670-ed0f7d3a1e88 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:49.545151 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 378/734] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Oct 25 13:12:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:49.551644 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b1f8a-1a87-4507-a14c-360f0b5397eb None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:49.658984 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b1f8a-1a87-4507-a14c-360f0b5397eb None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:49.693934 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a4a723-060d-4e4f-86dc-72b3dd67363b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:49.694534 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4a723-060d-4e4f-86dc-72b3dd67363b None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:49.694807 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4a723-060d-4e4f-86dc-72b3dd67363b None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:49.695074 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4a723-060d-4e4f-86dc-72b3dd67363b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:49.695765 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a4a723-060d-4e4f-86dc-72b3dd67363b None admin] RBAC: Adding query filter params (interface=admin, service_id=e3cadb2fba1a443dae789b59d4f34bcc, region_id=RegionOne) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:49.696093 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a4a723-060d-4e4f-86dc-72b3dd67363b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:49.697427 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a4a723-060d-4e4f-86dc-72b3dd67363b None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:49.703266 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 357/735] 10.222.0.25 () {56 vars in 1249 bytes} [Tue Oct 25 13:12:49 2022] GET /identity/v3/endpoints?service_id=e3cadb2fba1a443dae789b59d4f34bcc&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:49.708828 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea1100-bcfc-4878-a670-ed0f7d3a1e88 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:49.758092 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:49.832327 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea1100-bcfc-4878-a670-ed0f7d3a1e88 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:49.868169 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b009193-c699-4a92-94ec-744d174b0778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:49.868781 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b009193-c699-4a92-94ec-744d174b0778 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:49.869056 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b009193-c699-4a92-94ec-744d174b0778 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:49.869327 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b009193-c699-4a92-94ec-744d174b0778 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:49.869923 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b009193-c699-4a92-94ec-744d174b0778 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:49.871275 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b009193-c699-4a92-94ec-744d174b0778 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:49.878758 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 379/736] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Oct 25 13:12:49 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:12:50.010717 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca899a-c363-4440-8f8e-f905f64f362d None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:50.010895 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca899a-c363-4440-8f8e-f905f64f362d None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:50.011179 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca899a-c363-4440-8f8e-f905f64f362d None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:50.012944 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 358/737] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:50.021856 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a5acd-8319-4d7a-a3d1-2a3655e8547c None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:50.022224 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a5acd-8319-4d7a-a3d1-2a3655e8547c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:50.022509 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a5acd-8319-4d7a-a3d1-2a3655e8547c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:50.043406 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-183a5acd-8319-4d7a-a3d1-2a3655e8547c None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:50.044663 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-183a5acd-8319-4d7a-a3d1-2a3655e8547c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:50.118889 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 380/738] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 13:12:50.388882 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca899a-c363-4440-8f8e-f905f64f362d None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:50.435507 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:50.501798 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca899a-c363-4440-8f8e-f905f64f362d None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:50.536452 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbfb508-604a-4d3e-8683-974b2ef34e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:50.537048 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbfb508-604a-4d3e-8683-974b2ef34e6a None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:50.537323 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbfb508-604a-4d3e-8683-974b2ef34e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:50.537590 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbfb508-604a-4d3e-8683-974b2ef34e6a None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:50.538237 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbfb508-604a-4d3e-8683-974b2ef34e6a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:50.539577 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbfb508-604a-4d3e-8683-974b2ef34e6a None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:50.556860 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 359/739] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Oct 25 13:12:50 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:12:50.935937 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f27497-618f-4d9e-b145-e1d8e38e0fdb None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:50.937272 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f27497-618f-4d9e-b145-e1d8e38e0fdb None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:50.937761 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f27497-618f-4d9e-b145-e1d8e38e0fdb None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:50.939599 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 381/740] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:50.945178 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4656c9-f9b3-4f01-82a0-69108b43fe61 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:50.945726 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4656c9-f9b3-4f01-82a0-69108b43fe61 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:50.946220 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4656c9-f9b3-4f01-82a0-69108b43fe61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:50.965187 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-2d4656c9-f9b3-4f01-82a0-69108b43fe61 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:50.966691 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2d4656c9-f9b3-4f01-82a0-69108b43fe61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:51.048675 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 360/741] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:50 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 13:12:51.318081 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f27497-618f-4d9e-b145-e1d8e38e0fdb None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:51.334570 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef954f-8cfe-4bc1-8b1c-a180dc15e931 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:51.335187 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef954f-8cfe-4bc1-8b1c-a180dc15e931 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:51.335667 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef954f-8cfe-4bc1-8b1c-a180dc15e931 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:51.337459 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 361/742] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 13:12:51.342400 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845633e2-16ce-4702-9e90-2300ec337ef3 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:51.343457 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845633e2-16ce-4702-9e90-2300ec337ef3 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:51.344388 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845633e2-16ce-4702-9e90-2300ec337ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:51.350656 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:51.364903 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-845633e2-16ce-4702-9e90-2300ec337ef3 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:51.366392 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-845633e2-16ce-4702-9e90-2300ec337ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:51.396381 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:51.431444 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f27497-618f-4d9e-b145-e1d8e38e0fdb None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:51.451979 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 362/743] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:51 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 25 13:12:51.468455 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc004cf7-01fc-4417-ab3c-ba4003aeac51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:51.469067 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc004cf7-01fc-4417-ab3c-ba4003aeac51 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:51.469352 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc004cf7-01fc-4417-ab3c-ba4003aeac51 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:51.469630 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc004cf7-01fc-4417-ab3c-ba4003aeac51 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:51.470328 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc004cf7-01fc-4417-ab3c-ba4003aeac51 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:51.471910 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc004cf7-01fc-4417-ab3c-ba4003aeac51 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:51.491472 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 382/744] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Oct 25 13:12:51 2022] POST /identity/v3/services => generated 242 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:12:51.728823 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845633e2-16ce-4702-9e90-2300ec337ef3 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:51.833747 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845633e2-16ce-4702-9e90-2300ec337ef3 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:51.875797 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e7a885-db39-45d8-89f2-c8572e405399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:51.876778 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7a885-db39-45d8-89f2-c8572e405399 None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:51.877197 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7a885-db39-45d8-89f2-c8572e405399 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:51.877608 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7a885-db39-45d8-89f2-c8572e405399 None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:51.878375 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e7a885-db39-45d8-89f2-c8572e405399 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:51.879963 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e7a885-db39-45d8-89f2-c8572e405399 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:51.882698 dv-cinder-862432-2-smb devstack@keystone.service[81363]: WARNING keystone.server.flask.common [None req-76e7a885-db39-45d8-89f2-c8572e405399 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 25 13:12:51.902952 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.sql.core [None req-76e7a885-db39-45d8-89f2-c8572e405399 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 25 13:12:51.902952 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 25 13:12:51.902952 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [parameters: {'id': 'e05ac17e0452426a8b8a35c172307083', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 25 13:12:51.902952 dv-cinder-862432-2-smb devstack@keystone.service[81363]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81363) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 25 13:12:51.920543 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-76e7a885-db39-45d8-89f2-c8572e405399 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e05ac17e0452426a8b8a35c172307083.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e05ac17e0452426a8b8a35c172307083. Oct 25 13:12:51.920543 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:51.920543 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 25 13:12:51.920543 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 25 13:12:51.920543 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 25 13:12:51.920543 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 25 13:12:51.920543 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 25 13:12:51.920543 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application result = self._query(query) Oct 25 13:12:51.920543 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 25 13:12:51.920543 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application conn.query(q) Oct 25 13:12:51.920543 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 25 13:12:51.920543 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 25 13:12:51.920543 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 25 13:12:51.922136 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application result.read() Oct 25 13:12:51.922136 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 25 13:12:51.922136 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 25 13:12:51.922136 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 25 13:12:51.922136 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 25 13:12:51.922136 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 25 13:12:51.922136 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 25 13:12:51.922136 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 25 13:12:51.922136 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 25 13:12:51.922136 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 25 13:12:51.922136 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:51.922136 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 25 13:12:51.922136 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:51.922136 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:51.922136 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 25 13:12:51.922136 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 25 13:12:51.922136 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 25 13:12:51.922136 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 25 13:12:51.923408 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 25 13:12:51.923408 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application next(self.gen) Oct 25 13:12:51.923408 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 25 13:12:51.923408 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application yield resource Oct 25 13:12:51.923408 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 25 13:12:51.923408 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application next(self.gen) Oct 25 13:12:51.923408 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 25 13:12:51.923408 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self.session.rollback() Oct 25 13:12:51.923408 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 13:12:51.923408 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self.force_reraise() Oct 25 13:12:51.923408 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 13:12:51.923408 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise self.value Oct 25 13:12:51.923408 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 25 13:12:51.923408 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 25 13:12:51.923408 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 25 13:12:51.923408 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application session.commit() Oct 25 13:12:51.923408 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 25 13:12:51.924505 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 25 13:12:51.924505 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 25 13:12:51.924505 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._prepare_impl() Oct 25 13:12:51.924505 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 25 13:12:51.924505 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self.session.flush() Oct 25 13:12:51.924505 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 25 13:12:51.924505 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._flush(objects) Oct 25 13:12:51.924505 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 25 13:12:51.924505 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 25 13:12:51.924505 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 25 13:12:51.924505 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application compat.raise_( Oct 25 13:12:51.924505 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 25 13:12:51.924505 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception Oct 25 13:12:51.924505 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 25 13:12:51.924505 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application flush_context.execute() Oct 25 13:12:51.924505 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 25 13:12:51.924505 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rec.execute(self) Oct 25 13:12:51.925407 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 25 13:12:51.925407 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 25 13:12:51.925407 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 25 13:12:51.925407 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 25 13:12:51.925407 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 25 13:12:51.925407 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 25 13:12:51.925407 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 25 13:12:51.925407 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 25 13:12:51.925407 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 25 13:12:51.925407 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 25 13:12:51.925407 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 25 13:12:51.925407 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 25 13:12:51.925407 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 25 13:12:51.925407 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 25 13:12:51.925407 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 25 13:12:51.926234 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 25 13:12:51.926234 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 25 13:12:51.926234 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception Oct 25 13:12:51.926234 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 25 13:12:51.926234 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 25 13:12:51.926234 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 25 13:12:51.926234 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 25 13:12:51.926234 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 25 13:12:51.926234 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application result = self._query(query) Oct 25 13:12:51.926234 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 25 13:12:51.926234 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application conn.query(q) Oct 25 13:12:51.926234 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 25 13:12:51.926234 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 25 13:12:51.926234 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 25 13:12:51.926234 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application result.read() Oct 25 13:12:51.926234 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 25 13:12:51.926234 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 25 13:12:51.927303 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 25 13:12:51.927303 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 25 13:12:51.927303 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 25 13:12:51.927303 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 25 13:12:51.927303 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 25 13:12:51.927303 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 25 13:12:51.927303 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 25 13:12:51.927303 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 25 13:12:51.927303 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [parameters: {'id': 'e05ac17e0452426a8b8a35c172307083', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 25 13:12:51.927303 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 25 13:12:51.927303 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:51.927303 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 13:12:51.927303 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:51.927303 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:51.927303 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 25 13:12:51.928300 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 25 13:12:51.928300 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 25 13:12:51.928300 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 25 13:12:51.928300 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 25 13:12:51.928300 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:51.928300 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 13:12:51.928300 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:51.928300 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:51.928300 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:51.928300 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:51.928300 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:51.928300 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:51.928300 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:51.928300 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:51.928300 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:51.928300 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:51.928300 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:51.929213 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:51.929213 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 25 13:12:51.929213 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 25 13:12:51.929213 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:51.929213 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:51.929213 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 25 13:12:51.929213 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 25 13:12:51.929213 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e05ac17e0452426a8b8a35c172307083. Oct 25 13:12:51.929213 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:51.931082 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 363/745] 10.222.0.25 () {60 vars in 1140 bytes} [Tue Oct 25 13:12:51 2022] POST /identity/v3/projects => generated 262 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:51.937379 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc004cf7-01fc-4417-ab3c-ba4003aeac51 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:52.037528 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:52.054316 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc004cf7-01fc-4417-ab3c-ba4003aeac51 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:52.093219 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a4cc0-4002-4788-97dc-3d2387b4f779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:52.094139 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a4cc0-4002-4788-97dc-3d2387b4f779 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:52.094611 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a4cc0-4002-4788-97dc-3d2387b4f779 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:52.095029 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a4cc0-4002-4788-97dc-3d2387b4f779 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:52.102224 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a4cc0-4002-4788-97dc-3d2387b4f779 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:52.103870 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a4cc0-4002-4788-97dc-3d2387b4f779 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:52.110439 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c3d75-12a7-46e1-9fc1-498114b1a7b8 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:52.110728 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c3d75-12a7-46e1-9fc1-498114b1a7b8 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:52.111005 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c3d75-12a7-46e1-9fc1-498114b1a7b8 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:52.116926 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-448a4cc0-4002-4788-97dc-3d2387b4f779 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:12:52.116926 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:52.116926 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:52.116926 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:52.116926 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:52.116926 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:52.116926 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:52.116926 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:52.116926 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:52.116926 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:52.116926 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:52.116926 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:52.116926 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 25 13:12:52.116926 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 25 13:12:52.116926 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 25 13:12:52.117960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 25 13:12:52.117960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:52.117960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:52.117960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:52.117960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:52.117960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:52.117960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:52.117960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:52.117960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:52.117960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:52.117960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:52.117960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:52.117960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:52.117960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:52.117960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:52.117960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:52.117960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:52.119035 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 25 13:12:52.119035 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 25 13:12:52.119035 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 25 13:12:52.119035 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 25 13:12:52.119035 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 25 13:12:52.119035 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 25 13:12:52.119035 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:12:52.119035 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:52.119467 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 364/746] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:52 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:52.120490 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b7d60-44d9-4919-8949-bda09edd9796 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:52.120775 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b7d60-44d9-4919-8949-bda09edd9796 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:52.121048 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b7d60-44d9-4919-8949-bda09edd9796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:52.121398 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 383/747] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 25 13:12:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:52.127518 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a4cc0-4002-4788-97dc-3d2387b4f779 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:52.141060 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-d20b7d60-44d9-4919-8949-bda09edd9796 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:52.142563 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-d20b7d60-44d9-4919-8949-bda09edd9796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:52.145806 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:52.244103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a4cc0-4002-4788-97dc-3d2387b4f779 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:52.244327 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 365/748] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:52 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 13:12:52.278894 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921aa7e-5a5a-42af-9ebd-3285ba9001c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:52.279506 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921aa7e-5a5a-42af-9ebd-3285ba9001c7 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:52.279787 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921aa7e-5a5a-42af-9ebd-3285ba9001c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:52.280136 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921aa7e-5a5a-42af-9ebd-3285ba9001c7 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:52.281502 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921aa7e-5a5a-42af-9ebd-3285ba9001c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:52.281715 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921aa7e-5a5a-42af-9ebd-3285ba9001c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:52.283277 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921aa7e-5a5a-42af-9ebd-3285ba9001c7 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:52.303130 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 384/749] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Oct 25 13:12:52 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:52.535179 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b7d60-44d9-4919-8949-bda09edd9796 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:52.642674 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b7d60-44d9-4919-8949-bda09edd9796 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:52.678209 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb561cbe-d826-4b97-b424-33df92d72189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:52.678846 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb561cbe-d826-4b97-b424-33df92d72189 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:52.679123 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb561cbe-d826-4b97-b424-33df92d72189 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:52.679400 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb561cbe-d826-4b97-b424-33df92d72189 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:52.680010 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb561cbe-d826-4b97-b424-33df92d72189 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:52.681517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb561cbe-d826-4b97-b424-33df92d72189 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:52.691172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-cb561cbe-d826-4b97-b424-33df92d72189 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 25 13:12:52.691172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:52.691172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 13:12:52.691172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 13:12:52.691172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 13:12:52.691172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 13:12:52.691172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 13:12:52.691172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:52.691172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 25 13:12:52.691172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:52.691172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 13:12:52.691172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:52.691172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:52.691172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:52.691172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:52.691172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:52.691172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:52.692310 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:52.692310 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:52.692310 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:52.692310 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:52.692310 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:52.692310 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:52.692310 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 13:12:52.692310 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 13:12:52.692310 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 13:12:52.692310 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 13:12:52.692310 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:52.692310 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:52.692310 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:52.692310 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:52.692310 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:52.692310 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:52.693168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:52.693168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:52.693168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:52.693168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:52.693168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:52.693168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:52.693168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:52.693168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:52.693168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:52.693168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:52.693168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 13:12:52.693168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:52.693168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 25 13:12:52.693168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:52.693168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 366/750] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Oct 25 13:12:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:52.698631 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921aa7e-5a5a-42af-9ebd-3285ba9001c7 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:52.710167 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:52.805192 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921aa7e-5a5a-42af-9ebd-3285ba9001c7 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:52.841971 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b26839-c713-420f-b245-8f6326eecfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:52.842660 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b26839-c713-420f-b245-8f6326eecfa4 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:52.843536 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b26839-c713-420f-b245-8f6326eecfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:52.843747 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b26839-c713-420f-b245-8f6326eecfa4 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:52.844449 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b26839-c713-420f-b245-8f6326eecfa4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:52.844755 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b26839-c713-420f-b245-8f6326eecfa4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:52.846241 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b26839-c713-420f-b245-8f6326eecfa4 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:52.852509 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 385/751] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Oct 25 13:12:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:52.858605 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb561cbe-d826-4b97-b424-33df92d72189 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:52.862731 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:52.959604 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c157c6-c904-4075-942c-0e5a65503b05 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:52.960270 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c157c6-c904-4075-942c-0e5a65503b05 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:52.960755 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c157c6-c904-4075-942c-0e5a65503b05 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:52.962521 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 386/752] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 13:12:52.967646 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f94f67-4e9d-40da-8c15-79974372d7c4 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:52.968404 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f94f67-4e9d-40da-8c15-79974372d7c4 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:52.968905 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f94f67-4e9d-40da-8c15-79974372d7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:52.969092 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb561cbe-d826-4b97-b424-33df92d72189 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:52.994725 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-91f94f67-4e9d-40da-8c15-79974372d7c4 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:52.996960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-91f94f67-4e9d-40da-8c15-79974372d7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:53.004504 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40205468-8d52-46b8-b49a-2557e70ca0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:53.005110 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40205468-8d52-46b8-b49a-2557e70ca0bc None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:53.005388 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40205468-8d52-46b8-b49a-2557e70ca0bc None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:53.005659 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40205468-8d52-46b8-b49a-2557e70ca0bc None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:53.006285 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40205468-8d52-46b8-b49a-2557e70ca0bc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:53.006583 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40205468-8d52-46b8-b49a-2557e70ca0bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:53.007979 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40205468-8d52-46b8-b49a-2557e70ca0bc None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:53.015151 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 367/753] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Oct 25 13:12:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:53.021036 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40205468-8d52-46b8-b49a-2557e70ca0bc None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:53.087026 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 387/754] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:52 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 13:12:53.099498 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:53.137746 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40205468-8d52-46b8-b49a-2557e70ca0bc None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:53.174456 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b77ef-1796-47cc-a537-b968db056e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:53.175448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b77ef-1796-47cc-a537-b968db056e26 None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:53.175953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b77ef-1796-47cc-a537-b968db056e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:53.176425 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b77ef-1796-47cc-a537-b968db056e26 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:53.177314 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b77ef-1796-47cc-a537-b968db056e26 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:53.178904 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b77ef-1796-47cc-a537-b968db056e26 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:53.197018 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 368/755] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:12:53 2022] POST /identity/v3/endpoints => generated 325 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:12:53.377681 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f94f67-4e9d-40da-8c15-79974372d7c4 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:53.380295 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:53.486932 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f94f67-4e9d-40da-8c15-79974372d7c4 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:53.528000 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8503556-c5f1-4c3a-9bc8-2f45bf00658c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:53.528634 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8503556-c5f1-4c3a-9bc8-2f45bf00658c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:53.528914 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8503556-c5f1-4c3a-9bc8-2f45bf00658c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:53.529187 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8503556-c5f1-4c3a-9bc8-2f45bf00658c None admin] PATH_INFO: `/v3/services/compute` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:53.529758 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8503556-c5f1-4c3a-9bc8-2f45bf00658c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:53.531275 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8503556-c5f1-4c3a-9bc8-2f45bf00658c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:53.540043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-c8503556-c5f1-4c3a-9bc8-2f45bf00658c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 25 13:12:53.540043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:53.540043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 13:12:53.540043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 13:12:53.540043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 13:12:53.540043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 13:12:53.540043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 13:12:53.540043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:53.540043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 25 13:12:53.540043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:53.540043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 13:12:53.540043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:53.540043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:53.540043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:53.540043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:53.540043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:53.540043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:53.541032 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:53.541032 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:53.541032 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:53.541032 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:53.541032 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:53.541032 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:53.541032 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 13:12:53.541032 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 13:12:53.541032 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 13:12:53.541032 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 13:12:53.541032 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:53.541032 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:53.541032 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:53.541032 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:53.541032 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:53.541032 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:53.541872 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:53.541872 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:53.541872 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:53.541872 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:53.541872 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:53.541872 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:53.541872 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:53.541872 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:53.541872 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:53.541872 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:53.541872 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 13:12:53.541872 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:53.541872 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 25 13:12:53.541872 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:53.541872 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 388/756] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 25 13:12:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:53.550215 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b77ef-1796-47cc-a537-b968db056e26 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:53.665776 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b77ef-1796-47cc-a537-b968db056e26 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:53.694243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:53.704562 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad3673-ecaf-4c28-8022-fbcce2813a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:53.705189 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad3673-ecaf-4c28-8022-fbcce2813a1f None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:53.705912 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad3673-ecaf-4c28-8022-fbcce2813a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:53.706185 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad3673-ecaf-4c28-8022-fbcce2813a1f None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:53.706898 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad3673-ecaf-4c28-8022-fbcce2813a1f None admin] RBAC: Adding query filter params (name=compute) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:53.707200 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad3673-ecaf-4c28-8022-fbcce2813a1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:53.707718 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74058609-10b3-4a31-b5b2-25f39462a51a None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:53.708533 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74058609-10b3-4a31-b5b2-25f39462a51a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:53.708903 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad3673-ecaf-4c28-8022-fbcce2813a1f None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:53.709118 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74058609-10b3-4a31-b5b2-25f39462a51a None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:53.712141 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 389/757] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:53.714566 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 369/758] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Oct 25 13:12:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:53.717195 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5d650-481a-4de1-baf6-d01ffb809358 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:53.718240 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5d650-481a-4de1-baf6-d01ffb809358 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:53.718719 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5d650-481a-4de1-baf6-d01ffb809358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:53.725050 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad3673-ecaf-4c28-8022-fbcce2813a1f None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:53.743558 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-22e5d650-481a-4de1-baf6-d01ffb809358 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:53.745266 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-22e5d650-481a-4de1-baf6-d01ffb809358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:53.811470 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:53.830053 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 390/759] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:53 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 13:12:53.839776 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad3673-ecaf-4c28-8022-fbcce2813a1f None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:53.875464 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef710a7d-ad1b-45e0-8bce-74cf27b9a73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:53.876090 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef710a7d-ad1b-45e0-8bce-74cf27b9a73a None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:53.876376 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef710a7d-ad1b-45e0-8bce-74cf27b9a73a None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:53.876646 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef710a7d-ad1b-45e0-8bce-74cf27b9a73a None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:53.877265 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef710a7d-ad1b-45e0-8bce-74cf27b9a73a None admin] RBAC: Adding query filter params (type=compute) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:53.877562 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef710a7d-ad1b-45e0-8bce-74cf27b9a73a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:53.878900 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef710a7d-ad1b-45e0-8bce-74cf27b9a73a None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:53.884144 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 370/760] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Oct 25 13:12:53 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:53.893208 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e5d650-481a-4de1-baf6-d01ffb809358 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:53.995501 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e5d650-481a-4de1-baf6-d01ffb809358 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:54.031706 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596e3f7-757d-4c16-8c23-5543185c17bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:54.032657 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596e3f7-757d-4c16-8c23-5543185c17bb None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:54.033114 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596e3f7-757d-4c16-8c23-5543185c17bb None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:54.033545 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596e3f7-757d-4c16-8c23-5543185c17bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:54.034423 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9596e3f7-757d-4c16-8c23-5543185c17bb None admin] RBAC: Adding query filter params (interface=public, service_id=0518090314614df5854279c73367242e, region_id=RegionOne) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:54.034888 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9596e3f7-757d-4c16-8c23-5543185c17bb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:54.036419 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9596e3f7-757d-4c16-8c23-5543185c17bb None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:54.047652 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 391/761] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Oct 25 13:12:53 2022] GET /identity/v3/endpoints?service_id=0518090314614df5854279c73367242e&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:54.052973 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef710a7d-ad1b-45e0-8bce-74cf27b9a73a None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:54.105174 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596e3f7-757d-4c16-8c23-5543185c17bb None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:54.114313 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:54.164123 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef710a7d-ad1b-45e0-8bce-74cf27b9a73a None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:54.180887 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:54.202816 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c6f2d-ec23-4af0-8f9b-0a0305fb923b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:54.203991 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c6f2d-ec23-4af0-8f9b-0a0305fb923b None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:54.204272 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c6f2d-ec23-4af0-8f9b-0a0305fb923b None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:54.204546 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c6f2d-ec23-4af0-8f9b-0a0305fb923b None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:54.205147 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c6f2d-ec23-4af0-8f9b-0a0305fb923b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:54.206804 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c6f2d-ec23-4af0-8f9b-0a0305fb923b None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:54.219926 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 371/762] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Oct 25 13:12:54 2022] GET /identity/v3/services => generated 1957 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:12:54.243634 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596e3f7-757d-4c16-8c23-5543185c17bb None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:54.283925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa81f6-39ae-4993-8bfe-029be52c8f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:54.284494 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa81f6-39ae-4993-8bfe-029be52c8f67 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:54.284769 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa81f6-39ae-4993-8bfe-029be52c8f67 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:54.285035 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa81f6-39ae-4993-8bfe-029be52c8f67 None admin] PATH_INFO: `/v3/services/image` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:54.285624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa81f6-39ae-4993-8bfe-029be52c8f67 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:54.287020 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa81f6-39ae-4993-8bfe-029be52c8f67 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:54.298142 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-abfa81f6-39ae-4993-8bfe-029be52c8f67 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 25 13:12:54.298142 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:54.298142 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 13:12:54.298142 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 13:12:54.298142 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 13:12:54.298142 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 13:12:54.298142 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 13:12:54.298142 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:54.298142 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 25 13:12:54.298142 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:54.298142 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 13:12:54.298142 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:54.298142 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:54.298142 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:54.298142 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:54.298142 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:54.298142 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:54.299302 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:54.299302 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:54.299302 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:54.299302 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:54.299302 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:54.299302 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:54.299302 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 13:12:54.299302 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 13:12:54.299302 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 13:12:54.299302 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 13:12:54.299302 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:54.299302 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:54.299302 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:54.299302 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:54.299302 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:54.299302 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:54.300388 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:54.300388 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:54.300388 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:54.300388 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:54.300388 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:54.300388 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:54.300388 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:54.300388 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:54.300388 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:54.300388 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:54.300388 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 13:12:54.300388 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:54.300388 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 25 13:12:54.300388 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:54.300388 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 392/763] 10.222.0.25 () {56 vars in 1105 bytes} [Tue Oct 25 13:12:54 2022] GET /identity/v3/services/image => generated 86 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 13:12:54.307779 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c6f2d-ec23-4af0-8f9b-0a0305fb923b None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:54.425667 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c6f2d-ec23-4af0-8f9b-0a0305fb923b None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:54.446609 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:54.462298 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe3b5b-db69-4815-b6fb-73ef00de2ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:54.462960 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe3b5b-db69-4815-b6fb-73ef00de2ef1 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:54.463239 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe3b5b-db69-4815-b6fb-73ef00de2ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:54.463533 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe3b5b-db69-4815-b6fb-73ef00de2ef1 None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:54.464196 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe3b5b-db69-4815-b6fb-73ef00de2ef1 None admin] RBAC: Adding query filter params (name=image) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:54.464497 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe3b5b-db69-4815-b6fb-73ef00de2ef1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:54.465855 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe3b5b-db69-4815-b6fb-73ef00de2ef1 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:54.472109 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 372/764] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:54.478019 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa81f6-39ae-4993-8bfe-029be52c8f67 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:54.590412 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa81f6-39ae-4993-8bfe-029be52c8f67 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:54.612953 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:54.628662 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6f3c0-cca5-4c45-8d7a-a527e412b115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:54.629644 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6f3c0-cca5-4c45-8d7a-a527e412b115 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:54.630144 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6f3c0-cca5-4c45-8d7a-a527e412b115 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:54.630623 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6f3c0-cca5-4c45-8d7a-a527e412b115 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:54.631454 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc6f3c0-cca5-4c45-8d7a-a527e412b115 None admin] RBAC: Adding query filter params (type=image) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:54.632001 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc6f3c0-cca5-4c45-8d7a-a527e412b115 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:54.633632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc6f3c0-cca5-4c45-8d7a-a527e412b115 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:54.640419 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 393/765] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:54 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:54.647990 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe3b5b-db69-4815-b6fb-73ef00de2ef1 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:54.657125 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06bacc-47d0-4ac6-8898-f1a325ccd742 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:54.657415 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06bacc-47d0-4ac6-8898-f1a325ccd742 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:54.657701 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06bacc-47d0-4ac6-8898-f1a325ccd742 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:54.659300 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 394/766] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 13:12:54.664399 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7e1ad-e8c5-4079-ae90-f884024b9bdf None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:54.664687 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7e1ad-e8c5-4079-ae90-f884024b9bdf None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:54.664967 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7e1ad-e8c5-4079-ae90-f884024b9bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:54.686629 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-97a7e1ad-e8c5-4079-ae90-f884024b9bdf None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:54.687821 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-97a7e1ad-e8c5-4079-ae90-f884024b9bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:54.763208 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 395/767] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:54 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 25 13:12:54.782237 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe3b5b-db69-4815-b6fb-73ef00de2ef1 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:54.821212 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db3ad8-f6c2-4b63-805e-73f44bb48bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:54.821856 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db3ad8-f6c2-4b63-805e-73f44bb48bcc None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:54.822139 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db3ad8-f6c2-4b63-805e-73f44bb48bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:54.822406 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db3ad8-f6c2-4b63-805e-73f44bb48bcc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:54.823094 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db3ad8-f6c2-4b63-805e-73f44bb48bcc None admin] RBAC: Adding query filter params (interface=public, service_id=a4290d4f33e34ea3b46a1d008703f269, region_id=RegionOne) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:54.823394 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db3ad8-f6c2-4b63-805e-73f44bb48bcc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:54.824817 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db3ad8-f6c2-4b63-805e-73f44bb48bcc None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:54.831003 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 373/768] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Oct 25 13:12:54 2022] GET /identity/v3/endpoints?service_id=a4290d4f33e34ea3b46a1d008703f269&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:54.836736 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a7e1ad-e8c5-4079-ae90-f884024b9bdf None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:54.944935 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a7e1ad-e8c5-4079-ae90-f884024b9bdf None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:54.959856 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:54.981227 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2b0e4-66a4-447f-9495-03c3b180c537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:54.981839 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2b0e4-66a4-447f-9495-03c3b180c537 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:54.982118 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2b0e4-66a4-447f-9495-03c3b180c537 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:54.982396 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2b0e4-66a4-447f-9495-03c3b180c537 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:54.982997 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c2b0e4-66a4-447f-9495-03c3b180c537 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:54.984626 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c2b0e4-66a4-447f-9495-03c3b180c537 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:54.991592 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 396/769] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Oct 25 13:12:54 2022] GET /identity/v3/services => generated 1957 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:12:55.066760 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db3ad8-f6c2-4b63-805e-73f44bb48bcc None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:55.124670 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:55.188796 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db3ad8-f6c2-4b63-805e-73f44bb48bcc None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:55.227271 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec88d52-a69c-474d-887f-38919d6b3f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:55.228275 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec88d52-a69c-474d-887f-38919d6b3f87 None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:55.228761 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec88d52-a69c-474d-887f-38919d6b3f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:55.229253 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec88d52-a69c-474d-887f-38919d6b3f87 None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:55.230094 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec88d52-a69c-474d-887f-38919d6b3f87 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:55.231814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec88d52-a69c-474d-887f-38919d6b3f87 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:55.250834 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.sql.core [None req-6ec88d52-a69c-474d-887f-38919d6b3f87 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 25 13:12:55.250834 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 25 13:12:55.250834 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [parameters: {'user_id': 'c57c552497c7478283670fa5c60af551', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 25 13:12:55.250834 dv-cinder-862432-2-smb devstack@keystone.service[81363]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81363) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 25 13:12:55.259009 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-6ec88d52-a69c-474d-887f-38919d6b3f87 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 25 13:12:55.259009 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:55.259009 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 25 13:12:55.259009 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 25 13:12:55.259009 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 25 13:12:55.259009 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 25 13:12:55.259009 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 25 13:12:55.259009 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application result = self._query(query) Oct 25 13:12:55.259009 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 25 13:12:55.259009 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application conn.query(q) Oct 25 13:12:55.259009 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 25 13:12:55.259009 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 25 13:12:55.259009 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 25 13:12:55.259009 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application result.read() Oct 25 13:12:55.259009 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 25 13:12:55.259987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 25 13:12:55.259987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 25 13:12:55.259987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 25 13:12:55.259987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 25 13:12:55.259987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 25 13:12:55.259987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 25 13:12:55.259987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 25 13:12:55.259987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 25 13:12:55.259987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:55.259987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 25 13:12:55.259987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:55.259987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:55.259987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 25 13:12:55.259987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 25 13:12:55.259987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 25 13:12:55.259987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 25 13:12:55.259987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 25 13:12:55.259987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application next(self.gen) Oct 25 13:12:55.260962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 25 13:12:55.260962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application yield resource Oct 25 13:12:55.260962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 25 13:12:55.260962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application next(self.gen) Oct 25 13:12:55.260962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 25 13:12:55.260962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self.session.rollback() Oct 25 13:12:55.260962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 13:12:55.260962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self.force_reraise() Oct 25 13:12:55.260962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 13:12:55.260962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise self.value Oct 25 13:12:55.260962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 25 13:12:55.260962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 25 13:12:55.260962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 25 13:12:55.260962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application session.commit() Oct 25 13:12:55.260962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 25 13:12:55.260962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 25 13:12:55.260962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 25 13:12:55.261875 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._prepare_impl() Oct 25 13:12:55.261875 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 25 13:12:55.261875 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self.session.flush() Oct 25 13:12:55.261875 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 25 13:12:55.261875 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._flush(objects) Oct 25 13:12:55.261875 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 25 13:12:55.261875 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 25 13:12:55.261875 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 25 13:12:55.261875 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application compat.raise_( Oct 25 13:12:55.261875 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 25 13:12:55.261875 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception Oct 25 13:12:55.261875 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 25 13:12:55.261875 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application flush_context.execute() Oct 25 13:12:55.261875 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 25 13:12:55.261875 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rec.execute(self) Oct 25 13:12:55.261875 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 25 13:12:55.261875 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 25 13:12:55.262777 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 25 13:12:55.262777 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 25 13:12:55.262777 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 25 13:12:55.262777 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 25 13:12:55.262777 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 25 13:12:55.262777 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 25 13:12:55.262777 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 25 13:12:55.262777 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 25 13:12:55.262777 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 25 13:12:55.262777 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 25 13:12:55.262777 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 25 13:12:55.262777 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 25 13:12:55.262777 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 25 13:12:55.262777 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 25 13:12:55.262777 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 25 13:12:55.262777 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception Oct 25 13:12:55.263613 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 25 13:12:55.263613 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 25 13:12:55.263613 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 25 13:12:55.263613 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 25 13:12:55.263613 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 25 13:12:55.263613 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application result = self._query(query) Oct 25 13:12:55.263613 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 25 13:12:55.263613 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application conn.query(q) Oct 25 13:12:55.263613 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 25 13:12:55.263613 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 25 13:12:55.263613 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 25 13:12:55.263613 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application result.read() Oct 25 13:12:55.263613 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 25 13:12:55.263613 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 25 13:12:55.263613 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 25 13:12:55.263613 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 25 13:12:55.266188 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 25 13:12:55.266188 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 25 13:12:55.266188 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 25 13:12:55.266188 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 25 13:12:55.266188 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 25 13:12:55.266188 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 25 13:12:55.266188 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c57c552497c7478283670fa5c60af551', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 25 13:12:55.266188 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 25 13:12:55.266188 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:55.266188 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 13:12:55.266188 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:55.266188 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:55.266188 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:55.266188 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:55.266188 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:55.268094 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:55.268094 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:55.268094 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:55.268094 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:55.268094 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:55.268094 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:55.268094 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:55.268094 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 25 13:12:55.268094 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 25 13:12:55.268094 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:55.268094 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:55.268094 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 25 13:12:55.268094 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:12:55.268094 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 25 13:12:55.268094 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:12:55.268094 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 25 13:12:55.268094 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 25 13:12:55.270252 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 25 13:12:55.270252 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 25 13:12:55.270252 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 25 13:12:55.270252 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 25 13:12:55.270252 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 25 13:12:55.270252 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:12:55.272739 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 374/770] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Oct 25 13:12:55 2022] POST /identity/v3/users => generated 160 bytes in 206 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:55.279240 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2b0e4-66a4-447f-9495-03c3b180c537 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:55.385993 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2b0e4-66a4-447f-9495-03c3b180c537 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:55.423448 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545b746-bdc9-4331-96e4-558b480b902f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:55.424525 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545b746-bdc9-4331-96e4-558b480b902f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:55.425044 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545b746-bdc9-4331-96e4-558b480b902f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:55.425523 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545b746-bdc9-4331-96e4-558b480b902f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:55.434473 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545b746-bdc9-4331-96e4-558b480b902f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:55.436377 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545b746-bdc9-4331-96e4-558b480b902f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:55.450220 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-a545b746-bdc9-4331-96e4-558b480b902f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 25 13:12:55.450220 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:55.450220 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:55.450220 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:55.450220 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:55.450220 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:55.450220 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:55.450220 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:55.450220 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:55.450220 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:55.450220 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:55.450220 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:55.450220 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 25 13:12:55.450220 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 25 13:12:55.450220 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 25 13:12:55.450220 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 25 13:12:55.451339 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:55.451339 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:55.451339 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 25 13:12:55.451339 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:12:55.451339 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 25 13:12:55.451339 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:12:55.451339 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:55.451339 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:55.451339 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:55.451339 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:55.451339 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:55.451339 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:55.451339 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:55.451339 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:55.451339 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:55.451339 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:55.451339 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:55.451339 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:55.452891 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:55.452891 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:55.452891 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 25 13:12:55.452891 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 25 13:12:55.452891 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 25 13:12:55.452891 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 25 13:12:55.452891 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 25 13:12:55.452891 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 25 13:12:55.452891 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 25 13:12:55.452891 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:55.455700 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 397/771] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 25 13:12:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:55.462190 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec88d52-a69c-474d-887f-38919d6b3f87 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:55.554444 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9155514-98f7-4d3c-8f05-82873cee876a None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:55.554741 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9155514-98f7-4d3c-8f05-82873cee876a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:55.554938 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9155514-98f7-4d3c-8f05-82873cee876a None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:55.556556 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 398/772] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 13:12:55.561604 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa85c2-0e3f-4ffb-8758-7fa9e7b6b424 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:55.561884 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa85c2-0e3f-4ffb-8758-7fa9e7b6b424 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:55.562168 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa85c2-0e3f-4ffb-8758-7fa9e7b6b424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:55.575660 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec88d52-a69c-474d-887f-38919d6b3f87 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:55.580979 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d0fa85c2-0e3f-4ffb-8758-7fa9e7b6b424 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:55.582349 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d0fa85c2-0e3f-4ffb-8758-7fa9e7b6b424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:55.592448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:55.618159 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:55.622178 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2bd9a8-8eae-4b74-b65d-af707dc7f7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:55.623037 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bd9a8-8eae-4b74-b65d-af707dc7f7bf None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:55.623513 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bd9a8-8eae-4b74-b65d-af707dc7f7bf None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:55.624083 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bd9a8-8eae-4b74-b65d-af707dc7f7bf None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:55.626304 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2bd9a8-8eae-4b74-b65d-af707dc7f7bf None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:55.626833 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2bd9a8-8eae-4b74-b65d-af707dc7f7bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:55.628686 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2bd9a8-8eae-4b74-b65d-af707dc7f7bf None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:55.668498 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 399/773] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:55 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 25 13:12:55.672825 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 375/774] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 25 13:12:55 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:55.942280 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa85c2-0e3f-4ffb-8758-7fa9e7b6b424 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:56.047977 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa85c2-0e3f-4ffb-8758-7fa9e7b6b424 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:56.081804 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebf515-1edf-4fb7-9dd1-c10ba3008bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:56.082434 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebf515-1edf-4fb7-9dd1-c10ba3008bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:56.082713 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebf515-1edf-4fb7-9dd1-c10ba3008bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:56.082987 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebf515-1edf-4fb7-9dd1-c10ba3008bc7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:56.084113 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ebf515-1edf-4fb7-9dd1-c10ba3008bc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:56.085552 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ebf515-1edf-4fb7-9dd1-c10ba3008bc7 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:56.087249 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 400/775] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:56.093362 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2bd9a8-8eae-4b74-b65d-af707dc7f7bf None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:56.192929 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2bd9a8-8eae-4b74-b65d-af707dc7f7bf None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:56.228968 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104d537-8d52-4478-944c-ea8f3479fee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:56.229573 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104d537-8d52-4478-944c-ea8f3479fee8 None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:56.229850 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104d537-8d52-4478-944c-ea8f3479fee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:56.230118 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104d537-8d52-4478-944c-ea8f3479fee8 None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:56.230769 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104d537-8d52-4478-944c-ea8f3479fee8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:56.232206 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104d537-8d52-4478-944c-ea8f3479fee8 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:56.267927 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 376/776] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Oct 25 13:12:56 2022] POST /identity/v3/projects => generated 311 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:12:56.580561 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd33f00-6e04-49a0-902c-3c1de4f00782 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:56.580782 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd33f00-6e04-49a0-902c-3c1de4f00782 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:56.581019 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd33f00-6e04-49a0-902c-3c1de4f00782 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:56.582360 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 401/777] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:56.587581 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548b441-8f41-49f8-acbd-515984bd4547 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:56.587871 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548b441-8f41-49f8-acbd-515984bd4547 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:56.588177 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548b441-8f41-49f8-acbd-515984bd4547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:56.606932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-7548b441-8f41-49f8-acbd-515984bd4547 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:56.608554 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-7548b441-8f41-49f8-acbd-515984bd4547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:56.623065 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:56.680220 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 377/778] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:56 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 13:12:56.947977 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd33f00-6e04-49a0-902c-3c1de4f00782 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:56.984328 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:57.052400 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd33f00-6e04-49a0-902c-3c1de4f00782 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:57.086530 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a26fea-1148-4cb2-9252-c4de9d317792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:57.087160 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a26fea-1148-4cb2-9252-c4de9d317792 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:57.087439 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a26fea-1148-4cb2-9252-c4de9d317792 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:57.087713 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a26fea-1148-4cb2-9252-c4de9d317792 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:57.088322 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a26fea-1148-4cb2-9252-c4de9d317792 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:57.089678 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a26fea-1148-4cb2-9252-c4de9d317792 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:57.098771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-b8a26fea-1148-4cb2-9252-c4de9d317792 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 25 13:12:57.098771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:57.098771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 13:12:57.098771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 13:12:57.098771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 13:12:57.098771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 13:12:57.098771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 13:12:57.098771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:57.098771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 25 13:12:57.098771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:57.098771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 13:12:57.098771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:57.098771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:57.098771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:57.098771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:57.098771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:57.098771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:57.099807 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:57.099807 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:57.099807 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:57.099807 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:57.099807 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:57.099807 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:57.099807 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 13:12:57.099807 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 13:12:57.099807 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 13:12:57.099807 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 13:12:57.099807 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:57.099807 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:57.099807 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:57.099807 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:57.099807 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:57.099807 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:57.100708 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:57.100708 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:57.100708 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:57.100708 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:57.100708 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:57.100708 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:57.100708 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:57.100708 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:57.100708 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:57.100708 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:57.100708 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 13:12:57.100708 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:57.100708 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 25 13:12:57.100708 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:57.103978 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 402/779] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 25 13:12:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:57.106299 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548b441-8f41-49f8-acbd-515984bd4547 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:57.215238 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548b441-8f41-49f8-acbd-515984bd4547 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:57.250222 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a6608-116c-4d70-a30f-3bb6c38c5e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:57.250825 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a6608-116c-4d70-a30f-3bb6c38c5e7a None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:57.251102 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a6608-116c-4d70-a30f-3bb6c38c5e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:57.251379 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a6608-116c-4d70-a30f-3bb6c38c5e7a None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:57.252026 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a6608-116c-4d70-a30f-3bb6c38c5e7a None admin] RBAC: Adding query filter params (name=compute) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:57.252332 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a6608-116c-4d70-a30f-3bb6c38c5e7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:57.253763 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a6608-116c-4d70-a30f-3bb6c38c5e7a None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:57.263312 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 378/780] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Oct 25 13:12:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:57.265342 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a26fea-1148-4cb2-9252-c4de9d317792 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:57.277606 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43b18a-f291-499e-9bf7-8f064b1682c3 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:57.277891 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43b18a-f291-499e-9bf7-8f064b1682c3 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:57.278165 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43b18a-f291-499e-9bf7-8f064b1682c3 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:57.280053 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 379/781] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 13:12:57.285933 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a9866-30fc-4752-afab-ce4da04c38a6 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:57.286216 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a9866-30fc-4752-afab-ce4da04c38a6 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:57.286492 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a9866-30fc-4752-afab-ce4da04c38a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:57.304663 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-9f5a9866-30fc-4752-afab-ce4da04c38a6 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:57.305630 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-9f5a9866-30fc-4752-afab-ce4da04c38a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:57.315603 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:57.375701 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:57.377042 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 380/782] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:57 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 25 13:12:57.379068 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a26fea-1148-4cb2-9252-c4de9d317792 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:57.414313 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c8d4c-1059-489b-9453-e0c535a446dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:57.414915 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c8d4c-1059-489b-9453-e0c535a446dd None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:57.415196 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c8d4c-1059-489b-9453-e0c535a446dd None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:57.415471 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c8d4c-1059-489b-9453-e0c535a446dd None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:57.416119 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c8d4c-1059-489b-9453-e0c535a446dd None admin] RBAC: Adding query filter params (type=compute) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:57.416426 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c8d4c-1059-489b-9453-e0c535a446dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:57.417780 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c8d4c-1059-489b-9453-e0c535a446dd None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:57.423101 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 403/783] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Oct 25 13:12:57 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:57.428744 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a9866-30fc-4752-afab-ce4da04c38a6 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:57.530054 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a9866-30fc-4752-afab-ce4da04c38a6 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:57.567195 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1030948-c79f-4227-82ed-bfd9a9635f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:57.567800 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1030948-c79f-4227-82ed-bfd9a9635f70 None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:57.568098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1030948-c79f-4227-82ed-bfd9a9635f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:57.568374 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1030948-c79f-4227-82ed-bfd9a9635f70 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:57.569043 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1030948-c79f-4227-82ed-bfd9a9635f70 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:57.570409 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1030948-c79f-4227-82ed-bfd9a9635f70 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:57.587187 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:57.600293 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 381/784] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:12:57 2022] POST /identity/v3/endpoints => generated 334 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:12:57.647290 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c8d4c-1059-489b-9453-e0c535a446dd None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:57.765425 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c8d4c-1059-489b-9453-e0c535a446dd None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:57.809640 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264481d2-da62-4253-a14e-7cde406692a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:57.810197 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264481d2-da62-4253-a14e-7cde406692a0 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:57.810483 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264481d2-da62-4253-a14e-7cde406692a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:57.810752 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264481d2-da62-4253-a14e-7cde406692a0 None admin] PATH_INFO: `/v3/services/image` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:57.811322 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264481d2-da62-4253-a14e-7cde406692a0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:57.812838 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264481d2-da62-4253-a14e-7cde406692a0 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:57.821574 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-264481d2-da62-4253-a14e-7cde406692a0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 25 13:12:57.821574 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:57.821574 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 13:12:57.821574 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 13:12:57.821574 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 13:12:57.821574 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 13:12:57.821574 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 13:12:57.821574 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:57.821574 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 25 13:12:57.821574 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:57.821574 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 13:12:57.821574 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:57.821574 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:12:57.821574 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:12:57.821574 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:12:57.821574 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:12:57.821574 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:12:57.822638 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:12:57.822638 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:12:57.822638 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:12:57.822638 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:12:57.822638 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:12:57.822638 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:12:57.822638 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 13:12:57.822638 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 13:12:57.822638 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 13:12:57.822638 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 13:12:57.822638 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:12:57.822638 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:12:57.822638 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:12:57.822638 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:12:57.822638 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:12:57.822638 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:12:57.823480 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:12:57.823480 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:12:57.823480 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:12:57.823480 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:12:57.823480 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:12:57.823480 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:12:57.823480 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:12:57.823480 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:12:57.823480 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:12:57.823480 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:12:57.823480 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 13:12:57.823480 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:12:57.823480 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 25 13:12:57.823480 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:12:57.823480 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 404/785] 10.222.0.25 () {56 vars in 1105 bytes} [Tue Oct 25 13:12:57 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:12:57.829276 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1030948-c79f-4227-82ed-bfd9a9635f70 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:57.938287 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1030948-c79f-4227-82ed-bfd9a9635f70 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:57.972830 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b4bf04-96d8-49ea-8478-c0d67f740677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:57.973730 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4bf04-96d8-49ea-8478-c0d67f740677 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:57.974215 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4bf04-96d8-49ea-8478-c0d67f740677 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:57.974673 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4bf04-96d8-49ea-8478-c0d67f740677 None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:57.975480 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b4bf04-96d8-49ea-8478-c0d67f740677 None admin] RBAC: Adding query filter params (name=image) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:57.975997 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b4bf04-96d8-49ea-8478-c0d67f740677 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:57.977568 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b4bf04-96d8-49ea-8478-c0d67f740677 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:57.982792 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 382/786] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:57.989495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264481d2-da62-4253-a14e-7cde406692a0 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:58.017178 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:58.095261 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264481d2-da62-4253-a14e-7cde406692a0 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:58.129554 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080af4dd-6192-4cc4-8da9-a11a037c6746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:58.130161 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080af4dd-6192-4cc4-8da9-a11a037c6746 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:58.130439 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080af4dd-6192-4cc4-8da9-a11a037c6746 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:58.130720 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080af4dd-6192-4cc4-8da9-a11a037c6746 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:58.131331 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080af4dd-6192-4cc4-8da9-a11a037c6746 None admin] RBAC: Adding query filter params (type=image) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:12:58.131631 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080af4dd-6192-4cc4-8da9-a11a037c6746 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:58.133025 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080af4dd-6192-4cc4-8da9-a11a037c6746 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:58.137981 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 405/787] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:58.143807 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b4bf04-96d8-49ea-8478-c0d67f740677 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:58.209404 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:58.253989 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b4bf04-96d8-49ea-8478-c0d67f740677 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:58.288707 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0805e8-9758-4304-9a4d-197829363822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:58.289300 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0805e8-9758-4304-9a4d-197829363822 None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:58.289575 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0805e8-9758-4304-9a4d-197829363822 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:58.289841 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0805e8-9758-4304-9a4d-197829363822 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:58.290499 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0805e8-9758-4304-9a4d-197829363822 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:58.291857 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0805e8-9758-4304-9a4d-197829363822 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:58.312265 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 383/788] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:12:58 2022] POST /identity/v3/endpoints => generated 327 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:12:58.545245 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42cf12-9114-4b34-ae34-f5da3c668516 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:58.545618 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42cf12-9114-4b34-ae34-f5da3c668516 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:58.546334 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42cf12-9114-4b34-ae34-f5da3c668516 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:58.547859 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 406/789] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:58.552975 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef5b36-f05e-4b7c-83c3-adc42a16aa16 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:58.553266 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef5b36-f05e-4b7c-83c3-adc42a16aa16 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:58.553538 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef5b36-f05e-4b7c-83c3-adc42a16aa16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:58.571693 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-0aef5b36-f05e-4b7c-83c3-adc42a16aa16 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:58.572906 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-0aef5b36-f05e-4b7c-83c3-adc42a16aa16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:58.650665 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 384/790] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 13:12:58.925545 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42cf12-9114-4b34-ae34-f5da3c668516 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:59.015087 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:59.029793 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42cf12-9114-4b34-ae34-f5da3c668516 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:59.065566 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabdbe9a-16a5-418f-9381-e51896791f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:59.066196 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdbe9a-16a5-418f-9381-e51896791f60 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:59.066474 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdbe9a-16a5-418f-9381-e51896791f60 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:59.066745 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdbe9a-16a5-418f-9381-e51896791f60 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:59.067842 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabdbe9a-16a5-418f-9381-e51896791f60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:59.069300 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabdbe9a-16a5-418f-9381-e51896791f60 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:59.071021 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 407/791] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:12:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:12:59.076522 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef5b36-f05e-4b7c-83c3-adc42a16aa16 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:12:59.122836 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:12:59.178261 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef5b36-f05e-4b7c-83c3-adc42a16aa16 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:12:59.211923 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab654ae2-6d2d-41b3-b9da-e478731d6d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:12:59.212517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab654ae2-6d2d-41b3-b9da-e478731d6d37 None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:59.212795 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab654ae2-6d2d-41b3-b9da-e478731d6d37 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:59.213066 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab654ae2-6d2d-41b3-b9da-e478731d6d37 None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:59.213718 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab654ae2-6d2d-41b3-b9da-e478731d6d37 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:12:59.215136 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab654ae2-6d2d-41b3-b9da-e478731d6d37 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:12:59.237841 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 385/792] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 25 13:12:59 2022] POST /identity/v3/users => generated 285 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:12:59.854950 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38192df1-3c55-471b-a333-2a2b6face6cf None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:59.855309 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38192df1-3c55-471b-a333-2a2b6face6cf None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:59.855500 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38192df1-3c55-471b-a333-2a2b6face6cf None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:59.856986 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 408/793] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:12:59.862020 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5af60-0549-4311-be5c-e068ea1ec528 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:12:59.862310 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5af60-0549-4311-be5c-e068ea1ec528 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:12:59.862584 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5af60-0549-4311-be5c-e068ea1ec528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:12:59.880742 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-afd5af60-0549-4311-be5c-e068ea1ec528 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:12:59.881897 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-afd5af60-0549-4311-be5c-e068ea1ec528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:12:59.948987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 386/794] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:12:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 13:13:00.214331 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38192df1-3c55-471b-a333-2a2b6face6cf None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:00.315775 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38192df1-3c55-471b-a333-2a2b6face6cf None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:00.350233 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043dbef-7bfc-4fab-b46c-7c275e353989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:00.350854 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043dbef-7bfc-4fab-b46c-7c275e353989 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:00.351130 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043dbef-7bfc-4fab-b46c-7c275e353989 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:00.351401 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043dbef-7bfc-4fab-b46c-7c275e353989 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:00.362079 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043dbef-7bfc-4fab-b46c-7c275e353989 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:13:00.366771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-f043dbef-7bfc-4fab-b46c-7c275e353989 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 25 13:13:00.366771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:13:00.366771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:13:00.366771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:13:00.366771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:13:00.366771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:13:00.366771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:13:00.366771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:13:00.366771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:13:00.366771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:13:00.366771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:13:00.366771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:13:00.366771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:13:00.366771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:13:00.366771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:13:00.366771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:13:00.367733 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:13:00.367733 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:13:00.367733 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:13:00.367733 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:13:00.367733 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:13:00.367733 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:13:00.367733 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:13:00.367733 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:13:00.367733 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:13:00.367733 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:13:00.367733 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:13:00.367733 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:13:00.367733 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:13:00.367733 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:13:00.367733 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:13:00.367733 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:13:00.368614 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:13:00.368614 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:13:00.368614 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:13:00.368614 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:13:00.368614 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:13:00.368614 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:13:00.368614 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:13:00.368614 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:13:00.368614 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:13:00.368614 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:13:00.368614 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 25 13:13:00.368614 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:13:00.372218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 409/795] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Oct 25 13:13:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:13:00.373743 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5af60-0549-4311-be5c-e068ea1ec528 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:00.404253 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:00.481474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5af60-0549-4311-be5c-e068ea1ec528 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:00.516650 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2332e1f-2138-435e-8557-2d901f848f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:00.517252 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2332e1f-2138-435e-8557-2d901f848f4e None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:00.517528 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2332e1f-2138-435e-8557-2d901f848f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:00.517793 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2332e1f-2138-435e-8557-2d901f848f4e None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:00.518447 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2332e1f-2138-435e-8557-2d901f848f4e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:13:00.518744 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2332e1f-2138-435e-8557-2d901f848f4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:00.520123 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2332e1f-2138-435e-8557-2d901f848f4e None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:00.532074 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 387/796] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Oct 25 13:13:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:13:00.534985 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043dbef-7bfc-4fab-b46c-7c275e353989 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:00.546676 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace449b-bca8-489f-bec4-7b675d2afdc7 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:00.547065 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace449b-bca8-489f-bec4-7b675d2afdc7 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:00.547341 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace449b-bca8-489f-bec4-7b675d2afdc7 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:00.548843 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 388/797] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:13:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 13:13:00.553714 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c691167-9e39-47c9-bc74-8316aadc6245 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:00.553996 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c691167-9e39-47c9-bc74-8316aadc6245 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:00.554279 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c691167-9e39-47c9-bc74-8316aadc6245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:00.556676 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:00.572983 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-3c691167-9e39-47c9-bc74-8316aadc6245 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:13:00.574147 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-3c691167-9e39-47c9-bc74-8316aadc6245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:13:00.643228 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043dbef-7bfc-4fab-b46c-7c275e353989 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:00.644603 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 389/798] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:13:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 25 13:13:00.684776 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308921c-7297-4fdb-9169-c7a53ec1f471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:00.685401 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308921c-7297-4fdb-9169-c7a53ec1f471 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:00.685681 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308921c-7297-4fdb-9169-c7a53ec1f471 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:00.685955 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308921c-7297-4fdb-9169-c7a53ec1f471 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:00.696202 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308921c-7297-4fdb-9169-c7a53ec1f471 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:00.697630 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308921c-7297-4fdb-9169-c7a53ec1f471 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:00.712495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-2308921c-7297-4fdb-9169-c7a53ec1f471 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:13:00.712495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:13:00.712495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:13:00.712495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:13:00.712495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:13:00.712495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:13:00.712495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:13:00.712495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:13:00.712495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:13:00.712495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:13:00.712495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:13:00.712495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:13:00.712495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:13:00.712495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:13:00.712495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:13:00.712495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:13:00.713460 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:13:00.713460 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:13:00.713460 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:13:00.713460 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:13:00.713460 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:13:00.713460 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:13:00.713460 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:13:00.713460 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:13:00.713460 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:13:00.713460 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:13:00.713460 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:13:00.713460 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:13:00.713460 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:13:00.713460 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:13:00.713460 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:13:00.713460 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:13:00.713460 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:13:00.714474 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:13:00.714474 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:13:00.714474 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:13:00.714474 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 410/799] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:13:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:13:00.719852 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c691167-9e39-47c9-bc74-8316aadc6245 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:00.749450 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:00.826328 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c691167-9e39-47c9-bc74-8316aadc6245 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:00.861901 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731587e-6eeb-4957-9b77-e1ac4179a620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:00.862505 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731587e-6eeb-4957-9b77-e1ac4179a620 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:00.862791 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731587e-6eeb-4957-9b77-e1ac4179a620 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:00.863065 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731587e-6eeb-4957-9b77-e1ac4179a620 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:00.863698 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3731587e-6eeb-4957-9b77-e1ac4179a620 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:13:00.864028 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3731587e-6eeb-4957-9b77-e1ac4179a620 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:00.865401 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3731587e-6eeb-4957-9b77-e1ac4179a620 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:00.881208 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 390/800] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:13:00.882284 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308921c-7297-4fdb-9169-c7a53ec1f471 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:00.926837 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731587e-6eeb-4957-9b77-e1ac4179a620 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:00.957399 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:00.994923 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308921c-7297-4fdb-9169-c7a53ec1f471 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:01.012807 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:01.029722 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731587e-6eeb-4957-9b77-e1ac4179a620 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:01.032765 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c9112-9bb7-4dd5-ae56-b519b4e4537e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:01.033400 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c9112-9bb7-4dd5-ae56-b519b4e4537e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:01.033683 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c9112-9bb7-4dd5-ae56-b519b4e4537e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:01.033961 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c9112-9bb7-4dd5-ae56-b519b4e4537e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:01.041971 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c9112-9bb7-4dd5-ae56-b519b4e4537e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:01.044075 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c9112-9bb7-4dd5-ae56-b519b4e4537e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:01.057107 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-514c9112-9bb7-4dd5-ae56-b519b4e4537e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 25 13:13:01.057107 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:13:01.057107 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:13:01.057107 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:13:01.057107 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:13:01.057107 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:13:01.057107 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:13:01.057107 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:13:01.057107 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:13:01.057107 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:13:01.057107 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:13:01.057107 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:13:01.057107 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 25 13:13:01.057107 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 25 13:13:01.057107 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 25 13:13:01.057107 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 25 13:13:01.058263 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:13:01.058263 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:13:01.058263 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 25 13:13:01.058263 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:13:01.058263 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 25 13:13:01.058263 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:13:01.058263 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:13:01.058263 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:13:01.058263 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:13:01.058263 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:13:01.058263 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:13:01.058263 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:13:01.058263 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:13:01.058263 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:13:01.058263 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:13:01.058263 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:13:01.058263 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:13:01.058263 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:13:01.059229 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:13:01.059229 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:13:01.059229 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 25 13:13:01.059229 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 25 13:13:01.059229 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 25 13:13:01.059229 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 25 13:13:01.059229 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 25 13:13:01.059229 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 25 13:13:01.059229 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 25 13:13:01.059229 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:13:01.059229 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 411/801] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Oct 25 13:13:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:13:01.064152 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c9112-9bb7-4dd5-ae56-b519b4e4537e None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:01.068160 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7e542-334e-4b94-815b-bf28d7931877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:01.068782 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7e542-334e-4b94-815b-bf28d7931877 None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:01.069062 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7e542-334e-4b94-815b-bf28d7931877 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:01.069338 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7e542-334e-4b94-815b-bf28d7931877 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:01.070017 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd7e542-334e-4b94-815b-bf28d7931877 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:01.071380 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd7e542-334e-4b94-815b-bf28d7931877 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:01.080398 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.sql.core [None req-cbd7e542-334e-4b94-815b-bf28d7931877 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 25 13:13:01.080398 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 25 13:13:01.080398 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [parameters: {'id': '0653b3bd081a438b8b005db820f39f7b', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 25 13:13:01.080398 dv-cinder-862432-2-smb devstack@keystone.service[81363]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81363) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 25 13:13:01.088299 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-cbd7e542-334e-4b94-815b-bf28d7931877 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 25 13:13:01.088299 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:13:01.088299 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 25 13:13:01.088299 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 25 13:13:01.088299 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 25 13:13:01.088299 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 25 13:13:01.088299 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 25 13:13:01.088299 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application result = self._query(query) Oct 25 13:13:01.088299 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 25 13:13:01.088299 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application conn.query(q) Oct 25 13:13:01.088299 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 25 13:13:01.088299 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 25 13:13:01.088299 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 25 13:13:01.088299 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application result.read() Oct 25 13:13:01.089123 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 25 13:13:01.089123 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 25 13:13:01.089123 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 25 13:13:01.089123 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 25 13:13:01.089123 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 25 13:13:01.089123 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 25 13:13:01.089123 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 25 13:13:01.089123 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 25 13:13:01.089123 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 25 13:13:01.089123 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:13:01.089123 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 25 13:13:01.089123 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:13:01.089123 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:13:01.089123 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 25 13:13:01.089123 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 25 13:13:01.089123 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 25 13:13:01.089123 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 25 13:13:01.089123 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 25 13:13:01.090098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application next(self.gen) Oct 25 13:13:01.090098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 25 13:13:01.090098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application yield resource Oct 25 13:13:01.090098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 25 13:13:01.090098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application next(self.gen) Oct 25 13:13:01.090098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 25 13:13:01.090098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self.session.rollback() Oct 25 13:13:01.090098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 13:13:01.090098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self.force_reraise() Oct 25 13:13:01.090098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 13:13:01.090098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise self.value Oct 25 13:13:01.090098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 25 13:13:01.090098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 25 13:13:01.090098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 25 13:13:01.090098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application session.commit() Oct 25 13:13:01.090098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 25 13:13:01.090098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 25 13:13:01.091012 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 25 13:13:01.091012 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._prepare_impl() Oct 25 13:13:01.091012 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 25 13:13:01.091012 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self.session.flush() Oct 25 13:13:01.091012 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 25 13:13:01.091012 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._flush(objects) Oct 25 13:13:01.091012 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 25 13:13:01.091012 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 25 13:13:01.091012 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 25 13:13:01.091012 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application compat.raise_( Oct 25 13:13:01.091012 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 25 13:13:01.091012 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception Oct 25 13:13:01.091012 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 25 13:13:01.091012 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application flush_context.execute() Oct 25 13:13:01.091012 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 25 13:13:01.091012 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rec.execute(self) Oct 25 13:13:01.091012 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 25 13:13:01.091965 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 25 13:13:01.091965 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 25 13:13:01.091965 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 25 13:13:01.091965 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 25 13:13:01.091965 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 25 13:13:01.091965 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 25 13:13:01.091965 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 25 13:13:01.091965 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 25 13:13:01.091965 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 25 13:13:01.091965 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 25 13:13:01.091965 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 25 13:13:01.091965 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 25 13:13:01.091965 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 25 13:13:01.091965 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 25 13:13:01.091965 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 25 13:13:01.093399 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 25 13:13:01.093399 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception Oct 25 13:13:01.093399 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 25 13:13:01.093399 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 25 13:13:01.093399 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 25 13:13:01.093399 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 25 13:13:01.093399 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 25 13:13:01.093399 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application result = self._query(query) Oct 25 13:13:01.093399 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 25 13:13:01.093399 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application conn.query(q) Oct 25 13:13:01.093399 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 25 13:13:01.093399 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 25 13:13:01.093399 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 25 13:13:01.093399 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application result.read() Oct 25 13:13:01.093399 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 25 13:13:01.093399 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 25 13:13:01.093399 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 25 13:13:01.094325 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 25 13:13:01.094325 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 25 13:13:01.094325 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 25 13:13:01.094325 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 25 13:13:01.094325 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 25 13:13:01.094325 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 25 13:13:01.094325 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 25 13:13:01.094325 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [parameters: {'id': '0653b3bd081a438b8b005db820f39f7b', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 25 13:13:01.094325 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 25 13:13:01.094325 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:13:01.094325 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 13:13:01.094325 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:13:01.094325 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:13:01.094325 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 25 13:13:01.094325 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 25 13:13:01.095150 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 25 13:13:01.095150 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 25 13:13:01.095150 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 25 13:13:01.095150 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:13:01.095150 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 13:13:01.095150 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:13:01.095150 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:13:01.095150 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:13:01.095150 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:13:01.095150 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:13:01.095150 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:13:01.095150 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:13:01.095150 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:13:01.095150 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:13:01.095150 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:13:01.095150 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:13:01.095150 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:13:01.097669 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 25 13:13:01.097669 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 25 13:13:01.097669 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:13:01.097669 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:13:01.097669 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 25 13:13:01.097669 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 25 13:13:01.097669 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:13:01.097669 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:13:01.097669 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 25 13:13:01.097669 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 25 13:13:01.097669 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 25 13:13:01.097669 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:13:01.097669 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 391/802] 10.222.0.25 () {60 vars in 1137 bytes} [Tue Oct 25 13:13:00 2022] POST /identity/v3/domains => generated 190 bytes in 168 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 25 13:13:01.100874 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7e542-334e-4b94-815b-bf28d7931877 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:01.185626 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c9112-9bb7-4dd5-ae56-b519b4e4537e None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:01.209108 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7e542-334e-4b94-815b-bf28d7931877 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:01.215459 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:01.225118 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9afeb1-b543-4c3b-8d2f-cd0c79da54d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:01.225746 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9afeb1-b543-4c3b-8d2f-cd0c79da54d3 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:01.226133 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9afeb1-b543-4c3b-8d2f-cd0c79da54d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:01.226405 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9afeb1-b543-4c3b-8d2f-cd0c79da54d3 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:01.227119 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9afeb1-b543-4c3b-8d2f-cd0c79da54d3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:13:01.227420 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9afeb1-b543-4c3b-8d2f-cd0c79da54d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:01.228846 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9afeb1-b543-4c3b-8d2f-cd0c79da54d3 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:01.244071 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9aa5e-c196-43e1-9c3d-cb105044b2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:01.244750 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9aa5e-c196-43e1-9c3d-cb105044b2b5 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:01.244993 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9aa5e-c196-43e1-9c3d-cb105044b2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:01.245268 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9aa5e-c196-43e1-9c3d-cb105044b2b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:01.248266 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 412/803] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Oct 25 13:13:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:13:01.254427 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9afeb1-b543-4c3b-8d2f-cd0c79da54d3 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:01.260071 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9aa5e-c196-43e1-9c3d-cb105044b2b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:01.261521 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9aa5e-c196-43e1-9c3d-cb105044b2b5 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:01.270390 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:01.276814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-1ce9aa5e-c196-43e1-9c3d-cb105044b2b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:13:01.276814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:13:01.276814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:13:01.276814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:13:01.276814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:13:01.276814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:13:01.276814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:13:01.276814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:13:01.276814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:13:01.276814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:13:01.276814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:13:01.276814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:13:01.276814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:13:01.276814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:13:01.276814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:13:01.276814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:13:01.277932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:13:01.277932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:13:01.277932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:13:01.277932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:13:01.277932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:13:01.277932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:13:01.277932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:13:01.277932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:13:01.277932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:13:01.277932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:13:01.277932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:13:01.277932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:13:01.277932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:13:01.277932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:13:01.277932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:13:01.277932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:13:01.277932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:13:01.278847 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:13:01.278847 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:13:01.278847 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:13:01.287111 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 392/804] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:13:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:13:01.288102 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9aa5e-c196-43e1-9c3d-cb105044b2b5 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:01.369576 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9afeb1-b543-4c3b-8d2f-cd0c79da54d3 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:01.401217 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9aa5e-c196-43e1-9c3d-cb105044b2b5 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:01.407871 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a5895-de29-48fe-a873-1c322a4a4962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:01.408536 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a5895-de29-48fe-a873-1c322a4a4962 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:01.408816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a5895-de29-48fe-a873-1c322a4a4962 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:01.409089 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a5895-de29-48fe-a873-1c322a4a4962 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:01.419829 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a5895-de29-48fe-a873-1c322a4a4962 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:01.421384 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a5895-de29-48fe-a873-1c322a4a4962 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:01.436995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-377a5895-de29-48fe-a873-1c322a4a4962 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:13:01.436995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:13:01.436995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:13:01.436995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:13:01.436995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:13:01.436995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:13:01.436995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:13:01.436995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:13:01.436995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:13:01.436995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:13:01.436995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:13:01.436995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:13:01.436995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:13:01.436995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:13:01.436995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:13:01.436995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:13:01.438065 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:13:01.438065 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:13:01.438065 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:13:01.438065 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:13:01.438065 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:13:01.438065 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:13:01.438065 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:13:01.438065 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:13:01.438065 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:13:01.438065 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:13:01.438065 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:13:01.438065 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:13:01.438065 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:13:01.438065 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:13:01.438065 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:13:01.438065 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:13:01.438065 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:13:01.438948 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:13:01.438948 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:13:01.438948 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:13:01.438948 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 413/805] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:13:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 13:13:01.439584 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7bfb7-1832-410b-b72f-16912160efe6 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:01.439584 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7bfb7-1832-410b-b72f-16912160efe6 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:01.439837 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7bfb7-1832-410b-b72f-16912160efe6 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:01.440035 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03a14d-19fd-40c2-ac27-974aa9a5dc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:01.440638 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03a14d-19fd-40c2-ac27-974aa9a5dc84 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:01.440920 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03a14d-19fd-40c2-ac27-974aa9a5dc84 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:01.444818 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03a14d-19fd-40c2-ac27-974aa9a5dc84 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:01.444937 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 414/806] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:13:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:13:01.445033 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03a14d-19fd-40c2-ac27-974aa9a5dc84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:13:01.445033 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03a14d-19fd-40c2-ac27-974aa9a5dc84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:01.445194 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7bfb7-1832-410b-b72f-16912160efe6 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:01.445264 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03a14d-19fd-40c2-ac27-974aa9a5dc84 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:01.457291 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 393/807] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:13:01.458507 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e0cea-7849-4026-b1e1-ecf0913398f7 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:01.458797 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e0cea-7849-4026-b1e1-ecf0913398f7 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:01.459071 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e0cea-7849-4026-b1e1-ecf0913398f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:01.484723 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-ef1e0cea-7849-4026-b1e1-ecf0913398f7 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:13:01.485943 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ef1e0cea-7849-4026-b1e1-ecf0913398f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:13:01.488030 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:01.555808 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:01.566627 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7bfb7-1832-410b-b72f-16912160efe6 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:01.570819 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 394/808] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:13:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 13:13:01.606702 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3481d-0a9b-4b3a-9679-04c66b80d9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:01.607623 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3481d-0a9b-4b3a-9679-04c66b80d9b7 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:01.608110 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3481d-0a9b-4b3a-9679-04c66b80d9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:01.608562 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3481d-0a9b-4b3a-9679-04c66b80d9b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:01.609367 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d3481d-0a9b-4b3a-9679-04c66b80d9b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:13:01.609858 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d3481d-0a9b-4b3a-9679-04c66b80d9b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:01.611531 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d3481d-0a9b-4b3a-9679-04c66b80d9b7 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:01.625286 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 415/809] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:13:01.630649 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e0cea-7849-4026-b1e1-ecf0913398f7 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:01.743730 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e0cea-7849-4026-b1e1-ecf0913398f7 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:01.779206 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69ec9f-9d46-4d15-aae9-a7905ff77ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:01.779834 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69ec9f-9d46-4d15-aae9-a7905ff77ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:01.780570 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69ec9f-9d46-4d15-aae9-a7905ff77ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:01.780860 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69ec9f-9d46-4d15-aae9-a7905ff77ac6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:01.787739 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69ec9f-9d46-4d15-aae9-a7905ff77ac6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:01.789208 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69ec9f-9d46-4d15-aae9-a7905ff77ac6 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:01.801107 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-5e69ec9f-9d46-4d15-aae9-a7905ff77ac6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:13:01.801107 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:13:01.801107 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:13:01.801107 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:13:01.801107 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:13:01.801107 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:13:01.801107 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:13:01.801107 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:13:01.801107 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:13:01.801107 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:13:01.801107 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:13:01.801107 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:13:01.801107 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 25 13:13:01.801107 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 25 13:13:01.801107 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 25 13:13:01.802018 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 25 13:13:01.802018 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:13:01.802018 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:13:01.802018 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:13:01.802018 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:13:01.802018 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:13:01.802018 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:13:01.802018 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:13:01.802018 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:13:01.802018 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:13:01.802018 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:13:01.802018 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:13:01.802018 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:13:01.802018 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:13:01.802018 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:13:01.802018 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:13:01.802018 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:13:01.802950 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 25 13:13:01.802950 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 25 13:13:01.802950 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 25 13:13:01.802950 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 25 13:13:01.802950 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 25 13:13:01.802950 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 25 13:13:01.802950 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:13:01.802950 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:13:01.802950 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 395/810] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 25 13:13:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:13:01.808017 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3481d-0a9b-4b3a-9679-04c66b80d9b7 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:01.853915 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69ec9f-9d46-4d15-aae9-a7905ff77ac6 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:01.902312 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:01.904078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:01.908861 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3481d-0a9b-4b3a-9679-04c66b80d9b7 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:01.943378 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3b358-4375-4970-a127-3bb81623f7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:01.944070 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3b358-4375-4970-a127-3bb81623f7fd None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:01.944359 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3b358-4375-4970-a127-3bb81623f7fd None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:01.944628 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3b358-4375-4970-a127-3bb81623f7fd None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:01.945306 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed3b358-4375-4970-a127-3bb81623f7fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:13:01.945606 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed3b358-4375-4970-a127-3bb81623f7fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:01.947015 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed3b358-4375-4970-a127-3bb81623f7fd None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:01.953594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69ec9f-9d46-4d15-aae9-a7905ff77ac6 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:01.958676 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 416/811] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 25 13:13:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:13:01.964805 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3b358-4375-4970-a127-3bb81623f7fd None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:01.988562 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2136ec-4394-4248-99c8-e84d04374635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:01.989181 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2136ec-4394-4248-99c8-e84d04374635 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:01.989465 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2136ec-4394-4248-99c8-e84d04374635 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:01.989734 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2136ec-4394-4248-99c8-e84d04374635 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:02.000342 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2136ec-4394-4248-99c8-e84d04374635 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:13:02.005424 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-9a2136ec-4394-4248-99c8-e84d04374635 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 13:13:02.005424 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:13:02.005424 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:13:02.005424 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:13:02.005424 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:13:02.005424 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:13:02.005424 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:13:02.005424 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:13:02.005424 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:13:02.005424 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:13:02.005424 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:13:02.005424 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:13:02.005424 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:13:02.005424 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:13:02.005424 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:13:02.005424 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:13:02.006460 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:13:02.006460 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:13:02.006460 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:13:02.006460 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:13:02.006460 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:13:02.006460 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:13:02.006460 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:13:02.006460 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:13:02.006460 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:13:02.006460 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:13:02.006460 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:13:02.006460 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:13:02.006460 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:13:02.006460 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:13:02.006460 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:13:02.006460 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:13:02.008962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:13:02.008962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:13:02.008962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:13:02.008962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:13:02.008962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:13:02.008962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:13:02.008962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:13:02.008962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:13:02.008962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:13:02.008962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:13:02.008962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 13:13:02.008962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:13:02.008962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 396/812] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 25 13:13:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 13:13:02.012548 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2136ec-4394-4248-99c8-e84d04374635 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:02.062377 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3b358-4375-4970-a127-3bb81623f7fd None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:02.097836 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6dbabf-f8d2-4f14-a863-88b858e55618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:02.098492 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6dbabf-f8d2-4f14-a863-88b858e55618 None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:02.098769 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6dbabf-f8d2-4f14-a863-88b858e55618 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:02.099041 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6dbabf-f8d2-4f14-a863-88b858e55618 None admin] PATH_INFO: `/v3/projects/616ecfe8d2c74aad9386720718392e81/users/63e73c00cadb4deea934db6111ed76d5/roles/3e0f611d78184eac9855bafdbdd78a7c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:02.101247 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6dbabf-f8d2-4f14-a863-88b858e55618 None admin] RBAC: Authorizing `identity:create_grant(project_id=616ecfe8d2c74aad9386720718392e81, user_id=63e73c00cadb4deea934db6111ed76d5, role_id=3e0f611d78184eac9855bafdbdd78a7c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:02.102685 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6dbabf-f8d2-4f14-a863-88b858e55618 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:02.114603 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2136ec-4394-4248-99c8-e84d04374635 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:02.115610 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 417/813] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 25 13:13:01 2022] PUT /identity/v3/projects/616ecfe8d2c74aad9386720718392e81/users/63e73c00cadb4deea934db6111ed76d5/roles/3e0f611d78184eac9855bafdbdd78a7c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:13:02.126476 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:02.152444 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd25c55-ee81-4b4b-b02d-f24b6530641e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:02.153070 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd25c55-ee81-4b4b-b02d-f24b6530641e None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:02.153350 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd25c55-ee81-4b4b-b02d-f24b6530641e None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:02.153626 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd25c55-ee81-4b4b-b02d-f24b6530641e None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:02.154306 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd25c55-ee81-4b4b-b02d-f24b6530641e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:13:02.154610 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd25c55-ee81-4b4b-b02d-f24b6530641e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:02.156566 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd25c55-ee81-4b4b-b02d-f24b6530641e None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:02.166025 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 397/814] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 25 13:13:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:13:02.173176 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6dbabf-f8d2-4f14-a863-88b858e55618 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:02.193194 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:02.279841 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6dbabf-f8d2-4f14-a863-88b858e55618 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:02.316917 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cca385-0186-4bcf-b221-6082a4a90d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:02.317468 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cca385-0186-4bcf-b221-6082a4a90d58 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:02.317828 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cca385-0186-4bcf-b221-6082a4a90d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:02.318104 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cca385-0186-4bcf-b221-6082a4a90d58 None admin] PATH_INFO: `/v3/users/d15fd9f1dee14293a8de8c8e1a76e5a6` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:02.332585 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cca385-0186-4bcf-b221-6082a4a90d58 None admin] RBAC: Authorizing `identity:get_user(user_id=d15fd9f1dee14293a8de8c8e1a76e5a6)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:02.334005 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cca385-0186-4bcf-b221-6082a4a90d58 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:02.335622 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 418/815] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 25 13:13:02 2022] GET /identity/v3/users/d15fd9f1dee14293a8de8c8e1a76e5a6 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:13:02.341625 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd25c55-ee81-4b4b-b02d-f24b6530641e None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:02.440368 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd25c55-ee81-4b4b-b02d-f24b6530641e None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:02.473811 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530cba01-5226-4ee9-85c0-4fe86505faf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:02.474433 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cba01-5226-4ee9-85c0-4fe86505faf3 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:02.474714 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cba01-5226-4ee9-85c0-4fe86505faf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:02.474990 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cba01-5226-4ee9-85c0-4fe86505faf3 None admin] PATH_INFO: `/v3/projects/4886db4167754f3c8957bf8a9ccfc6da` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:02.476119 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530cba01-5226-4ee9-85c0-4fe86505faf3 None admin] RBAC: Authorizing `identity:get_project(project_id=4886db4167754f3c8957bf8a9ccfc6da)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:02.477551 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530cba01-5226-4ee9-85c0-4fe86505faf3 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:02.479156 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 398/816] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 25 13:13:02 2022] GET /identity/v3/projects/4886db4167754f3c8957bf8a9ccfc6da => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:13:02.485876 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cca385-0186-4bcf-b221-6082a4a90d58 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:02.560773 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:02.584244 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cca385-0186-4bcf-b221-6082a4a90d58 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:02.618402 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c11f20-fc7b-442a-a0a3-fb29deb70576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:02.619054 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c11f20-fc7b-442a-a0a3-fb29deb70576 None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:02.619333 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c11f20-fc7b-442a-a0a3-fb29deb70576 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:02.619607 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c11f20-fc7b-442a-a0a3-fb29deb70576 None admin] PATH_INFO: `/v3/projects/4886db4167754f3c8957bf8a9ccfc6da/users/d15fd9f1dee14293a8de8c8e1a76e5a6/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:02.621504 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c11f20-fc7b-442a-a0a3-fb29deb70576 None admin] RBAC: Authorizing `identity:create_grant(project_id=4886db4167754f3c8957bf8a9ccfc6da, user_id=d15fd9f1dee14293a8de8c8e1a76e5a6, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:02.622925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c11f20-fc7b-442a-a0a3-fb29deb70576 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:02.635570 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 419/817] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 25 13:13:02 2022] PUT /identity/v3/projects/4886db4167754f3c8957bf8a9ccfc6da/users/d15fd9f1dee14293a8de8c8e1a76e5a6/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:13:04.278773 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca6eb9-a8a2-4fb6-910e-c0325723f1d6 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:04.279324 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca6eb9-a8a2-4fb6-910e-c0325723f1d6 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:04.279324 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca6eb9-a8a2-4fb6-910e-c0325723f1d6 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:04.281199 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 399/818] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:13:04.286421 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbdccd-c562-48f5-ba58-639d0d7b7987 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:04.286815 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbdccd-c562-48f5-ba58-639d0d7b7987 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:04.286968 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbdccd-c562-48f5-ba58-639d0d7b7987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:04.305078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-7ecbdccd-c562-48f5-ba58-639d0d7b7987 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:13:04.306246 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7ecbdccd-c562-48f5-ba58-639d0d7b7987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:13:04.371349 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 420/819] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:13:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 13:13:04.637307 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca6eb9-a8a2-4fb6-910e-c0325723f1d6 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:04.681477 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:04.747434 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca6eb9-a8a2-4fb6-910e-c0325723f1d6 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:04.782245 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c57088-e9b2-4321-88d8-da0168d1a2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:04.782859 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c57088-e9b2-4321-88d8-da0168d1a2d8 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:04.783135 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c57088-e9b2-4321-88d8-da0168d1a2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:04.783403 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c57088-e9b2-4321-88d8-da0168d1a2d8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:04.793501 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c57088-e9b2-4321-88d8-da0168d1a2d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:13:04.798761 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-a0c57088-e9b2-4321-88d8-da0168d1a2d8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 25 13:13:04.798761 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:13:04.798761 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:13:04.798761 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:13:04.798761 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:13:04.798761 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:13:04.798761 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:13:04.798761 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:13:04.798761 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:13:04.798761 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:13:04.798761 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:13:04.798761 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:13:04.798761 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:13:04.798761 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:13:04.798761 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:13:04.798761 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:13:04.799984 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:13:04.799984 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:13:04.799984 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:13:04.799984 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:13:04.799984 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:13:04.799984 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:13:04.799984 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:13:04.799984 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:13:04.799984 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:13:04.799984 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:13:04.799984 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:13:04.799984 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:13:04.799984 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:13:04.799984 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:13:04.799984 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:13:04.799984 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:13:04.800936 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:13:04.800936 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:13:04.800936 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:13:04.800936 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:13:04.800936 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:13:04.800936 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:13:04.800936 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:13:04.800936 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:13:04.800936 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:13:04.800936 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:13:04.800936 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 25 13:13:04.800936 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:13:04.800936 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 400/820] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Oct 25 13:13:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:13:04.805970 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbdccd-c562-48f5-ba58-639d0d7b7987 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:04.814926 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10271c62-2d3a-44a8-bd22-7eddbcbd3fc6 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:04.815213 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10271c62-2d3a-44a8-bd22-7eddbcbd3fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:04.815489 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10271c62-2d3a-44a8-bd22-7eddbcbd3fc6 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:04.816890 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 401/821] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 13:13:04.821833 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787d474-b508-4786-ae54-8fb0108888c2 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:04.822144 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787d474-b508-4786-ae54-8fb0108888c2 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:04.822430 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787d474-b508-4786-ae54-8fb0108888c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:04.877057 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:04.918359 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbdccd-c562-48f5-ba58-639d0d7b7987 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:04.956811 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fd280-237e-4613-9959-2a554e0bde72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:04.957619 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fd280-237e-4613-9959-2a554e0bde72 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:04.958070 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fd280-237e-4613-9959-2a554e0bde72 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:04.958531 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fd280-237e-4613-9959-2a554e0bde72 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:04.959596 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138fd280-237e-4613-9959-2a554e0bde72 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:13:04.959698 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-e787d474-b508-4786-ae54-8fb0108888c2 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:13:04.960126 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138fd280-237e-4613-9959-2a554e0bde72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:04.961451 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-e787d474-b508-4786-ae54-8fb0108888c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:13:04.962482 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138fd280-237e-4613-9959-2a554e0bde72 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:04.975308 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 421/822] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Oct 25 13:13:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:13:04.980908 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fd280-237e-4613-9959-2a554e0bde72 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:05.037027 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 402/823] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:13:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 25 13:13:05.080424 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fd280-237e-4613-9959-2a554e0bde72 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:05.105240 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:05.113232 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7af25c-f030-4813-ab2f-1017bb808909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:05.113847 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7af25c-f030-4813-ab2f-1017bb808909 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:05.114121 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7af25c-f030-4813-ab2f-1017bb808909 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:05.114413 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7af25c-f030-4813-ab2f-1017bb808909 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:05.125521 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7af25c-f030-4813-ab2f-1017bb808909 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:05.126954 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7af25c-f030-4813-ab2f-1017bb808909 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:05.140902 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-bc7af25c-f030-4813-ab2f-1017bb808909 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:13:05.140902 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:13:05.140902 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:13:05.140902 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:13:05.140902 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:13:05.140902 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:13:05.140902 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:13:05.140902 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:13:05.140902 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:13:05.140902 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:13:05.140902 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:13:05.140902 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:13:05.140902 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:13:05.140902 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:13:05.140902 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:13:05.140902 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:13:05.141903 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:13:05.141903 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:13:05.141903 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:13:05.141903 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:13:05.141903 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:13:05.141903 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:13:05.141903 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:13:05.141903 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:13:05.141903 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:13:05.141903 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:13:05.141903 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:13:05.141903 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:13:05.141903 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:13:05.141903 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:13:05.141903 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:13:05.141903 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:13:05.141903 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:13:05.142849 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:13:05.142849 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:13:05.142849 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:13:05.142849 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 422/824] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:13:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 13:13:05.147808 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e787d474-b508-4786-ae54-8fb0108888c2 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:05.177929 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:05.245151 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e787d474-b508-4786-ae54-8fb0108888c2 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:05.277797 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c344c48-a32d-4848-beb0-2ecc926e0fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:05.278391 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c344c48-a32d-4848-beb0-2ecc926e0fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:05.278671 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c344c48-a32d-4848-beb0-2ecc926e0fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:05.278944 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c344c48-a32d-4848-beb0-2ecc926e0fb0 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:05.279573 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c344c48-a32d-4848-beb0-2ecc926e0fb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:13:05.279876 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c344c48-a32d-4848-beb0-2ecc926e0fb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:05.281294 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c344c48-a32d-4848-beb0-2ecc926e0fb0 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:05.292253 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 403/825] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:13:05.299247 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7af25c-f030-4813-ab2f-1017bb808909 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:05.304418 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c344c48-a32d-4848-beb0-2ecc926e0fb0 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:05.393215 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:05.400641 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7af25c-f030-4813-ab2f-1017bb808909 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:05.403038 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c344c48-a32d-4848-beb0-2ecc926e0fb0 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:05.434608 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2e1fa-cc92-43f1-9b19-e8b436b1e48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:05.435169 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2e1fa-cc92-43f1-9b19-e8b436b1e48a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:05.435446 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2e1fa-cc92-43f1-9b19-e8b436b1e48a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:05.435719 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2e1fa-cc92-43f1-9b19-e8b436b1e48a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:05.436880 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a53593-b931-4952-9ec0-2d8e91e1a4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:05.437648 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a53593-b931-4952-9ec0-2d8e91e1a4dd None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:05.437925 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a53593-b931-4952-9ec0-2d8e91e1a4dd None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:05.438197 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a53593-b931-4952-9ec0-2d8e91e1a4dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:05.443659 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab2e1fa-cc92-43f1-9b19-e8b436b1e48a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:05.445117 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab2e1fa-cc92-43f1-9b19-e8b436b1e48a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:05.448461 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a53593-b931-4952-9ec0-2d8e91e1a4dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:13:05.453297 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-e9a53593-b931-4952-9ec0-2d8e91e1a4dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 13:13:05.453297 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:13:05.453297 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:13:05.453297 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:13:05.453297 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:13:05.453297 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:13:05.453297 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:13:05.453297 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:13:05.453297 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:13:05.453297 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:13:05.453297 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:13:05.453297 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:13:05.453297 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:13:05.453297 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:13:05.453297 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:13:05.453297 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:13:05.454223 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:13:05.454223 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:13:05.454223 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:13:05.454223 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:13:05.454223 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:13:05.454223 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:13:05.454223 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:13:05.454223 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:13:05.454223 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:13:05.454223 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:13:05.454223 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:13:05.454223 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:13:05.454223 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:13:05.454223 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:13:05.454223 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:13:05.454223 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:13:05.455155 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:13:05.455155 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:13:05.455155 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:13:05.455155 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:13:05.455155 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:13:05.455155 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:13:05.455155 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:13:05.455155 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:13:05.455155 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:13:05.455155 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:13:05.455155 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 13:13:05.455155 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:13:05.455155 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 404/826] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 25 13:13:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 13:13:05.456154 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-cab2e1fa-cc92-43f1-9b19-e8b436b1e48a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 25 13:13:05.456154 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:13:05.456154 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:13:05.456154 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:13:05.456154 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:13:05.456154 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:13:05.456154 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:13:05.456154 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:13:05.456154 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:13:05.456154 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:13:05.456154 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:13:05.456154 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:13:05.456154 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 25 13:13:05.456154 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 25 13:13:05.456154 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 25 13:13:05.456154 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 25 13:13:05.457795 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:13:05.457795 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:13:05.457795 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 25 13:13:05.457795 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:13:05.457795 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 25 13:13:05.457795 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:13:05.457795 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:13:05.457795 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:13:05.457795 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:13:05.457795 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:13:05.457795 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:13:05.457795 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:13:05.457795 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:13:05.457795 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:13:05.457795 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:13:05.457795 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:13:05.457795 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:13:05.457795 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:13:05.458925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:13:05.458925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:13:05.458925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 25 13:13:05.458925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 25 13:13:05.458925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 25 13:13:05.458925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 25 13:13:05.458925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 25 13:13:05.458925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 25 13:13:05.458925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 25 13:13:05.458925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:13:05.458925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 423/827] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Oct 25 13:13:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 13:13:05.460385 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a53593-b931-4952-9ec0-2d8e91e1a4dd None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:05.462722 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2e1fa-cc92-43f1-9b19-e8b436b1e48a None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:05.504517 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:05.558947 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a53593-b931-4952-9ec0-2d8e91e1a4dd None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:05.564614 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2e1fa-cc92-43f1-9b19-e8b436b1e48a None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:05.591801 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73b614-f94b-402b-adfe-ee7b93a3953a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:05.594667 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73b614-f94b-402b-adfe-ee7b93a3953a None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:05.594949 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73b614-f94b-402b-adfe-ee7b93a3953a None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:05.595223 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73b614-f94b-402b-adfe-ee7b93a3953a None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:05.595879 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da73b614-f94b-402b-adfe-ee7b93a3953a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:13:05.596202 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da73b614-f94b-402b-adfe-ee7b93a3953a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:05.597563 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da73b614-f94b-402b-adfe-ee7b93a3953a None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:05.597685 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea0271-b609-4afc-8adb-b940744080f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:05.598217 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea0271-b609-4afc-8adb-b940744080f2 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:05.598495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea0271-b609-4afc-8adb-b940744080f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:05.598775 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea0271-b609-4afc-8adb-b940744080f2 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:05.599500 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea0271-b609-4afc-8adb-b940744080f2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:13:05.599798 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea0271-b609-4afc-8adb-b940744080f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:05.601240 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea0271-b609-4afc-8adb-b940744080f2 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:05.606388 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 405/828] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 25 13:13:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:13:05.612289 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73b614-f94b-402b-adfe-ee7b93a3953a None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:05.622950 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 424/829] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Oct 25 13:13:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:13:05.624439 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea0271-b609-4afc-8adb-b940744080f2 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:05.627258 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:05.710619 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73b614-f94b-402b-adfe-ee7b93a3953a None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:05.721904 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:05.725580 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea0271-b609-4afc-8adb-b940744080f2 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:05.749038 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b34f3b-2626-4af3-bfb5-05e84dc3b9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:05.749738 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b34f3b-2626-4af3-bfb5-05e84dc3b9ee None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:05.750017 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b34f3b-2626-4af3-bfb5-05e84dc3b9ee None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:05.750292 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b34f3b-2626-4af3-bfb5-05e84dc3b9ee None admin] PATH_INFO: `/v3/users/d15fd9f1dee14293a8de8c8e1a76e5a6` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:05.751429 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b34f3b-2626-4af3-bfb5-05e84dc3b9ee None admin] RBAC: Authorizing `identity:get_user(user_id=d15fd9f1dee14293a8de8c8e1a76e5a6)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:05.752881 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b34f3b-2626-4af3-bfb5-05e84dc3b9ee None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:05.754458 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 406/830] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 25 13:13:05 2022] GET /identity/v3/users/d15fd9f1dee14293a8de8c8e1a76e5a6 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:13:05.760102 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b34f3b-2626-4af3-bfb5-05e84dc3b9ee None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:05.761081 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8795e4-dcc0-426f-8d09-26d8180c05b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:05.761688 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8795e4-dcc0-426f-8d09-26d8180c05b1 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:05.761969 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8795e4-dcc0-426f-8d09-26d8180c05b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:05.762242 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8795e4-dcc0-426f-8d09-26d8180c05b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:05.829048 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8795e4-dcc0-426f-8d09-26d8180c05b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:05.830481 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8795e4-dcc0-426f-8d09-26d8180c05b1 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:05.840173 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:05.859843 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b34f3b-2626-4af3-bfb5-05e84dc3b9ee None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:05.893534 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8d50b-2e66-4976-a409-1605bf79722f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:05.894127 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8d50b-2e66-4976-a409-1605bf79722f None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:05.894408 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8d50b-2e66-4976-a409-1605bf79722f None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:05.894680 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8d50b-2e66-4976-a409-1605bf79722f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:05.924594 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:05.928846 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 425/831] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 25 13:13:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 25 13:13:05.934563 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8795e4-dcc0-426f-8d09-26d8180c05b1 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:05.961907 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b8d50b-2e66-4976-a409-1605bf79722f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:05.963310 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b8d50b-2e66-4976-a409-1605bf79722f None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:06.033800 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8795e4-dcc0-426f-8d09-26d8180c05b1 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:06.041907 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:06.062675 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 407/832] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 25 13:13:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 25 13:13:06.068634 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8d50b-2e66-4976-a409-1605bf79722f None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:06.069068 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89675a-fdbf-4f27-84f4-4678643199ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:06.069697 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89675a-fdbf-4f27-84f4-4678643199ce None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:06.069976 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89675a-fdbf-4f27-84f4-4678643199ce None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:06.070250 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89675a-fdbf-4f27-84f4-4678643199ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:06.080873 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb89675a-fdbf-4f27-84f4-4678643199ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:06.082302 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb89675a-fdbf-4f27-84f4-4678643199ce None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:06.096983 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-cb89675a-fdbf-4f27-84f4-4678643199ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:13:06.096983 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:13:06.096983 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:13:06.096983 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:13:06.096983 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:13:06.096983 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:13:06.096983 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:13:06.096983 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:13:06.096983 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:13:06.096983 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:13:06.096983 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:13:06.096983 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:13:06.096983 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:13:06.096983 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:13:06.096983 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:13:06.096983 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:13:06.098034 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:13:06.098034 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:13:06.098034 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:13:06.098034 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:13:06.098034 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:13:06.098034 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:13:06.098034 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:13:06.098034 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:13:06.098034 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:13:06.098034 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:13:06.098034 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:13:06.098034 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:13:06.098034 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:13:06.098034 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:13:06.098034 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:13:06.098034 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:13:06.098034 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:13:06.098919 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:13:06.098919 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:13:06.098919 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:13:06.098919 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 426/833] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:13:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 13:13:06.103720 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89675a-fdbf-4f27-84f4-4678643199ce None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:06.154835 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:06.166947 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8d50b-2e66-4976-a409-1605bf79722f None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:06.201061 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987aeec5-f005-447e-a910-a6eebba001f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:06.201670 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987aeec5-f005-447e-a910-a6eebba001f1 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:06.201991 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987aeec5-f005-447e-a910-a6eebba001f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:06.202813 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987aeec5-f005-447e-a910-a6eebba001f1 None admin] PATH_INFO: `/v3/projects/4886db4167754f3c8957bf8a9ccfc6da` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:06.203917 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987aeec5-f005-447e-a910-a6eebba001f1 None admin] RBAC: Authorizing `identity:get_project(project_id=4886db4167754f3c8957bf8a9ccfc6da)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:06.205431 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987aeec5-f005-447e-a910-a6eebba001f1 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:06.206569 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89675a-fdbf-4f27-84f4-4678643199ce None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:06.207042 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 408/834] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 25 13:13:06 2022] GET /identity/v3/projects/4886db4167754f3c8957bf8a9ccfc6da => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:13:06.213034 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987aeec5-f005-447e-a910-a6eebba001f1 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:06.242085 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1fe532-a8d4-4d9f-88a8-c98812da7729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:06.242679 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fe532-a8d4-4d9f-88a8-c98812da7729 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:06.242955 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fe532-a8d4-4d9f-88a8-c98812da7729 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:06.243234 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fe532-a8d4-4d9f-88a8-c98812da7729 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:06.244182 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1fe532-a8d4-4d9f-88a8-c98812da7729 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:13:06.244481 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1fe532-a8d4-4d9f-88a8-c98812da7729 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:06.245835 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1fe532-a8d4-4d9f-88a8-c98812da7729 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:06.257610 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 427/835] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:13:06.261288 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:06.263207 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1fe532-a8d4-4d9f-88a8-c98812da7729 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:06.311545 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987aeec5-f005-447e-a910-a6eebba001f1 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:06.347293 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5740f9-cc2c-4e5f-ac1a-7e2c6651fc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:06.347886 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5740f9-cc2c-4e5f-ac1a-7e2c6651fc96 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:06.348183 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5740f9-cc2c-4e5f-ac1a-7e2c6651fc96 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:06.348452 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5740f9-cc2c-4e5f-ac1a-7e2c6651fc96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:06.349162 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5740f9-cc2c-4e5f-ac1a-7e2c6651fc96 None admin] RBAC: Adding query filter params (role.id=4c7114fda3ec4652abed55516b5f4315, scope.project.id=4886db4167754f3c8957bf8a9ccfc6da, user.id=d15fd9f1dee14293a8de8c8e1a76e5a6) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:13:06.349467 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5740f9-cc2c-4e5f-ac1a-7e2c6651fc96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:06.350876 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5740f9-cc2c-4e5f-ac1a-7e2c6651fc96 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:06.356601 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 409/836] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 25 13:13:06 2022] GET /identity/v3/role_assignments?user.id=d15fd9f1dee14293a8de8c8e1a76e5a6&scope.project.id=4886db4167754f3c8957bf8a9ccfc6da&role.id=4c7114fda3ec4652abed55516b5f4315 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:13:06.362192 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1fe532-a8d4-4d9f-88a8-c98812da7729 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:06.375027 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:06.401912 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24da35-e0f8-44f5-a927-41213ccb7741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:06.402555 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24da35-e0f8-44f5-a927-41213ccb7741 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:06.402833 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24da35-e0f8-44f5-a927-41213ccb7741 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:06.403108 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24da35-e0f8-44f5-a927-41213ccb7741 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:06.411551 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24da35-e0f8-44f5-a927-41213ccb7741 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:06.413069 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24da35-e0f8-44f5-a927-41213ccb7741 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:06.426340 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-da24da35-e0f8-44f5-a927-41213ccb7741 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:13:06.426340 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:13:06.426340 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:13:06.426340 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:13:06.426340 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:13:06.426340 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:13:06.426340 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:13:06.426340 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:13:06.426340 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:13:06.426340 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:13:06.426340 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:13:06.426340 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:13:06.426340 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 25 13:13:06.426340 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 25 13:13:06.426340 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 25 13:13:06.427347 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 25 13:13:06.427347 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:13:06.427347 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:13:06.427347 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:13:06.427347 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:13:06.427347 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:13:06.427347 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:13:06.427347 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:13:06.427347 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:13:06.427347 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:13:06.427347 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:13:06.427347 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:13:06.427347 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:13:06.427347 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:13:06.427347 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:13:06.427347 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:13:06.427347 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:13:06.428371 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 25 13:13:06.428371 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 25 13:13:06.428371 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 25 13:13:06.428371 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 25 13:13:06.428371 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 25 13:13:06.428371 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 25 13:13:06.428371 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:13:06.428371 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:13:06.428371 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 428/837] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 25 13:13:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 13:13:06.433658 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5740f9-cc2c-4e5f-ac1a-7e2c6651fc96 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:06.540493 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5740f9-cc2c-4e5f-ac1a-7e2c6651fc96 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:06.554646 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:06.577366 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabab991-6a81-4cd9-893c-a8d81005b2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:06.577972 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabab991-6a81-4cd9-893c-a8d81005b2bf None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:06.578250 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabab991-6a81-4cd9-893c-a8d81005b2bf None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:06.578522 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabab991-6a81-4cd9-893c-a8d81005b2bf None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:06.579210 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabab991-6a81-4cd9-893c-a8d81005b2bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:13:06.579513 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabab991-6a81-4cd9-893c-a8d81005b2bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:06.580971 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabab991-6a81-4cd9-893c-a8d81005b2bf None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:06.593849 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 410/838] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 25 13:13:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:13:06.599878 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24da35-e0f8-44f5-a927-41213ccb7741 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:06.700259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24da35-e0f8-44f5-a927-41213ccb7741 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:06.736257 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc0b08-cfdb-42ab-a388-6468035a10a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:06.736856 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc0b08-cfdb-42ab-a388-6468035a10a0 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:06.737133 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc0b08-cfdb-42ab-a388-6468035a10a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:06.737404 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc0b08-cfdb-42ab-a388-6468035a10a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:06.738114 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc0b08-cfdb-42ab-a388-6468035a10a0 None admin] RBAC: Adding query filter params (role.id=3e0f611d78184eac9855bafdbdd78a7c, scope.project.id=616ecfe8d2c74aad9386720718392e81, user.id=63e73c00cadb4deea934db6111ed76d5) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:13:06.738419 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc0b08-cfdb-42ab-a388-6468035a10a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:06.739836 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc0b08-cfdb-42ab-a388-6468035a10a0 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:06.745446 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 429/839] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 25 13:13:06 2022] GET /identity/v3/role_assignments?user.id=63e73c00cadb4deea934db6111ed76d5&scope.project.id=616ecfe8d2c74aad9386720718392e81&role.id=3e0f611d78184eac9855bafdbdd78a7c => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:13:08.518100 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0556ff2-617b-4327-9436-1cdd61559f88 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:08.518661 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0556ff2-617b-4327-9436-1cdd61559f88 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:08.518661 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0556ff2-617b-4327-9436-1cdd61559f88 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:08.520000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 411/840] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:13:08.525091 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd16b5-6f6f-4d4f-a6aa-2e2f3f5ecdec None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:08.525506 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd16b5-6f6f-4d4f-a6aa-2e2f3f5ecdec None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:08.525635 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd16b5-6f6f-4d4f-a6aa-2e2f3f5ecdec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:08.544499 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-fefd16b5-6f6f-4d4f-a6aa-2e2f3f5ecdec None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:13:08.545696 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fefd16b5-6f6f-4d4f-a6aa-2e2f3f5ecdec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:13:08.571618 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:08.610907 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 430/841] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:13:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 13:13:08.886318 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0556ff2-617b-4327-9436-1cdd61559f88 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:08.985797 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0556ff2-617b-4327-9436-1cdd61559f88 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:09.018355 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7757f-41c6-40fb-ae0d-8692142ae481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:09.018964 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7757f-41c6-40fb-ae0d-8692142ae481 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:09.019238 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7757f-41c6-40fb-ae0d-8692142ae481 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:09.019506 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7757f-41c6-40fb-ae0d-8692142ae481 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:09.020616 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c7757f-41c6-40fb-ae0d-8692142ae481 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:09.022028 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c7757f-41c6-40fb-ae0d-8692142ae481 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:09.023562 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 412/842] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:13:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:13:09.029272 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd16b5-6f6f-4d4f-a6aa-2e2f3f5ecdec None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:09.125239 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd16b5-6f6f-4d4f-a6aa-2e2f3f5ecdec None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:09.272118 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b590ee-7097-4d71-bb4b-e3b4cf61f03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:09.272709 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b590ee-7097-4d71-bb4b-e3b4cf61f03c None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:09.272988 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b590ee-7097-4d71-bb4b-e3b4cf61f03c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:09.273256 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b590ee-7097-4d71-bb4b-e3b4cf61f03c None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:09.273902 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b590ee-7097-4d71-bb4b-e3b4cf61f03c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:09.275283 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b590ee-7097-4d71-bb4b-e3b4cf61f03c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:09.297668 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 431/843] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 25 13:13:09 2022] POST /identity/v3/users => generated 286 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:13:11.461327 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e0d44-7e43-4fa0-9757-58e6fbdcf7d7 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:11.461849 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e0d44-7e43-4fa0-9757-58e6fbdcf7d7 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:11.461849 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e0d44-7e43-4fa0-9757-58e6fbdcf7d7 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:11.463210 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 413/844] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:13:11.469058 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d99754-1b67-47f0-909c-f565d18b0cc6 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:11.469494 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d99754-1b67-47f0-909c-f565d18b0cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:11.469594 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d99754-1b67-47f0-909c-f565d18b0cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:11.487723 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-75d99754-1b67-47f0-909c-f565d18b0cc6 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:13:11.488940 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-75d99754-1b67-47f0-909c-f565d18b0cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:13:11.503023 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:11.554014 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 432/845] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:13:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 25 13:13:11.824170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e0d44-7e43-4fa0-9757-58e6fbdcf7d7 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:11.866228 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:11.923659 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e0d44-7e43-4fa0-9757-58e6fbdcf7d7 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:11.956337 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcebab1e-c2b8-4ead-89aa-4c370ce3bca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:11.956941 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcebab1e-c2b8-4ead-89aa-4c370ce3bca2 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:11.957215 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcebab1e-c2b8-4ead-89aa-4c370ce3bca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:11.957482 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcebab1e-c2b8-4ead-89aa-4c370ce3bca2 None admin] PATH_INFO: `/v3/roles/955523e4392d4c278c29f6ce715a5ae6` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:11.958838 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcebab1e-c2b8-4ead-89aa-4c370ce3bca2 None admin] RBAC: Authorizing `identity:get_role(role_id=955523e4392d4c278c29f6ce715a5ae6)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:11.960211 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcebab1e-c2b8-4ead-89aa-4c370ce3bca2 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:11.961503 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 414/846] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 25 13:13:11 2022] GET /identity/v3/roles/955523e4392d4c278c29f6ce715a5ae6 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:13:11.967209 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d99754-1b67-47f0-909c-f565d18b0cc6 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:12.062412 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d99754-1b67-47f0-909c-f565d18b0cc6 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:12.094597 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb61c45-3768-471b-a683-8f3391313fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:12.095221 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb61c45-3768-471b-a683-8f3391313fde None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:12.095500 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb61c45-3768-471b-a683-8f3391313fde None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:12.095772 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb61c45-3768-471b-a683-8f3391313fde None admin] PATH_INFO: `/v3/users/f62918091da046dbb07a19ba72c8c3c7` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:12.109077 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb61c45-3768-471b-a683-8f3391313fde None admin] RBAC: Authorizing `identity:get_user(user_id=f62918091da046dbb07a19ba72c8c3c7)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:12.110350 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb61c45-3768-471b-a683-8f3391313fde None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:12.111919 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 433/847] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 25 13:13:11 2022] GET /identity/v3/users/f62918091da046dbb07a19ba72c8c3c7 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:13:12.117462 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcebab1e-c2b8-4ead-89aa-4c370ce3bca2 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:12.214520 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcebab1e-c2b8-4ead-89aa-4c370ce3bca2 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:12.223793 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:12.248456 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3ffef-d2da-4e3e-995b-410db202da05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:12.249593 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3ffef-d2da-4e3e-995b-410db202da05 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:12.249863 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3ffef-d2da-4e3e-995b-410db202da05 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:12.250128 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3ffef-d2da-4e3e-995b-410db202da05 None admin] PATH_INFO: `/v3/projects/4886db4167754f3c8957bf8a9ccfc6da` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:12.251207 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e3ffef-d2da-4e3e-995b-410db202da05 None admin] RBAC: Authorizing `identity:get_project(project_id=4886db4167754f3c8957bf8a9ccfc6da)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:12.252635 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e3ffef-d2da-4e3e-995b-410db202da05 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:12.254206 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 415/848] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 25 13:13:12 2022] GET /identity/v3/projects/4886db4167754f3c8957bf8a9ccfc6da => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:13:12.260045 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb61c45-3768-471b-a683-8f3391313fde None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:12.271028 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:12.356984 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb61c45-3768-471b-a683-8f3391313fde None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:12.389924 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43684f2-7819-436a-b62b-2f33f0c7f34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:12.390567 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43684f2-7819-436a-b62b-2f33f0c7f34d None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:12.390845 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43684f2-7819-436a-b62b-2f33f0c7f34d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:12.391119 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43684f2-7819-436a-b62b-2f33f0c7f34d None admin] PATH_INFO: `/v3/projects/4886db4167754f3c8957bf8a9ccfc6da/users/f62918091da046dbb07a19ba72c8c3c7/roles/955523e4392d4c278c29f6ce715a5ae6` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:12.393259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43684f2-7819-436a-b62b-2f33f0c7f34d None admin] RBAC: Authorizing `identity:create_grant(project_id=4886db4167754f3c8957bf8a9ccfc6da, user_id=f62918091da046dbb07a19ba72c8c3c7, role_id=955523e4392d4c278c29f6ce715a5ae6)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:12.394669 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43684f2-7819-436a-b62b-2f33f0c7f34d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:12.407358 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 434/849] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 25 13:13:12 2022] PUT /identity/v3/projects/4886db4167754f3c8957bf8a9ccfc6da/users/f62918091da046dbb07a19ba72c8c3c7/roles/955523e4392d4c278c29f6ce715a5ae6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:13:14.522432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84330d5-0dac-428d-848e-c6f991ba7271 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:14.522981 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84330d5-0dac-428d-848e-c6f991ba7271 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:14.522981 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84330d5-0dac-428d-848e-c6f991ba7271 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:14.524351 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 416/850] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:13:14.529647 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53576011-f53b-49d7-9e54-30ecdf329a16 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:14.530633 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53576011-f53b-49d7-9e54-30ecdf329a16 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:14.530801 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53576011-f53b-49d7-9e54-30ecdf329a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:14.548677 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-53576011-f53b-49d7-9e54-30ecdf329a16 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:13:14.549847 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-53576011-f53b-49d7-9e54-30ecdf329a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:13:14.610039 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:14.615968 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 435/851] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:13:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 13:13:14.885156 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84330d5-0dac-428d-848e-c6f991ba7271 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:14.984336 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84330d5-0dac-428d-848e-c6f991ba7271 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:15.017249 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b08f4c-c0db-401e-a4eb-19f690481fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:15.017857 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b08f4c-c0db-401e-a4eb-19f690481fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:15.018133 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b08f4c-c0db-401e-a4eb-19f690481fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:15.018406 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b08f4c-c0db-401e-a4eb-19f690481fb9 None admin] PATH_INFO: `/v3/roles/955523e4392d4c278c29f6ce715a5ae6` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:15.019768 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b08f4c-c0db-401e-a4eb-19f690481fb9 None admin] RBAC: Authorizing `identity:get_role(role_id=955523e4392d4c278c29f6ce715a5ae6)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:15.021203 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b08f4c-c0db-401e-a4eb-19f690481fb9 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:15.022503 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 417/852] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 25 13:13:14 2022] GET /identity/v3/roles/955523e4392d4c278c29f6ce715a5ae6 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:13:15.028250 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53576011-f53b-49d7-9e54-30ecdf329a16 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:15.123163 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53576011-f53b-49d7-9e54-30ecdf329a16 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:15.155679 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0a702-98b1-434b-8fcd-43fc16054f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:15.156320 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0a702-98b1-434b-8fcd-43fc16054f85 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:15.156601 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0a702-98b1-434b-8fcd-43fc16054f85 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:15.156871 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0a702-98b1-434b-8fcd-43fc16054f85 None admin] PATH_INFO: `/v3/users/f62918091da046dbb07a19ba72c8c3c7` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:15.157968 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b0a702-98b1-434b-8fcd-43fc16054f85 None admin] RBAC: Authorizing `identity:get_user(user_id=f62918091da046dbb07a19ba72c8c3c7)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:15.159365 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b0a702-98b1-434b-8fcd-43fc16054f85 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:15.160974 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 436/853] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 25 13:13:15 2022] GET /identity/v3/users/f62918091da046dbb07a19ba72c8c3c7 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:13:15.166562 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b08f4c-c0db-401e-a4eb-19f690481fb9 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:15.211670 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:15.263793 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b08f4c-c0db-401e-a4eb-19f690481fb9 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:15.296345 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468dada9-1488-4834-a8fd-596ec1fcd290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:15.296929 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468dada9-1488-4834-a8fd-596ec1fcd290 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:15.297203 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468dada9-1488-4834-a8fd-596ec1fcd290 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:15.297471 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468dada9-1488-4834-a8fd-596ec1fcd290 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:15.364246 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468dada9-1488-4834-a8fd-596ec1fcd290 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:15.365675 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468dada9-1488-4834-a8fd-596ec1fcd290 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:15.407947 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:15.460780 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 418/854] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 25 13:13:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 25 13:13:15.466719 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0a702-98b1-434b-8fcd-43fc16054f85 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:15.530904 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:15.565312 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0a702-98b1-434b-8fcd-43fc16054f85 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:15.598033 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b2f77-d10f-4626-a8f1-804c0714e0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:15.598645 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b2f77-d10f-4626-a8f1-804c0714e0f0 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:15.598922 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b2f77-d10f-4626-a8f1-804c0714e0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:15.599198 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b2f77-d10f-4626-a8f1-804c0714e0f0 None admin] PATH_INFO: `/v3/projects/4886db4167754f3c8957bf8a9ccfc6da` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:15.600317 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b2f77-d10f-4626-a8f1-804c0714e0f0 None admin] RBAC: Authorizing `identity:get_project(project_id=4886db4167754f3c8957bf8a9ccfc6da)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:15.601721 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b2f77-d10f-4626-a8f1-804c0714e0f0 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:15.603293 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 437/855] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 25 13:13:15 2022] GET /identity/v3/projects/4886db4167754f3c8957bf8a9ccfc6da => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:13:15.610606 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468dada9-1488-4834-a8fd-596ec1fcd290 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:15.707676 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468dada9-1488-4834-a8fd-596ec1fcd290 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:15.741888 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f6746-f2c9-4324-934e-9c52b2b44f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:15.742477 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f6746-f2c9-4324-934e-9c52b2b44f0c None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:15.742749 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f6746-f2c9-4324-934e-9c52b2b44f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:15.743011 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f6746-f2c9-4324-934e-9c52b2b44f0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:15.743708 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f6746-f2c9-4324-934e-9c52b2b44f0c None admin] RBAC: Adding query filter params (role.id=955523e4392d4c278c29f6ce715a5ae6, scope.project.id=4886db4167754f3c8957bf8a9ccfc6da, user.id=f62918091da046dbb07a19ba72c8c3c7) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:13:15.744035 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f6746-f2c9-4324-934e-9c52b2b44f0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:15.745428 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f6746-f2c9-4324-934e-9c52b2b44f0c None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:15.751551 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 419/856] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 25 13:13:15 2022] GET /identity/v3/role_assignments?user.id=f62918091da046dbb07a19ba72c8c3c7&scope.project.id=4886db4167754f3c8957bf8a9ccfc6da&role.id=955523e4392d4c278c29f6ce715a5ae6 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:13:18.025008 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317f1cb-18db-4810-bdcb-d8bb8c42a4c2 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:18.025536 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317f1cb-18db-4810-bdcb-d8bb8c42a4c2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:18.025536 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317f1cb-18db-4810-bdcb-d8bb8c42a4c2 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:18.026801 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 438/857] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:13:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:13:18.032959 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0550e-bfe4-4732-938c-b85bc024e2c3 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:18.033376 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0550e-bfe4-4732-938c-b85bc024e2c3 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:18.033507 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0550e-bfe4-4732-938c-b85bc024e2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:18.051520 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-25c0550e-bfe4-4732-938c-b85bc024e2c3 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:13:18.052729 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-25c0550e-bfe4-4732-938c-b85bc024e2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:13:18.054633 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:18.117331 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 420/858] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:13:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 13:13:18.387695 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317f1cb-18db-4810-bdcb-d8bb8c42a4c2 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:18.484851 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317f1cb-18db-4810-bdcb-d8bb8c42a4c2 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:18.517974 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea802a-8171-4b93-b5b8-ea41f44e9f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:18.518583 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea802a-8171-4b93-b5b8-ea41f44e9f46 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:18.518861 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea802a-8171-4b93-b5b8-ea41f44e9f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:18.519133 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea802a-8171-4b93-b5b8-ea41f44e9f46 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:18.520248 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea802a-8171-4b93-b5b8-ea41f44e9f46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:18.521655 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea802a-8171-4b93-b5b8-ea41f44e9f46 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:18.523222 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 439/859] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:13:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:13:18.528925 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0550e-bfe4-4732-938c-b85bc024e2c3 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:18.623410 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0550e-bfe4-4732-938c-b85bc024e2c3 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:18.656784 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf989cf3-09a7-43c6-a768-2346f45f01d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:18.657374 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf989cf3-09a7-43c6-a768-2346f45f01d1 None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:18.657648 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf989cf3-09a7-43c6-a768-2346f45f01d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:18.657914 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf989cf3-09a7-43c6-a768-2346f45f01d1 None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:18.658561 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf989cf3-09a7-43c6-a768-2346f45f01d1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:18.659996 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf989cf3-09a7-43c6-a768-2346f45f01d1 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:18.669150 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:18.686995 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 421/860] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Oct 25 13:13:18 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:13:20.855573 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc22343-3403-4f50-bb2a-9bf3d4898458 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:20.856152 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc22343-3403-4f50-bb2a-9bf3d4898458 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:20.856152 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc22343-3403-4f50-bb2a-9bf3d4898458 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:20.857473 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 440/861] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:13:20.863344 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fa585-9937-4e68-92ad-ec257b21bbc2 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:20.863772 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fa585-9937-4e68-92ad-ec257b21bbc2 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:20.863874 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fa585-9937-4e68-92ad-ec257b21bbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:20.881338 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-2a5fa585-9937-4e68-92ad-ec257b21bbc2 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:13:20.882495 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2a5fa585-9937-4e68-92ad-ec257b21bbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:13:20.946440 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 422/862] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:13:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 13:13:21.221049 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc22343-3403-4f50-bb2a-9bf3d4898458 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:21.223916 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:21.321890 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc22343-3403-4f50-bb2a-9bf3d4898458 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:21.354925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e41fd-8b4c-4daf-a593-0b8e5f03ce67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:21.355536 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e41fd-8b4c-4daf-a593-0b8e5f03ce67 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:21.355817 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e41fd-8b4c-4daf-a593-0b8e5f03ce67 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:21.356117 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e41fd-8b4c-4daf-a593-0b8e5f03ce67 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:21.357213 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e41fd-8b4c-4daf-a593-0b8e5f03ce67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:21.359304 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e41fd-8b4c-4daf-a593-0b8e5f03ce67 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:21.360863 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 441/863] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:13:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:13:21.366518 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5fa585-9937-4e68-92ad-ec257b21bbc2 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:21.461532 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5fa585-9937-4e68-92ad-ec257b21bbc2 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:21.481724 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:21.496405 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b295a0-9bce-429f-92c1-cc78e097a334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:21.496995 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b295a0-9bce-429f-92c1-cc78e097a334 None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:21.497272 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b295a0-9bce-429f-92c1-cc78e097a334 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:21.497540 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b295a0-9bce-429f-92c1-cc78e097a334 None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:21.498186 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b295a0-9bce-429f-92c1-cc78e097a334 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:21.500310 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b295a0-9bce-429f-92c1-cc78e097a334 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:21.520639 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 423/864] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 25 13:13:21 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:13:23.682869 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25cbcf-4205-45ca-958f-b173bb416e4f None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:23.683408 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25cbcf-4205-45ca-958f-b173bb416e4f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:23.683408 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25cbcf-4205-45ca-958f-b173bb416e4f None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:23.684762 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 442/865] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:13:23.690530 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7dfaa-2495-47ab-99f5-b41f62da23ef None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:23.690921 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7dfaa-2495-47ab-99f5-b41f62da23ef None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:23.691083 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7dfaa-2495-47ab-99f5-b41f62da23ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:23.709677 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-f6d7dfaa-2495-47ab-99f5-b41f62da23ef None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:13:23.710840 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-f6d7dfaa-2495-47ab-99f5-b41f62da23ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:13:23.775622 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 424/866] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:13:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 13:13:24.042357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a25cbcf-4205-45ca-958f-b173bb416e4f None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:24.110192 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:24.141831 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a25cbcf-4205-45ca-958f-b173bb416e4f None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:24.175125 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5246c-2297-4f86-8ec1-d3f016f2edf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:24.175737 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5246c-2297-4f86-8ec1-d3f016f2edf8 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:24.176050 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5246c-2297-4f86-8ec1-d3f016f2edf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:24.176325 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5246c-2297-4f86-8ec1-d3f016f2edf8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:24.185975 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a5246c-2297-4f86-8ec1-d3f016f2edf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:13:24.190699 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-91a5246c-2297-4f86-8ec1-d3f016f2edf8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 13:13:24.190699 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:13:24.190699 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:13:24.190699 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:13:24.190699 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:13:24.190699 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:13:24.190699 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:13:24.190699 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:13:24.190699 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:13:24.190699 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:13:24.190699 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:13:24.190699 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:13:24.190699 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:13:24.190699 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:13:24.190699 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:13:24.190699 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:13:24.191785 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:13:24.191785 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:13:24.191785 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:13:24.191785 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:13:24.191785 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:13:24.191785 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:13:24.191785 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:13:24.191785 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:13:24.191785 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:13:24.191785 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:13:24.191785 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:13:24.191785 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:13:24.191785 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:13:24.191785 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:13:24.191785 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:13:24.191785 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:13:24.192780 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:13:24.192780 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:13:24.192780 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:13:24.192780 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:13:24.192780 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:13:24.192780 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:13:24.192780 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:13:24.192780 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:13:24.192780 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:13:24.192780 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:13:24.192780 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 13:13:24.192780 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:13:24.192780 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 443/867] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 25 13:13:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:13:24.197729 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7dfaa-2495-47ab-99f5-b41f62da23ef None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:24.294125 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7dfaa-2495-47ab-99f5-b41f62da23ef None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:24.301037 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:24.330888 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232064d2-fcbe-480c-a322-13b8bc11f5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:24.331486 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232064d2-fcbe-480c-a322-13b8bc11f5b3 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:24.331764 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232064d2-fcbe-480c-a322-13b8bc11f5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:24.332070 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232064d2-fcbe-480c-a322-13b8bc11f5b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:24.332730 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232064d2-fcbe-480c-a322-13b8bc11f5b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:13:24.333031 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232064d2-fcbe-480c-a322-13b8bc11f5b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:24.334394 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232064d2-fcbe-480c-a322-13b8bc11f5b3 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:24.342363 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 425/868] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 25 13:13:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:13:24.348770 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5246c-2297-4f86-8ec1-d3f016f2edf8 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:24.444099 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5246c-2297-4f86-8ec1-d3f016f2edf8 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:24.471303 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:24.477130 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e650a6-0288-4f52-ae99-30576ba6f704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:24.477737 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e650a6-0288-4f52-ae99-30576ba6f704 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:24.478014 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e650a6-0288-4f52-ae99-30576ba6f704 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:24.478287 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e650a6-0288-4f52-ae99-30576ba6f704 None admin] PATH_INFO: `/v3/users/a5d87fc4bbc442b088858c76d2073fa2` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:24.490763 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e650a6-0288-4f52-ae99-30576ba6f704 None admin] RBAC: Authorizing `identity:get_user(user_id=a5d87fc4bbc442b088858c76d2073fa2)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:24.492213 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e650a6-0288-4f52-ae99-30576ba6f704 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:24.493754 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 444/869] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 25 13:13:24 2022] GET /identity/v3/users/a5d87fc4bbc442b088858c76d2073fa2 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:13:24.499972 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232064d2-fcbe-480c-a322-13b8bc11f5b3 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:24.596674 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232064d2-fcbe-480c-a322-13b8bc11f5b3 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:24.629028 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f196552-8b64-40a9-9b3c-a0544564ada7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:24.629646 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f196552-8b64-40a9-9b3c-a0544564ada7 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:24.629927 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f196552-8b64-40a9-9b3c-a0544564ada7 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:24.630203 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f196552-8b64-40a9-9b3c-a0544564ada7 None admin] PATH_INFO: `/v3/projects/9d8aca97c4794447ace3817077772050` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:24.631317 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f196552-8b64-40a9-9b3c-a0544564ada7 None admin] RBAC: Authorizing `identity:get_project(project_id=9d8aca97c4794447ace3817077772050)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:24.632765 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f196552-8b64-40a9-9b3c-a0544564ada7 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:24.634550 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 426/870] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 25 13:13:24 2022] GET /identity/v3/projects/9d8aca97c4794447ace3817077772050 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:13:24.640306 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e650a6-0288-4f52-ae99-30576ba6f704 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:24.737167 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e650a6-0288-4f52-ae99-30576ba6f704 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:24.769610 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ad578-8a66-47f6-bd97-1f2636c50f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:24.770249 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ad578-8a66-47f6-bd97-1f2636c50f9f None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:24.770523 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ad578-8a66-47f6-bd97-1f2636c50f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:24.770788 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ad578-8a66-47f6-bd97-1f2636c50f9f None admin] PATH_INFO: `/v3/projects/9d8aca97c4794447ace3817077772050/users/a5d87fc4bbc442b088858c76d2073fa2/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:24.772647 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ad578-8a66-47f6-bd97-1f2636c50f9f None admin] RBAC: Authorizing `identity:create_grant(project_id=9d8aca97c4794447ace3817077772050, user_id=a5d87fc4bbc442b088858c76d2073fa2, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:24.774046 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ad578-8a66-47f6-bd97-1f2636c50f9f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:24.786532 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 445/871] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 25 13:13:24 2022] PUT /identity/v3/projects/9d8aca97c4794447ace3817077772050/users/a5d87fc4bbc442b088858c76d2073fa2/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:13:26.917090 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d058f-76f7-4932-b835-a8ddac34c997 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:26.917606 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d058f-76f7-4932-b835-a8ddac34c997 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:26.917606 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d058f-76f7-4932-b835-a8ddac34c997 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:26.919206 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 427/872] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:13:26.924490 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7814f42-0074-444b-b922-f65bf505a751 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:26.924922 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7814f42-0074-444b-b922-f65bf505a751 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:26.925041 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7814f42-0074-444b-b922-f65bf505a751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:26.942624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f7814f42-0074-444b-b922-f65bf505a751 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:13:26.943787 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f7814f42-0074-444b-b922-f65bf505a751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:13:26.986611 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:27.010395 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 446/873] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:13:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 13:13:27.277841 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d058f-76f7-4932-b835-a8ddac34c997 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:27.314436 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:27.379854 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d058f-76f7-4932-b835-a8ddac34c997 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:27.412646 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba9913-3bd6-40bb-8b51-09ac010a2e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:27.413259 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba9913-3bd6-40bb-8b51-09ac010a2e41 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:27.413538 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba9913-3bd6-40bb-8b51-09ac010a2e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:27.413811 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba9913-3bd6-40bb-8b51-09ac010a2e41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:27.424410 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba9913-3bd6-40bb-8b51-09ac010a2e41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:13:27.429208 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-f9ba9913-3bd6-40bb-8b51-09ac010a2e41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 13:13:27.429208 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:13:27.429208 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:13:27.429208 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:13:27.429208 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:13:27.429208 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:13:27.429208 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:13:27.429208 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:13:27.429208 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:13:27.429208 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:13:27.429208 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:13:27.429208 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:13:27.429208 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:13:27.429208 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:13:27.429208 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:13:27.429208 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:13:27.430282 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:13:27.430282 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:13:27.430282 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:13:27.430282 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:13:27.430282 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:13:27.430282 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:13:27.430282 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:13:27.430282 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:13:27.430282 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:13:27.430282 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:13:27.430282 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:13:27.430282 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:13:27.430282 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:13:27.430282 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:13:27.430282 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:13:27.430282 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:13:27.431180 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:13:27.431180 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:13:27.431180 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:13:27.431180 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:13:27.431180 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:13:27.431180 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:13:27.431180 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:13:27.431180 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:13:27.431180 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:13:27.431180 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:13:27.431180 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 13:13:27.431180 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:13:27.431180 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 428/874] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 25 13:13:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:13:27.436965 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7814f42-0074-444b-b922-f65bf505a751 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:27.531350 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7814f42-0074-444b-b922-f65bf505a751 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:27.563719 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4af50-ae30-4d52-8d35-e3ca7dd13f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:27.564337 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4af50-ae30-4d52-8d35-e3ca7dd13f54 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:27.564618 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4af50-ae30-4d52-8d35-e3ca7dd13f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:27.564896 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4af50-ae30-4d52-8d35-e3ca7dd13f54 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:27.565542 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da4af50-ae30-4d52-8d35-e3ca7dd13f54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:13:27.565845 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da4af50-ae30-4d52-8d35-e3ca7dd13f54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:27.567225 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da4af50-ae30-4d52-8d35-e3ca7dd13f54 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:27.574828 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 447/875] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 25 13:13:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:13:27.580931 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba9913-3bd6-40bb-8b51-09ac010a2e41 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:27.673872 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:27.680206 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba9913-3bd6-40bb-8b51-09ac010a2e41 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:27.713178 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895442a-24e4-4013-bf32-2570190f8ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:27.713786 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895442a-24e4-4013-bf32-2570190f8ed1 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:27.714065 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895442a-24e4-4013-bf32-2570190f8ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:27.714337 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895442a-24e4-4013-bf32-2570190f8ed1 None admin] PATH_INFO: `/v3/users/a5d87fc4bbc442b088858c76d2073fa2` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:27.715486 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3895442a-24e4-4013-bf32-2570190f8ed1 None admin] RBAC: Authorizing `identity:get_user(user_id=a5d87fc4bbc442b088858c76d2073fa2)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:27.716946 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3895442a-24e4-4013-bf32-2570190f8ed1 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:27.719423 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 429/876] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 25 13:13:27 2022] GET /identity/v3/users/a5d87fc4bbc442b088858c76d2073fa2 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:13:27.725080 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4af50-ae30-4d52-8d35-e3ca7dd13f54 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:27.766031 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:27.823047 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4af50-ae30-4d52-8d35-e3ca7dd13f54 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:27.856256 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be9ea8-55ee-41d0-9e37-14ecff7296cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:27.856852 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be9ea8-55ee-41d0-9e37-14ecff7296cf None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:27.857130 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be9ea8-55ee-41d0-9e37-14ecff7296cf None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:27.857662 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be9ea8-55ee-41d0-9e37-14ecff7296cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:27.922874 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7be9ea8-55ee-41d0-9e37-14ecff7296cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:27.924363 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7be9ea8-55ee-41d0-9e37-14ecff7296cf None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:27.963024 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:28.020104 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 448/877] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 25 13:13:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 25 13:13:28.025915 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895442a-24e4-4013-bf32-2570190f8ed1 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:28.123150 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895442a-24e4-4013-bf32-2570190f8ed1 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:28.156099 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c2f93-1038-4fa0-be1e-2d3508ef27eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:28.156697 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c2f93-1038-4fa0-be1e-2d3508ef27eb None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:28.156974 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c2f93-1038-4fa0-be1e-2d3508ef27eb None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:28.157243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c2f93-1038-4fa0-be1e-2d3508ef27eb None admin] PATH_INFO: `/v3/projects/9d8aca97c4794447ace3817077772050` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:28.158357 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c2f93-1038-4fa0-be1e-2d3508ef27eb None admin] RBAC: Authorizing `identity:get_project(project_id=9d8aca97c4794447ace3817077772050)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:28.159764 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c2f93-1038-4fa0-be1e-2d3508ef27eb None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:28.161384 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 430/878] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 25 13:13:28 2022] GET /identity/v3/projects/9d8aca97c4794447ace3817077772050 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:13:28.167374 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be9ea8-55ee-41d0-9e37-14ecff7296cf None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:28.262530 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be9ea8-55ee-41d0-9e37-14ecff7296cf None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:28.296562 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187afe0-f45f-4cdd-a1dd-fba813cc0f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:28.297152 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187afe0-f45f-4cdd-a1dd-fba813cc0f8e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:28.297429 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187afe0-f45f-4cdd-a1dd-fba813cc0f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:28.297697 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187afe0-f45f-4cdd-a1dd-fba813cc0f8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:28.298401 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d187afe0-f45f-4cdd-a1dd-fba813cc0f8e None admin] RBAC: Adding query filter params (role.id=4c7114fda3ec4652abed55516b5f4315, scope.project.id=9d8aca97c4794447ace3817077772050, user.id=a5d87fc4bbc442b088858c76d2073fa2) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:13:28.298706 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d187afe0-f45f-4cdd-a1dd-fba813cc0f8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:28.300177 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d187afe0-f45f-4cdd-a1dd-fba813cc0f8e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:28.305652 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 449/879] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 25 13:13:28 2022] GET /identity/v3/role_assignments?user.id=a5d87fc4bbc442b088858c76d2073fa2&scope.project.id=9d8aca97c4794447ace3817077772050&role.id=4c7114fda3ec4652abed55516b5f4315 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:13:30.447863 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658a99a-cdce-446f-82c2-7d142c2f0fdc None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:30.448441 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658a99a-cdce-446f-82c2-7d142c2f0fdc None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:30.448441 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658a99a-cdce-446f-82c2-7d142c2f0fdc None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:30.449753 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 431/880] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:13:30.456106 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0e580-fb8e-4ef2-8495-64e25b2be748 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:30.456506 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0e580-fb8e-4ef2-8495-64e25b2be748 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:30.456658 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0e580-fb8e-4ef2-8495-64e25b2be748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:30.463754 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:30.475110 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c3a0e580-fb8e-4ef2-8495-64e25b2be748 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:13:30.476328 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c3a0e580-fb8e-4ef2-8495-64e25b2be748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:13:30.540418 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 450/881] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:13:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 13:13:30.808858 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658a99a-cdce-446f-82c2-7d142c2f0fdc None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:30.840130 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:30.908821 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658a99a-cdce-446f-82c2-7d142c2f0fdc None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:30.941830 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50352819-ef37-402d-a7bb-9c36045680ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:30.942415 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50352819-ef37-402d-a7bb-9c36045680ac None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:30.942691 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50352819-ef37-402d-a7bb-9c36045680ac None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:30.942959 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50352819-ef37-402d-a7bb-9c36045680ac None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:30.943628 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50352819-ef37-402d-a7bb-9c36045680ac None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:30.945005 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50352819-ef37-402d-a7bb-9c36045680ac None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:30.959968 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 432/882] 10.222.0.25 () {60 vars in 1138 bytes} [Tue Oct 25 13:13:30 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:13:33.209322 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8ea85-a19f-4668-abf4-66a1d18fe6aa None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:33.209941 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8ea85-a19f-4668-abf4-66a1d18fe6aa None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:33.209941 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8ea85-a19f-4668-abf4-66a1d18fe6aa None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:33.211183 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 451/883] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:13:33.216587 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8c6ad-b772-4030-9df3-6b46d8791676 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:33.217016 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8c6ad-b772-4030-9df3-6b46d8791676 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:33.217176 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8c6ad-b772-4030-9df3-6b46d8791676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:33.235513 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-12c8c6ad-b772-4030-9df3-6b46d8791676 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:13:33.236721 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-12c8c6ad-b772-4030-9df3-6b46d8791676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:13:33.301006 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 433/884] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:13:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 13:13:33.569798 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8ea85-a19f-4668-abf4-66a1d18fe6aa None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:33.666707 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8ea85-a19f-4668-abf4-66a1d18fe6aa None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:33.699320 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e709af-42fd-480b-a01f-83ef08db7141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:33.699951 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e709af-42fd-480b-a01f-83ef08db7141 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:33.700234 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e709af-42fd-480b-a01f-83ef08db7141 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:33.700504 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e709af-42fd-480b-a01f-83ef08db7141 None admin] PATH_INFO: `/v3/domains/f4003c083133477b990c20937979b89e` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:33.702891 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:33.711999 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e709af-42fd-480b-a01f-83ef08db7141 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f4003c083133477b990c20937979b89e)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:33.713424 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e709af-42fd-480b-a01f-83ef08db7141 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:33.715013 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 452/885] 10.222.0.25 () {56 vars in 1183 bytes} [Tue Oct 25 13:13:33 2022] GET /identity/v3/domains/f4003c083133477b990c20937979b89e => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:13:33.721429 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8c6ad-b772-4030-9df3-6b46d8791676 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:33.744382 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:33.818173 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8c6ad-b772-4030-9df3-6b46d8791676 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:33.851596 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c71ab-c215-4e1e-b5f7-293d43305d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:33.852150 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c71ab-c215-4e1e-b5f7-293d43305d9f None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:33.852426 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c71ab-c215-4e1e-b5f7-293d43305d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:33.852694 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c71ab-c215-4e1e-b5f7-293d43305d9f None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:33.853337 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c71ab-c215-4e1e-b5f7-293d43305d9f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:33.855022 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c71ab-c215-4e1e-b5f7-293d43305d9f None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:33.880700 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 434/886] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Oct 25 13:13:33 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:13:36.053044 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde3f31-a5a3-4ad1-a38a-a9763847ed93 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:36.053554 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde3f31-a5a3-4ad1-a38a-a9763847ed93 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:36.053554 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde3f31-a5a3-4ad1-a38a-a9763847ed93 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:36.054832 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 453/887] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:13:36.059973 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94c577-cfcc-431f-b716-75c4d0e62eee None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:36.060400 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94c577-cfcc-431f-b716-75c4d0e62eee None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:36.060563 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94c577-cfcc-431f-b716-75c4d0e62eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:36.078950 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-3c94c577-cfcc-431f-b716-75c4d0e62eee None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:13:36.080152 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-3c94c577-cfcc-431f-b716-75c4d0e62eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:13:36.144791 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 435/888] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:13:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 13:13:36.413430 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde3f31-a5a3-4ad1-a38a-a9763847ed93 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:36.511255 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde3f31-a5a3-4ad1-a38a-a9763847ed93 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:36.543398 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf951e4-5e2b-43be-92b6-64c854a5813f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:36.544310 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf951e4-5e2b-43be-92b6-64c854a5813f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:36.544589 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf951e4-5e2b-43be-92b6-64c854a5813f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:36.544858 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf951e4-5e2b-43be-92b6-64c854a5813f None admin] PATH_INFO: `/v3/domains/f4003c083133477b990c20937979b89e` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:36.546123 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf951e4-5e2b-43be-92b6-64c854a5813f None admin] RBAC: Authorizing `identity:get_domain(domain_id=f4003c083133477b990c20937979b89e)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:36.547533 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf951e4-5e2b-43be-92b6-64c854a5813f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:36.549078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 454/889] 10.222.0.25 () {56 vars in 1183 bytes} [Tue Oct 25 13:13:36 2022] GET /identity/v3/domains/f4003c083133477b990c20937979b89e => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:13:36.554688 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94c577-cfcc-431f-b716-75c4d0e62eee None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:36.557813 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:36.652293 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94c577-cfcc-431f-b716-75c4d0e62eee None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:36.686647 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc6ac0-a3a5-40fe-9930-fa80051a361c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:36.687427 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc6ac0-a3a5-40fe-9930-fa80051a361c None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:36.687706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc6ac0-a3a5-40fe-9930-fa80051a361c None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:36.688003 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc6ac0-a3a5-40fe-9930-fa80051a361c None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:36.688657 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc6ac0-a3a5-40fe-9930-fa80051a361c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:36.690067 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc6ac0-a3a5-40fe-9930-fa80051a361c None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:36.710126 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 436/890] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 25 13:13:36 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:13:38.873464 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61414059-d9ec-4f4f-9beb-f9514b785704 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:38.874016 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61414059-d9ec-4f4f-9beb-f9514b785704 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:38.874116 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61414059-d9ec-4f4f-9beb-f9514b785704 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:38.875377 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 455/891] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:13:38.880772 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f17a5a-c5e4-4850-92a9-bc3b9c0f0b12 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:38.881161 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f17a5a-c5e4-4850-92a9-bc3b9c0f0b12 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:38.881319 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f17a5a-c5e4-4850-92a9-bc3b9c0f0b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:38.899961 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-f8f17a5a-c5e4-4850-92a9-bc3b9c0f0b12 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:13:38.901129 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-f8f17a5a-c5e4-4850-92a9-bc3b9c0f0b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:13:38.957044 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:38.969378 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 437/892] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:13:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 13:13:39.237236 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61414059-d9ec-4f4f-9beb-f9514b785704 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:39.298400 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:39.337540 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61414059-d9ec-4f4f-9beb-f9514b785704 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:39.370788 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6bf762-777d-46b2-aab8-d2e0710fc36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:39.371406 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bf762-777d-46b2-aab8-d2e0710fc36d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:39.371681 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bf762-777d-46b2-aab8-d2e0710fc36d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:39.371971 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bf762-777d-46b2-aab8-d2e0710fc36d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:39.381648 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6bf762-777d-46b2-aab8-d2e0710fc36d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:13:39.386285 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-ef6bf762-777d-46b2-aab8-d2e0710fc36d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 13:13:39.386285 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:13:39.386285 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:13:39.386285 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:13:39.386285 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:13:39.386285 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:13:39.386285 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:13:39.386285 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:13:39.386285 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:13:39.386285 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:13:39.386285 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:13:39.386285 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:13:39.386285 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:13:39.386285 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:13:39.386285 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:13:39.386285 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:13:39.387411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:13:39.387411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:13:39.387411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:13:39.387411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:13:39.387411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:13:39.387411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:13:39.387411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:13:39.387411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:13:39.387411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:13:39.387411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:13:39.387411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:13:39.387411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:13:39.387411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:13:39.387411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:13:39.387411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:13:39.387411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:13:39.388746 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:13:39.388746 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:13:39.388746 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:13:39.388746 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:13:39.388746 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:13:39.388746 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:13:39.388746 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:13:39.388746 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:13:39.388746 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:13:39.388746 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:13:39.388746 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 13:13:39.388746 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:13:39.388746 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 456/893] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 25 13:13:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 13:13:39.393656 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f17a5a-c5e4-4850-92a9-bc3b9c0f0b12 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:39.491518 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f17a5a-c5e4-4850-92a9-bc3b9c0f0b12 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:39.524008 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ce50a-d700-4ce8-b3fc-b1189c54a68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:39.524601 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ce50a-d700-4ce8-b3fc-b1189c54a68f None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:39.524880 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ce50a-d700-4ce8-b3fc-b1189c54a68f None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:39.525150 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ce50a-d700-4ce8-b3fc-b1189c54a68f None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:39.525831 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ce50a-d700-4ce8-b3fc-b1189c54a68f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:13:39.526131 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ce50a-d700-4ce8-b3fc-b1189c54a68f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:39.527484 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ce50a-d700-4ce8-b3fc-b1189c54a68f None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:39.535912 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 438/894] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 25 13:13:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:13:39.541737 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6bf762-777d-46b2-aab8-d2e0710fc36d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:39.638477 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6bf762-777d-46b2-aab8-d2e0710fc36d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:39.661085 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:39.673344 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f29472-9bdc-4ce7-bb2d-6778a3cb6b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:39.673956 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f29472-9bdc-4ce7-bb2d-6778a3cb6b56 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:39.674236 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f29472-9bdc-4ce7-bb2d-6778a3cb6b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:39.674512 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f29472-9bdc-4ce7-bb2d-6778a3cb6b56 None admin] PATH_INFO: `/v3/users/4c7e7d762557448a83d7a6a37c9f307d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:39.687119 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f29472-9bdc-4ce7-bb2d-6778a3cb6b56 None admin] RBAC: Authorizing `identity:get_user(user_id=4c7e7d762557448a83d7a6a37c9f307d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:39.688583 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f29472-9bdc-4ce7-bb2d-6778a3cb6b56 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:39.690138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 457/895] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 25 13:13:39 2022] GET /identity/v3/users/4c7e7d762557448a83d7a6a37c9f307d => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:13:39.695796 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ce50a-d700-4ce8-b3fc-b1189c54a68f None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:39.748081 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:39.794667 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ce50a-d700-4ce8-b3fc-b1189c54a68f None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:39.828431 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e3428-d1ae-4983-bb1d-38e413afbb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:39.829042 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e3428-d1ae-4983-bb1d-38e413afbb4a None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:39.829315 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e3428-d1ae-4983-bb1d-38e413afbb4a None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:39.829580 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e3428-d1ae-4983-bb1d-38e413afbb4a None admin] PATH_INFO: `/v3/projects/51906c0a738f4a53be5ea81ef7cecfef` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:39.830665 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e3428-d1ae-4983-bb1d-38e413afbb4a None admin] RBAC: Authorizing `identity:get_project(project_id=51906c0a738f4a53be5ea81ef7cecfef)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:39.832102 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e3428-d1ae-4983-bb1d-38e413afbb4a None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:39.833689 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 439/896] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 25 13:13:39 2022] GET /identity/v3/projects/51906c0a738f4a53be5ea81ef7cecfef => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:13:39.839628 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f29472-9bdc-4ce7-bb2d-6778a3cb6b56 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:39.936698 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f29472-9bdc-4ce7-bb2d-6778a3cb6b56 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:39.968761 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133318e4-6df2-48b5-969a-e36e336f0e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:39.969394 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133318e4-6df2-48b5-969a-e36e336f0e1f None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:39.969674 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133318e4-6df2-48b5-969a-e36e336f0e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:39.969946 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133318e4-6df2-48b5-969a-e36e336f0e1f None admin] PATH_INFO: `/v3/projects/51906c0a738f4a53be5ea81ef7cecfef/users/4c7e7d762557448a83d7a6a37c9f307d/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:39.971807 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133318e4-6df2-48b5-969a-e36e336f0e1f None admin] RBAC: Authorizing `identity:create_grant(project_id=51906c0a738f4a53be5ea81ef7cecfef, user_id=4c7e7d762557448a83d7a6a37c9f307d, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:39.973241 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133318e4-6df2-48b5-969a-e36e336f0e1f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:39.986326 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 458/897] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 25 13:13:39 2022] PUT /identity/v3/projects/51906c0a738f4a53be5ea81ef7cecfef/users/4c7e7d762557448a83d7a6a37c9f307d/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:13:42.110165 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1852595-3e45-43fd-a632-5067b6e35090 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:42.110676 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1852595-3e45-43fd-a632-5067b6e35090 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:42.110676 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1852595-3e45-43fd-a632-5067b6e35090 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:42.111977 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 440/898] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:13:42.117191 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157ac30-908f-43f8-91ff-0b79cfa8bc37 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:42.117622 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157ac30-908f-43f8-91ff-0b79cfa8bc37 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:42.117720 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157ac30-908f-43f8-91ff-0b79cfa8bc37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:42.135990 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-9157ac30-908f-43f8-91ff-0b79cfa8bc37 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:13:42.137160 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9157ac30-908f-43f8-91ff-0b79cfa8bc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:13:42.170055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:42.202990 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 459/899] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:13:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 13:13:42.470880 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1852595-3e45-43fd-a632-5067b6e35090 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:42.570472 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1852595-3e45-43fd-a632-5067b6e35090 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:42.589198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:42.603337 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192272d5-eb40-4fc6-b074-7f684d443f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:42.603975 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192272d5-eb40-4fc6-b074-7f684d443f51 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:42.604257 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192272d5-eb40-4fc6-b074-7f684d443f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:42.604527 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192272d5-eb40-4fc6-b074-7f684d443f51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:42.615373 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192272d5-eb40-4fc6-b074-7f684d443f51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:13:42.620097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-192272d5-eb40-4fc6-b074-7f684d443f51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 13:13:42.620097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:13:42.620097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:13:42.620097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:13:42.620097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:13:42.620097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:13:42.620097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:13:42.620097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:13:42.620097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:13:42.620097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:13:42.620097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:13:42.620097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:13:42.620097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:13:42.620097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:13:42.620097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:13:42.620097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:13:42.621183 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:13:42.621183 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:13:42.621183 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:13:42.621183 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:13:42.621183 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:13:42.621183 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:13:42.621183 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:13:42.621183 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:13:42.621183 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:13:42.621183 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:13:42.621183 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:13:42.621183 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:13:42.621183 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:13:42.621183 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:13:42.621183 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:13:42.621183 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:13:42.622259 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:13:42.622259 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:13:42.622259 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:13:42.622259 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:13:42.622259 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:13:42.622259 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:13:42.622259 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:13:42.622259 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:13:42.622259 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:13:42.622259 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:13:42.622259 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 13:13:42.622259 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:13:42.622259 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 441/900] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 25 13:13:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:13:42.627296 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157ac30-908f-43f8-91ff-0b79cfa8bc37 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:42.723393 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157ac30-908f-43f8-91ff-0b79cfa8bc37 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:42.756392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495c213-5140-43e9-823d-ceae8a57e054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:42.756991 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495c213-5140-43e9-823d-ceae8a57e054 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:42.757271 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495c213-5140-43e9-823d-ceae8a57e054 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:42.757544 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495c213-5140-43e9-823d-ceae8a57e054 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:42.758199 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1495c213-5140-43e9-823d-ceae8a57e054 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:13:42.758511 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1495c213-5140-43e9-823d-ceae8a57e054 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:42.759865 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1495c213-5140-43e9-823d-ceae8a57e054 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:42.768221 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 460/901] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 25 13:13:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:13:42.774102 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192272d5-eb40-4fc6-b074-7f684d443f51 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:42.873141 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192272d5-eb40-4fc6-b074-7f684d443f51 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:42.905664 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26388629-59fe-42af-839a-2f8702981d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:42.906271 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26388629-59fe-42af-839a-2f8702981d24 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:42.906547 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26388629-59fe-42af-839a-2f8702981d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:42.906818 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26388629-59fe-42af-839a-2f8702981d24 None admin] PATH_INFO: `/v3/users/4c7e7d762557448a83d7a6a37c9f307d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:42.907929 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26388629-59fe-42af-839a-2f8702981d24 None admin] RBAC: Authorizing `identity:get_user(user_id=4c7e7d762557448a83d7a6a37c9f307d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:42.909346 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26388629-59fe-42af-839a-2f8702981d24 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:42.910892 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 442/902] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 25 13:13:42 2022] GET /identity/v3/users/4c7e7d762557448a83d7a6a37c9f307d => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:13:42.916607 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495c213-5140-43e9-823d-ceae8a57e054 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:42.948557 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:43.014413 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495c213-5140-43e9-823d-ceae8a57e054 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:43.047138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea1ef3-6642-42f0-859b-2318f1e4911b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:43.047731 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea1ef3-6642-42f0-859b-2318f1e4911b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:43.048039 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea1ef3-6642-42f0-859b-2318f1e4911b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:43.048310 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea1ef3-6642-42f0-859b-2318f1e4911b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:43.113819 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea1ef3-6642-42f0-859b-2318f1e4911b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:43.115255 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea1ef3-6642-42f0-859b-2318f1e4911b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:43.143411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:43.211051 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 461/903] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 25 13:13:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 25 13:13:43.217575 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26388629-59fe-42af-839a-2f8702981d24 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:43.266023 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:43.317669 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26388629-59fe-42af-839a-2f8702981d24 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:43.350174 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d47302-2ccc-4042-b2cf-61fd3ddc0208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:43.350775 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d47302-2ccc-4042-b2cf-61fd3ddc0208 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:43.351049 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d47302-2ccc-4042-b2cf-61fd3ddc0208 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:43.351342 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d47302-2ccc-4042-b2cf-61fd3ddc0208 None admin] PATH_INFO: `/v3/projects/51906c0a738f4a53be5ea81ef7cecfef` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:43.352448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d47302-2ccc-4042-b2cf-61fd3ddc0208 None admin] RBAC: Authorizing `identity:get_project(project_id=51906c0a738f4a53be5ea81ef7cecfef)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:43.353846 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d47302-2ccc-4042-b2cf-61fd3ddc0208 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:43.355435 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 443/904] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 25 13:13:43 2022] GET /identity/v3/projects/51906c0a738f4a53be5ea81ef7cecfef => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:13:43.362247 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea1ef3-6642-42f0-859b-2318f1e4911b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:13:43.456853 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea1ef3-6642-42f0-859b-2318f1e4911b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:13:43.485579 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:43.490730 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5a6b1-5378-423a-a609-c0a5cefd469b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:13:43.491314 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5a6b1-5378-423a-a609-c0a5cefd469b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:13:43.491586 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5a6b1-5378-423a-a609-c0a5cefd469b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:13:43.491853 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5a6b1-5378-423a-a609-c0a5cefd469b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:13:43.492596 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b5a6b1-5378-423a-a609-c0a5cefd469b None admin] RBAC: Adding query filter params (role.id=4c7114fda3ec4652abed55516b5f4315, scope.project.id=51906c0a738f4a53be5ea81ef7cecfef, user.id=4c7e7d762557448a83d7a6a37c9f307d) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:13:43.492896 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b5a6b1-5378-423a-a609-c0a5cefd469b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:13:43.494293 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b5a6b1-5378-423a-a609-c0a5cefd469b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:13:43.499879 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 462/905] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 25 13:13:43 2022] GET /identity/v3/role_assignments?user.id=4c7e7d762557448a83d7a6a37c9f307d&scope.project.id=51906c0a738f4a53be5ea81ef7cecfef&role.id=4c7114fda3ec4652abed55516b5f4315 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:13:53.346750 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=42 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:13:53.497306 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:14:39.430770 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2cfbf-5adc-4c4d-8d2a-4825e03b0478 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:39.431350 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2cfbf-5adc-4c4d-8d2a-4825e03b0478 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:39.431437 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2cfbf-5adc-4c4d-8d2a-4825e03b0478 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:39.432767 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 444/906] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:14:39.439941 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42d903-ecc7-4a11-b9a5-ee94791e8c12 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:39.440484 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42d903-ecc7-4a11-b9a5-ee94791e8c12 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:39.440484 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42d903-ecc7-4a11-b9a5-ee94791e8c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:39.459966 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-8d42d903-ecc7-4a11-b9a5-ee94791e8c12 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:14:39.461258 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8d42d903-ecc7-4a11-b9a5-ee94791e8c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:14:39.550299 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 463/907] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:14:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 13:14:39.832636 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2cfbf-5adc-4c4d-8d2a-4825e03b0478 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:39.961759 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2cfbf-5adc-4c4d-8d2a-4825e03b0478 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:40.003318 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81885553-29b1-454f-86fe-5fa8b942628e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:40.003854 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81885553-29b1-454f-86fe-5fa8b942628e None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:40.004156 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81885553-29b1-454f-86fe-5fa8b942628e None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:40.004439 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81885553-29b1-454f-86fe-5fa8b942628e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:40.016486 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81885553-29b1-454f-86fe-5fa8b942628e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:40.017949 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81885553-29b1-454f-86fe-5fa8b942628e None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:40.036699 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-81885553-29b1-454f-86fe-5fa8b942628e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:14:40.036699 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:14:40.036699 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:14:40.036699 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:14:40.036699 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:14:40.036699 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:14:40.036699 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:14:40.036699 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:14:40.036699 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:14:40.036699 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:14:40.036699 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:14:40.036699 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:14:40.036699 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:14:40.036699 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:14:40.036699 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:14:40.036699 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:14:40.037763 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:14:40.037763 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:14:40.037763 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:14:40.037763 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:14:40.037763 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:14:40.037763 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:14:40.037763 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:14:40.037763 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:14:40.037763 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:14:40.037763 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:14:40.037763 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:14:40.037763 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:14:40.037763 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:14:40.037763 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:14:40.037763 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:14:40.037763 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:14:40.037763 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:14:40.038743 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:14:40.038743 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:14:40.038743 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:14:40.040252 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 445/908] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:14:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:14:40.047270 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42d903-ecc7-4a11-b9a5-ee94791e8c12 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:40.162589 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42d903-ecc7-4a11-b9a5-ee94791e8c12 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:40.198074 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:14:40.204846 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bfed17-d32c-449d-9b88-2415804dbbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:40.205496 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfed17-d32c-449d-9b88-2415804dbbad None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:40.206093 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfed17-d32c-449d-9b88-2415804dbbad None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:40.206542 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfed17-d32c-449d-9b88-2415804dbbad None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:40.207480 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bfed17-d32c-449d-9b88-2415804dbbad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:14:40.207766 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bfed17-d32c-449d-9b88-2415804dbbad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:40.209195 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bfed17-d32c-449d-9b88-2415804dbbad None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:40.223945 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 464/909] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:14:40.227862 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81885553-29b1-454f-86fe-5fa8b942628e None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:40.311216 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:14:40.363597 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81885553-29b1-454f-86fe-5fa8b942628e None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:40.405770 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684de48-6e56-47c0-a7ea-0e39159559fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:40.406419 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684de48-6e56-47c0-a7ea-0e39159559fc None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:40.406668 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684de48-6e56-47c0-a7ea-0e39159559fc None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:40.406974 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684de48-6e56-47c0-a7ea-0e39159559fc None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:40.407643 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8684de48-6e56-47c0-a7ea-0e39159559fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:40.409275 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8684de48-6e56-47c0-a7ea-0e39159559fc None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:40.443960 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 446/910] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 25 13:14:40 2022] POST /identity/v3/users => generated 251 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:14:42.721594 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdec99d-c9d0-4856-9fae-5b6fb12fc715 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:42.722146 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdec99d-c9d0-4856-9fae-5b6fb12fc715 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:42.722146 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdec99d-c9d0-4856-9fae-5b6fb12fc715 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:42.723611 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 465/911] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:14:42.729488 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404f5e5-bc9a-401e-b68d-1f7754477a46 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:42.729907 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404f5e5-bc9a-401e-b68d-1f7754477a46 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:42.730175 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404f5e5-bc9a-401e-b68d-1f7754477a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:42.751329 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-7404f5e5-bc9a-401e-b68d-1f7754477a46 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:14:42.752533 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-7404f5e5-bc9a-401e-b68d-1f7754477a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:14:42.841471 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 447/912] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:14:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 13:14:43.144633 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdec99d-c9d0-4856-9fae-5b6fb12fc715 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:43.268927 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdec99d-c9d0-4856-9fae-5b6fb12fc715 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:43.307681 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25a7ad-d1d9-422e-b2be-3a0b9d819a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:43.308350 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25a7ad-d1d9-422e-b2be-3a0b9d819a05 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:43.308634 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25a7ad-d1d9-422e-b2be-3a0b9d819a05 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:43.308893 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25a7ad-d1d9-422e-b2be-3a0b9d819a05 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:43.320732 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25a7ad-d1d9-422e-b2be-3a0b9d819a05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:14:43.326522 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-ac25a7ad-d1d9-422e-b2be-3a0b9d819a05 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 13:14:43.326522 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:14:43.326522 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:14:43.326522 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:14:43.326522 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:14:43.326522 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:14:43.326522 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:14:43.326522 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:14:43.326522 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:14:43.326522 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:14:43.326522 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:14:43.326522 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:14:43.326522 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:14:43.326522 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:14:43.326522 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:14:43.326522 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:14:43.327631 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:14:43.327631 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:14:43.327631 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:14:43.327631 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:14:43.327631 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:14:43.327631 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:14:43.327631 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:14:43.327631 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:14:43.327631 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:14:43.327631 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:14:43.327631 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:14:43.327631 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:14:43.327631 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:14:43.327631 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:14:43.327631 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:14:43.327631 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:14:43.328528 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:14:43.328528 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:14:43.328528 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:14:43.328528 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:14:43.328528 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:14:43.328528 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:14:43.328528 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:14:43.328528 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:14:43.328528 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:14:43.328528 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:14:43.328528 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 25 13:14:43.328528 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:14:43.328528 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 466/913] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 25 13:14:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:14:43.334540 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404f5e5-bc9a-401e-b68d-1f7754477a46 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:43.382397 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:14:43.458161 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404f5e5-bc9a-401e-b68d-1f7754477a46 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:43.497775 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88889f29-c8c5-4e4c-a729-25137f85c3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:43.498375 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88889f29-c8c5-4e4c-a729-25137f85c3ec None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:43.498650 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88889f29-c8c5-4e4c-a729-25137f85c3ec None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:43.498941 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88889f29-c8c5-4e4c-a729-25137f85c3ec None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:43.499586 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88889f29-c8c5-4e4c-a729-25137f85c3ec None admin] RBAC: Adding query filter params (name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:14:43.499886 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88889f29-c8c5-4e4c-a729-25137f85c3ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:43.501288 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88889f29-c8c5-4e4c-a729-25137f85c3ec None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:43.510387 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 448/914] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 25 13:14:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:14:43.517396 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25a7ad-d1d9-422e-b2be-3a0b9d819a05 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:43.578882 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:14:43.640402 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25a7ad-d1d9-422e-b2be-3a0b9d819a05 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:43.681487 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe3f34-ab7b-4c77-999c-801c0f26501e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:43.682235 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe3f34-ab7b-4c77-999c-801c0f26501e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:43.682623 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe3f34-ab7b-4c77-999c-801c0f26501e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:43.682857 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe3f34-ab7b-4c77-999c-801c0f26501e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:43.696192 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe3f34-ab7b-4c77-999c-801c0f26501e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:43.698437 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe3f34-ab7b-4c77-999c-801c0f26501e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:43.715000 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-e8fe3f34-ab7b-4c77-999c-801c0f26501e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:14:43.715000 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:14:43.715000 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:14:43.715000 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:14:43.715000 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:14:43.715000 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:14:43.715000 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:14:43.715000 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:14:43.715000 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:14:43.715000 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:14:43.715000 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:14:43.715000 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:14:43.715000 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:14:43.715000 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:14:43.715000 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:14:43.715000 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:14:43.720206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:14:43.720206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:14:43.720206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:14:43.720206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:14:43.720206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:14:43.720206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:14:43.720206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:14:43.720206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:14:43.720206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:14:43.720206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:14:43.720206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:14:43.720206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:14:43.720206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:14:43.720206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:14:43.720206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:14:43.720206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:14:43.720206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:14:43.721323 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:14:43.721323 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:14:43.721323 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:14:43.721323 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 467/915] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:14:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:14:43.722747 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88889f29-c8c5-4e4c-a729-25137f85c3ec None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:43.836024 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:14:43.839386 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88889f29-c8c5-4e4c-a729-25137f85c3ec None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:43.881657 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd60b9bd-79af-4929-a6ea-73a4447945c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:43.882370 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60b9bd-79af-4929-a6ea-73a4447945c3 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:43.882731 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60b9bd-79af-4929-a6ea-73a4447945c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:43.883030 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60b9bd-79af-4929-a6ea-73a4447945c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:43.883824 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd60b9bd-79af-4929-a6ea-73a4447945c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:14:43.884377 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd60b9bd-79af-4929-a6ea-73a4447945c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:43.886561 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd60b9bd-79af-4929-a6ea-73a4447945c3 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:43.900597 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 449/916] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:14:43.906975 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe3f34-ab7b-4c77-999c-801c0f26501e None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:44.022452 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe3f34-ab7b-4c77-999c-801c0f26501e None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:44.026892 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:14:44.063451 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac6d60-084d-4328-a6d4-b73cc44d7aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:44.064115 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac6d60-084d-4328-a6d4-b73cc44d7aaf None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:44.066881 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac6d60-084d-4328-a6d4-b73cc44d7aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:44.067170 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac6d60-084d-4328-a6d4-b73cc44d7aaf None admin] PATH_INFO: `/v3/users/placement` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:44.075675 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac6d60-084d-4328-a6d4-b73cc44d7aaf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:44.077779 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac6d60-084d-4328-a6d4-b73cc44d7aaf None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:44.090746 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-dcac6d60-084d-4328-a6d4-b73cc44d7aaf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 25 13:14:44.090746 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:14:44.090746 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:14:44.090746 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:14:44.090746 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:14:44.090746 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:14:44.090746 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:14:44.090746 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:14:44.090746 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:14:44.090746 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:14:44.090746 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:14:44.090746 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:14:44.090746 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 25 13:14:44.090746 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 25 13:14:44.090746 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 25 13:14:44.090746 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 25 13:14:44.092078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:14:44.092078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:14:44.092078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 25 13:14:44.092078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:14:44.092078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 25 13:14:44.092078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:14:44.092078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:14:44.092078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:14:44.092078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:14:44.092078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:14:44.092078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:14:44.092078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:14:44.092078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:14:44.092078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:14:44.092078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:14:44.092078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:14:44.092078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:14:44.092078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:14:44.093219 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:14:44.093219 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:14:44.093219 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 25 13:14:44.093219 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 25 13:14:44.093219 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 25 13:14:44.093219 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 25 13:14:44.093219 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 25 13:14:44.093219 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 25 13:14:44.093219 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 25 13:14:44.093219 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:14:44.093219 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 468/917] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:14:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:14:44.098528 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd60b9bd-79af-4929-a6ea-73a4447945c3 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:44.217705 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd60b9bd-79af-4929-a6ea-73a4447945c3 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:44.256440 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89276467-f6cc-4969-b291-ce6b997908ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:44.257231 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89276467-f6cc-4969-b291-ce6b997908ad None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:44.257542 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89276467-f6cc-4969-b291-ce6b997908ad None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:44.257998 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89276467-f6cc-4969-b291-ce6b997908ad None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:44.258735 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89276467-f6cc-4969-b291-ce6b997908ad None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:14:44.259110 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89276467-f6cc-4969-b291-ce6b997908ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:44.260690 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89276467-f6cc-4969-b291-ce6b997908ad None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:44.282758 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 450/918] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Oct 25 13:14:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:14:44.288768 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac6d60-084d-4328-a6d4-b73cc44d7aaf None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:44.421476 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac6d60-084d-4328-a6d4-b73cc44d7aaf None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:44.460715 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f2e8a-d733-4e24-b0ed-375b37745526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:44.461386 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f2e8a-d733-4e24-b0ed-375b37745526 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:44.461687 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f2e8a-d733-4e24-b0ed-375b37745526 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:44.461939 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f2e8a-d733-4e24-b0ed-375b37745526 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:44.475357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286f2e8a-d733-4e24-b0ed-375b37745526 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:44.477081 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286f2e8a-d733-4e24-b0ed-375b37745526 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:44.493407 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-286f2e8a-d733-4e24-b0ed-375b37745526 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:14:44.493407 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:14:44.493407 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:14:44.493407 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:14:44.493407 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:14:44.493407 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:14:44.493407 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:14:44.493407 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:14:44.493407 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:14:44.493407 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:14:44.493407 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:14:44.493407 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:14:44.493407 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:14:44.493407 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:14:44.493407 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:14:44.493407 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:14:44.494596 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:14:44.494596 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:14:44.494596 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:14:44.494596 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:14:44.494596 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:14:44.494596 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:14:44.494596 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:14:44.494596 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:14:44.494596 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:14:44.494596 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:14:44.494596 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:14:44.494596 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:14:44.494596 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:14:44.494596 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:14:44.494596 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:14:44.494596 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:14:44.494596 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:14:44.495575 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:14:44.495575 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:14:44.495575 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:14:44.495575 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 469/919] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:14:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:14:44.501494 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89276467-f6cc-4969-b291-ce6b997908ad None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:44.521801 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:14:44.616624 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89276467-f6cc-4969-b291-ce6b997908ad None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:44.652497 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa824135-85d6-4ddb-a52c-b7ca935e7225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:44.653097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa824135-85d6-4ddb-a52c-b7ca935e7225 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:44.653369 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa824135-85d6-4ddb-a52c-b7ca935e7225 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:44.653639 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa824135-85d6-4ddb-a52c-b7ca935e7225 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:44.654837 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa824135-85d6-4ddb-a52c-b7ca935e7225 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:14:44.655135 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa824135-85d6-4ddb-a52c-b7ca935e7225 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:44.656511 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa824135-85d6-4ddb-a52c-b7ca935e7225 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:44.670566 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 451/920] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:14:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:14:44.676401 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f2e8a-d733-4e24-b0ed-375b37745526 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:44.694624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:14:44.790566 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f2e8a-d733-4e24-b0ed-375b37745526 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:44.831410 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45132ac2-d2a3-48ca-b252-b89b2f6e0479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:44.832048 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45132ac2-d2a3-48ca-b252-b89b2f6e0479 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:44.832331 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45132ac2-d2a3-48ca-b252-b89b2f6e0479 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:44.832602 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45132ac2-d2a3-48ca-b252-b89b2f6e0479 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:44.845385 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45132ac2-d2a3-48ca-b252-b89b2f6e0479 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:44.847156 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45132ac2-d2a3-48ca-b252-b89b2f6e0479 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:44.860654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-45132ac2-d2a3-48ca-b252-b89b2f6e0479 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:14:44.860654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:14:44.860654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:14:44.860654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:14:44.860654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:14:44.860654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:14:44.860654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:14:44.860654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:14:44.860654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:14:44.860654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:14:44.860654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:14:44.860654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:14:44.860654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 25 13:14:44.860654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 25 13:14:44.860654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 25 13:14:44.861703 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 25 13:14:44.861703 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:14:44.861703 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:14:44.861703 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:14:44.861703 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:14:44.861703 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:14:44.861703 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:14:44.861703 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:14:44.861703 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:14:44.861703 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:14:44.861703 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:14:44.861703 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:14:44.861703 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:14:44.861703 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:14:44.861703 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:14:44.861703 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:14:44.861703 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:14:44.867783 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 25 13:14:44.867783 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 25 13:14:44.867783 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 25 13:14:44.867783 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 25 13:14:44.867783 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 25 13:14:44.867783 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 25 13:14:44.867783 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:14:44.867783 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:14:44.867783 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 470/921] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 25 13:14:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:14:44.869481 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa824135-85d6-4ddb-a52c-b7ca935e7225 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:44.963541 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:14:44.988146 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa824135-85d6-4ddb-a52c-b7ca935e7225 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:45.027511 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eccfc40-03c8-4dd0-99ca-278bb3e1fa1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:45.028197 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccfc40-03c8-4dd0-99ca-278bb3e1fa1f None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:45.028451 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccfc40-03c8-4dd0-99ca-278bb3e1fa1f None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:45.028865 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccfc40-03c8-4dd0-99ca-278bb3e1fa1f None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:45.029882 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eccfc40-03c8-4dd0-99ca-278bb3e1fa1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:14:45.030318 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eccfc40-03c8-4dd0-99ca-278bb3e1fa1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:45.031848 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eccfc40-03c8-4dd0-99ca-278bb3e1fa1f None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:45.046460 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 452/922] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 25 13:14:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:14:45.057242 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45132ac2-d2a3-48ca-b252-b89b2f6e0479 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:45.138262 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:14:45.164349 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45132ac2-d2a3-48ca-b252-b89b2f6e0479 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:45.201476 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155806e-8934-465d-a1f0-74b5120b396a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:45.202133 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155806e-8934-465d-a1f0-74b5120b396a None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:45.202416 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155806e-8934-465d-a1f0-74b5120b396a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:45.202688 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155806e-8934-465d-a1f0-74b5120b396a None admin] PATH_INFO: `/v3/projects/616ecfe8d2c74aad9386720718392e81/users/f10c161ef74c4a0d809346a5c4b53aa3/roles/b3a463dfc621439eaee93c0551a4e296` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:45.218190 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155806e-8934-465d-a1f0-74b5120b396a None admin] RBAC: Authorizing `identity:create_grant(project_id=616ecfe8d2c74aad9386720718392e81, user_id=f10c161ef74c4a0d809346a5c4b53aa3, role_id=b3a463dfc621439eaee93c0551a4e296)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:45.219644 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155806e-8934-465d-a1f0-74b5120b396a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:45.234889 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 471/923] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 25 13:14:45 2022] PUT /identity/v3/projects/616ecfe8d2c74aad9386720718392e81/users/f10c161ef74c4a0d809346a5c4b53aa3/roles/b3a463dfc621439eaee93c0551a4e296 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:14:47.679049 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabb9b8-9b91-4614-92b9-e96b0f5e58f1 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:47.679596 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabb9b8-9b91-4614-92b9-e96b0f5e58f1 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:47.679596 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabb9b8-9b91-4614-92b9-e96b0f5e58f1 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:47.681115 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 453/924] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:14:47.686716 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddddb6-e117-45ae-83bf-3ef3c2163e2e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:47.687165 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddddb6-e117-45ae-83bf-3ef3c2163e2e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:47.687291 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddddb6-e117-45ae-83bf-3ef3c2163e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:47.707134 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a0ddddb6-e117-45ae-83bf-3ef3c2163e2e None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:14:47.708390 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a0ddddb6-e117-45ae-83bf-3ef3c2163e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:14:47.786307 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 472/925] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:14:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 25 13:14:48.072500 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabb9b8-9b91-4614-92b9-e96b0f5e58f1 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:48.184506 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabb9b8-9b91-4614-92b9-e96b0f5e58f1 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:48.222129 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc40e2b-206a-43ed-8e24-a046da2d7f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:48.222819 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc40e2b-206a-43ed-8e24-a046da2d7f45 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:48.223094 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc40e2b-206a-43ed-8e24-a046da2d7f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:48.223417 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc40e2b-206a-43ed-8e24-a046da2d7f45 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:48.230929 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:14:48.235471 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc40e2b-206a-43ed-8e24-a046da2d7f45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:14:48.241411 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-5dc40e2b-206a-43ed-8e24-a046da2d7f45 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 25 13:14:48.241411 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:14:48.241411 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:14:48.241411 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:14:48.241411 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:14:48.241411 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:14:48.241411 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:14:48.241411 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:14:48.241411 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:14:48.241411 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:14:48.241411 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:14:48.241411 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:14:48.241411 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:14:48.241411 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:14:48.241411 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:14:48.241411 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:14:48.242553 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:14:48.242553 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:14:48.242553 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:14:48.242553 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:14:48.242553 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:14:48.242553 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:14:48.242553 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:14:48.242553 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:14:48.242553 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:14:48.242553 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:14:48.242553 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:14:48.242553 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:14:48.242553 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:14:48.242553 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:14:48.242553 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:14:48.242553 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:14:48.243736 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:14:48.243736 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:14:48.243736 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:14:48.243736 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:14:48.243736 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:14:48.243736 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:14:48.243736 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:14:48.243736 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:14:48.243736 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:14:48.243736 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:14:48.243736 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 25 13:14:48.243736 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:14:48.243736 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 454/926] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 25 13:14:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:14:48.249001 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddddb6-e117-45ae-83bf-3ef3c2163e2e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:48.305037 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:14:48.358181 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddddb6-e117-45ae-83bf-3ef3c2163e2e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:48.392954 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7973523-fbb9-4e0b-9b31-36fd325fdf3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:48.393690 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7973523-fbb9-4e0b-9b31-36fd325fdf3c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:48.394089 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7973523-fbb9-4e0b-9b31-36fd325fdf3c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:48.394405 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7973523-fbb9-4e0b-9b31-36fd325fdf3c None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:48.395160 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7973523-fbb9-4e0b-9b31-36fd325fdf3c None admin] RBAC: Adding query filter params (name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:14:48.395469 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7973523-fbb9-4e0b-9b31-36fd325fdf3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:48.397035 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7973523-fbb9-4e0b-9b31-36fd325fdf3c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:48.406416 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 473/927] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 25 13:14:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:14:48.412897 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc40e2b-206a-43ed-8e24-a046da2d7f45 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:48.526058 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc40e2b-206a-43ed-8e24-a046da2d7f45 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:48.565001 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be401e83-d273-4d9a-b480-bc8187ea49a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:48.565660 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be401e83-d273-4d9a-b480-bc8187ea49a0 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:48.565976 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be401e83-d273-4d9a-b480-bc8187ea49a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:48.566251 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be401e83-d273-4d9a-b480-bc8187ea49a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:48.577960 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be401e83-d273-4d9a-b480-bc8187ea49a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:48.579559 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be401e83-d273-4d9a-b480-bc8187ea49a0 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:48.597007 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-be401e83-d273-4d9a-b480-bc8187ea49a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:14:48.597007 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:14:48.597007 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:14:48.597007 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:14:48.597007 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:14:48.597007 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:14:48.597007 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:14:48.597007 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:14:48.597007 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:14:48.597007 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:14:48.597007 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:14:48.597007 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:14:48.597007 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:14:48.597007 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:14:48.597007 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:14:48.597007 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:14:48.598263 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:14:48.598263 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:14:48.598263 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:14:48.598263 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:14:48.598263 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:14:48.598263 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:14:48.598263 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:14:48.598263 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:14:48.598263 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:14:48.598263 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:14:48.598263 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:14:48.598263 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:14:48.598263 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:14:48.598263 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:14:48.598263 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:14:48.598263 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:14:48.598263 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:14:48.599381 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:14:48.599381 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:14:48.599381 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:14:48.599381 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 455/928] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:14:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:14:48.604644 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7973523-fbb9-4e0b-9b31-36fd325fdf3c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:48.717206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7973523-fbb9-4e0b-9b31-36fd325fdf3c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:48.735511 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:14:48.755009 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcae0f0-6e4c-497e-bba6-a31672ed4048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:48.755664 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcae0f0-6e4c-497e-bba6-a31672ed4048 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:48.755975 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcae0f0-6e4c-497e-bba6-a31672ed4048 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:48.756255 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcae0f0-6e4c-497e-bba6-a31672ed4048 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:48.756891 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcae0f0-6e4c-497e-bba6-a31672ed4048 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:14:48.757197 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcae0f0-6e4c-497e-bba6-a31672ed4048 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:48.758560 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcae0f0-6e4c-497e-bba6-a31672ed4048 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:48.772567 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 474/929] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:14:48.779048 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be401e83-d273-4d9a-b480-bc8187ea49a0 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:48.837947 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:14:48.895630 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be401e83-d273-4d9a-b480-bc8187ea49a0 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:48.932589 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2711a1c-8b12-42b8-8bc3-77486e526135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:48.933536 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2711a1c-8b12-42b8-8bc3-77486e526135 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:48.933856 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2711a1c-8b12-42b8-8bc3-77486e526135 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:48.934298 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2711a1c-8b12-42b8-8bc3-77486e526135 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:48.943268 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2711a1c-8b12-42b8-8bc3-77486e526135 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:48.944977 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2711a1c-8b12-42b8-8bc3-77486e526135 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:48.959083 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-c2711a1c-8b12-42b8-8bc3-77486e526135 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 25 13:14:48.959083 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:14:48.959083 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:14:48.959083 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:14:48.959083 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:14:48.959083 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:14:48.959083 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:14:48.959083 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:14:48.959083 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:14:48.959083 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:14:48.959083 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:14:48.959083 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:14:48.959083 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 25 13:14:48.959083 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 25 13:14:48.959083 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 25 13:14:48.959083 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 25 13:14:48.960337 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:14:48.960337 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:14:48.960337 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 25 13:14:48.960337 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:14:48.960337 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 25 13:14:48.960337 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:14:48.960337 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:14:48.960337 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:14:48.960337 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:14:48.960337 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:14:48.960337 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:14:48.960337 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:14:48.960337 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:14:48.960337 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:14:48.960337 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:14:48.960337 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:14:48.960337 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:14:48.960337 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:14:48.961473 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:14:48.961473 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:14:48.961473 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 25 13:14:48.961473 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 25 13:14:48.961473 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 25 13:14:48.961473 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 25 13:14:48.961473 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 25 13:14:48.961473 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 25 13:14:48.961473 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 25 13:14:48.961473 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:14:48.961473 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 456/930] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:14:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:14:48.966572 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcae0f0-6e4c-497e-bba6-a31672ed4048 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:49.086236 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcae0f0-6e4c-497e-bba6-a31672ed4048 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:49.125593 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38d9e2-2848-4916-90b6-3d9aad177b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:49.126235 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38d9e2-2848-4916-90b6-3d9aad177b20 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:49.126566 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38d9e2-2848-4916-90b6-3d9aad177b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:49.126836 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38d9e2-2848-4916-90b6-3d9aad177b20 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:49.127551 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f38d9e2-2848-4916-90b6-3d9aad177b20 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:14:49.127911 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f38d9e2-2848-4916-90b6-3d9aad177b20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:49.129431 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f38d9e2-2848-4916-90b6-3d9aad177b20 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:49.148840 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 475/931] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Oct 25 13:14:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:14:49.155679 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2711a1c-8b12-42b8-8bc3-77486e526135 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:49.275558 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2711a1c-8b12-42b8-8bc3-77486e526135 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:49.287368 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:14:49.322704 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18dd2d-58cc-415e-abd6-157806f721f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:49.323479 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18dd2d-58cc-415e-abd6-157806f721f3 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:49.324070 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18dd2d-58cc-415e-abd6-157806f721f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:49.324460 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18dd2d-58cc-415e-abd6-157806f721f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:49.400732 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18dd2d-58cc-415e-abd6-157806f721f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:49.402183 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18dd2d-58cc-415e-abd6-157806f721f3 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:49.505170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 457/932] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 25 13:14:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 25 13:14:49.511342 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38d9e2-2848-4916-90b6-3d9aad177b20 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:49.547972 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:14:49.619526 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38d9e2-2848-4916-90b6-3d9aad177b20 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:49.655999 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe6f9a-44bd-40c6-93a8-cbb705052f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:49.656545 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe6f9a-44bd-40c6-93a8-cbb705052f97 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:49.656825 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe6f9a-44bd-40c6-93a8-cbb705052f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:49.657150 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe6f9a-44bd-40c6-93a8-cbb705052f97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:49.667882 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe6f9a-44bd-40c6-93a8-cbb705052f97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:49.669259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe6f9a-44bd-40c6-93a8-cbb705052f97 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:49.685577 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-3bfe6f9a-44bd-40c6-93a8-cbb705052f97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:14:49.685577 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:14:49.685577 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:14:49.685577 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:14:49.685577 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:14:49.685577 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:14:49.685577 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:14:49.685577 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:14:49.685577 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:14:49.685577 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:14:49.685577 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:14:49.685577 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:14:49.685577 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:14:49.685577 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:14:49.685577 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:14:49.685577 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:14:49.686624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:14:49.686624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:14:49.686624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:14:49.686624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:14:49.686624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:14:49.686624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:14:49.686624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:14:49.686624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:14:49.686624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:14:49.686624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:14:49.686624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:14:49.686624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:14:49.686624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:14:49.686624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:14:49.686624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:14:49.686624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:14:49.686624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:14:49.687511 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:14:49.687511 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:14:49.687511 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:14:49.687511 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 476/933] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:14:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:14:49.692966 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18dd2d-58cc-415e-abd6-157806f721f3 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:49.705657 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:14:49.805175 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18dd2d-58cc-415e-abd6-157806f721f3 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:49.842583 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65560df-1527-4810-a558-33586281c4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:49.843191 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65560df-1527-4810-a558-33586281c4f1 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:49.843464 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65560df-1527-4810-a558-33586281c4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:49.843823 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65560df-1527-4810-a558-33586281c4f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:49.844437 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65560df-1527-4810-a558-33586281c4f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:14:49.844709 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65560df-1527-4810-a558-33586281c4f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:49.846072 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65560df-1527-4810-a558-33586281c4f1 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:49.858304 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 458/934] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:14:49.864052 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe6f9a-44bd-40c6-93a8-cbb705052f97 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:49.952241 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:14:49.968761 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe6f9a-44bd-40c6-93a8-cbb705052f97 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:50.004765 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473ea2a-51b1-4215-88fc-b4f89db02dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:50.005409 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473ea2a-51b1-4215-88fc-b4f89db02dbb None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:50.005690 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473ea2a-51b1-4215-88fc-b4f89db02dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:50.005988 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473ea2a-51b1-4215-88fc-b4f89db02dbb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:50.013808 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4473ea2a-51b1-4215-88fc-b4f89db02dbb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:50.015230 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4473ea2a-51b1-4215-88fc-b4f89db02dbb None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:50.026213 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-4473ea2a-51b1-4215-88fc-b4f89db02dbb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:14:50.026213 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:14:50.026213 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:14:50.026213 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:14:50.026213 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:14:50.026213 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:14:50.026213 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:14:50.026213 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:14:50.026213 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:14:50.026213 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:14:50.026213 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:14:50.026213 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:14:50.026213 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 25 13:14:50.026213 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 25 13:14:50.026213 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 25 13:14:50.027233 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 25 13:14:50.027233 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:14:50.027233 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:14:50.027233 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:14:50.027233 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:14:50.027233 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:14:50.027233 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:14:50.027233 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:14:50.027233 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:14:50.027233 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:14:50.027233 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:14:50.027233 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:14:50.027233 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:14:50.027233 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:14:50.027233 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:14:50.027233 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:14:50.027233 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:14:50.028347 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 25 13:14:50.028347 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 25 13:14:50.028347 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 25 13:14:50.028347 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 25 13:14:50.028347 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 25 13:14:50.028347 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 25 13:14:50.028347 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:14:50.028347 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:14:50.032188 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 477/935] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 25 13:14:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 13:14:50.033234 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65560df-1527-4810-a558-33586281c4f1 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:50.111910 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:14:50.147761 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65560df-1527-4810-a558-33586281c4f1 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:50.192838 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11bdb9-3214-4bb5-8c9c-cb7bf515603d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:50.193747 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11bdb9-3214-4bb5-8c9c-cb7bf515603d None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:50.194249 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11bdb9-3214-4bb5-8c9c-cb7bf515603d None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:50.194712 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11bdb9-3214-4bb5-8c9c-cb7bf515603d None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:50.195843 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db11bdb9-3214-4bb5-8c9c-cb7bf515603d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:14:50.196464 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db11bdb9-3214-4bb5-8c9c-cb7bf515603d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:50.198450 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db11bdb9-3214-4bb5-8c9c-cb7bf515603d None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:50.217450 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 459/936] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 25 13:14:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:14:50.224782 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473ea2a-51b1-4215-88fc-b4f89db02dbb None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:50.348289 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473ea2a-51b1-4215-88fc-b4f89db02dbb None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:50.389848 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd974f22-bae5-45c9-aba4-c3849b1239bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:50.390461 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd974f22-bae5-45c9-aba4-c3849b1239bb None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:50.390735 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd974f22-bae5-45c9-aba4-c3849b1239bb None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:50.391010 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd974f22-bae5-45c9-aba4-c3849b1239bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:50.391733 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd974f22-bae5-45c9-aba4-c3849b1239bb None admin] RBAC: Adding query filter params (role.id=b3a463dfc621439eaee93c0551a4e296, scope.project.id=616ecfe8d2c74aad9386720718392e81, user.id=f10c161ef74c4a0d809346a5c4b53aa3) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:14:50.392207 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd974f22-bae5-45c9-aba4-c3849b1239bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:50.393680 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd974f22-bae5-45c9-aba4-c3849b1239bb None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:50.399983 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 478/937] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 25 13:14:50 2022] GET /identity/v3/role_assignments?user.id=f10c161ef74c4a0d809346a5c4b53aa3&scope.project.id=616ecfe8d2c74aad9386720718392e81&role.id=b3a463dfc621439eaee93c0551a4e296 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:14:52.590536 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729ead8-fe8d-48f8-84b3-b96d69f2acc4 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:52.591085 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729ead8-fe8d-48f8-84b3-b96d69f2acc4 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:52.591164 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729ead8-fe8d-48f8-84b3-b96d69f2acc4 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:52.593073 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 460/938] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:14:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 13:14:52.598378 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257a2dc-02b3-4b6b-9eaf-c156c2598ac3 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:52.598842 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257a2dc-02b3-4b6b-9eaf-c156c2598ac3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:52.598922 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257a2dc-02b3-4b6b-9eaf-c156c2598ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:52.617795 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d257a2dc-02b3-4b6b-9eaf-c156c2598ac3 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:14:52.618990 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d257a2dc-02b3-4b6b-9eaf-c156c2598ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:14:52.621961 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:14:52.692562 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 479/939] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:14:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 13:14:52.968024 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729ead8-fe8d-48f8-84b3-b96d69f2acc4 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:53.082339 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729ead8-fe8d-48f8-84b3-b96d69f2acc4 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:53.118310 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:14:53.125845 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dced18e-7a0a-4457-8fe0-03374fa718bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:53.126626 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dced18e-7a0a-4457-8fe0-03374fa718bc None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:53.126940 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dced18e-7a0a-4457-8fe0-03374fa718bc None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:53.127240 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dced18e-7a0a-4457-8fe0-03374fa718bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:53.139538 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dced18e-7a0a-4457-8fe0-03374fa718bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:14:53.149764 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-5dced18e-7a0a-4457-8fe0-03374fa718bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 13:14:53.149764 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:14:53.149764 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:14:53.149764 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:14:53.149764 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:14:53.149764 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:14:53.149764 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:14:53.149764 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:14:53.149764 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:14:53.149764 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:14:53.149764 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:14:53.149764 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:14:53.149764 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:14:53.149764 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:14:53.149764 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:14:53.149764 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:14:53.150902 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:14:53.150902 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:14:53.150902 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:14:53.150902 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:14:53.150902 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:14:53.150902 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:14:53.150902 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:14:53.150902 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:14:53.150902 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:14:53.150902 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:14:53.150902 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:14:53.150902 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:14:53.150902 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:14:53.150902 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:14:53.150902 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:14:53.150902 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:14:53.151953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:14:53.151953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:14:53.151953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:14:53.151953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:14:53.151953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:14:53.151953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:14:53.151953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:14:53.151953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:14:53.151953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:14:53.151953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:14:53.151953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 13:14:53.151953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:14:53.151953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 461/940] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 25 13:14:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 13:14:53.158406 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257a2dc-02b3-4b6b-9eaf-c156c2598ac3 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:53.271068 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257a2dc-02b3-4b6b-9eaf-c156c2598ac3 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:53.307797 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ce632-8831-48ca-ab33-862abd5f7d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:53.308425 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ce632-8831-48ca-ab33-862abd5f7d54 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:53.308707 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ce632-8831-48ca-ab33-862abd5f7d54 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:53.308978 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ce632-8831-48ca-ab33-862abd5f7d54 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:53.309657 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ce632-8831-48ca-ab33-862abd5f7d54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:14:53.310890 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ce632-8831-48ca-ab33-862abd5f7d54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:53.312509 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ce632-8831-48ca-ab33-862abd5f7d54 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:53.321048 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 480/941] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 25 13:14:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:14:53.327646 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dced18e-7a0a-4457-8fe0-03374fa718bc None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:53.437938 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dced18e-7a0a-4457-8fe0-03374fa718bc None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:53.482554 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a60ea-6c12-49c1-93cd-3714215f19a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:53.483545 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a60ea-6c12-49c1-93cd-3714215f19a7 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:53.483828 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a60ea-6c12-49c1-93cd-3714215f19a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:53.484136 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a60ea-6c12-49c1-93cd-3714215f19a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:53.496239 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a60ea-6c12-49c1-93cd-3714215f19a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:53.498931 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a60ea-6c12-49c1-93cd-3714215f19a7 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:53.516108 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-ad3a60ea-6c12-49c1-93cd-3714215f19a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:14:53.516108 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:14:53.516108 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:14:53.516108 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:14:53.516108 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:14:53.516108 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:14:53.516108 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:14:53.516108 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:14:53.516108 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:14:53.516108 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:14:53.516108 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:14:53.516108 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:14:53.516108 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:14:53.516108 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:14:53.516108 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:14:53.516108 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:14:53.517286 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:14:53.517286 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:14:53.517286 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:14:53.517286 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:14:53.517286 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:14:53.517286 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:14:53.517286 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:14:53.517286 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:14:53.517286 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:14:53.517286 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:14:53.517286 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:14:53.517286 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:14:53.517286 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:14:53.517286 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:14:53.517286 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:14:53.517286 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:14:53.517286 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:14:53.518173 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:14:53.518173 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:14:53.518173 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:14:53.518173 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 462/942] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:14:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:14:53.523832 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ce632-8831-48ca-ab33-862abd5f7d54 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:53.526773 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:14:53.639648 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ce632-8831-48ca-ab33-862abd5f7d54 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:53.678977 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07c8c1-f446-419e-b5be-00ab903a4a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:53.679812 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07c8c1-f446-419e-b5be-00ab903a4a46 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:53.680203 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07c8c1-f446-419e-b5be-00ab903a4a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:53.680565 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07c8c1-f446-419e-b5be-00ab903a4a46 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:53.681301 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec07c8c1-f446-419e-b5be-00ab903a4a46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:14:53.681836 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec07c8c1-f446-419e-b5be-00ab903a4a46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:53.683508 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec07c8c1-f446-419e-b5be-00ab903a4a46 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:53.702187 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 481/943] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:14:53.708099 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a60ea-6c12-49c1-93cd-3714215f19a7 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:53.760631 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:14:53.829591 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a60ea-6c12-49c1-93cd-3714215f19a7 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:53.870728 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253dc6f9-d067-4969-a13a-a3923ab8d4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:53.871352 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253dc6f9-d067-4969-a13a-a3923ab8d4a9 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:53.871661 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253dc6f9-d067-4969-a13a-a3923ab8d4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:53.871923 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253dc6f9-d067-4969-a13a-a3923ab8d4a9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:53.880545 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253dc6f9-d067-4969-a13a-a3923ab8d4a9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:53.881976 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253dc6f9-d067-4969-a13a-a3923ab8d4a9 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:53.893374 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-253dc6f9-d067-4969-a13a-a3923ab8d4a9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 25 13:14:53.893374 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:14:53.893374 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:14:53.893374 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:14:53.893374 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:14:53.893374 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:14:53.893374 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:14:53.893374 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:14:53.893374 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:14:53.893374 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:14:53.893374 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:14:53.893374 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:14:53.893374 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 25 13:14:53.893374 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 25 13:14:53.893374 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 25 13:14:53.893374 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 25 13:14:53.894549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:14:53.894549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:14:53.894549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 25 13:14:53.894549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:14:53.894549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 25 13:14:53.894549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:14:53.894549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:14:53.894549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:14:53.894549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:14:53.894549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:14:53.894549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:14:53.894549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:14:53.894549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:14:53.894549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:14:53.894549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:14:53.894549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:14:53.894549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:14:53.894549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:14:53.895692 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:14:53.895692 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:14:53.895692 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 25 13:14:53.895692 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 25 13:14:53.895692 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 25 13:14:53.895692 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 25 13:14:53.895692 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 25 13:14:53.895692 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 25 13:14:53.895692 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 25 13:14:53.895692 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:14:53.895692 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 463/944] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:14:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:14:53.900438 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07c8c1-f446-419e-b5be-00ab903a4a46 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:53.963340 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:14:54.003196 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07c8c1-f446-419e-b5be-00ab903a4a46 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:54.039515 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5594d2c-14fc-482c-8e43-d00c27e2292d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:54.040170 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5594d2c-14fc-482c-8e43-d00c27e2292d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:54.040448 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5594d2c-14fc-482c-8e43-d00c27e2292d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:54.040718 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5594d2c-14fc-482c-8e43-d00c27e2292d None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:54.041442 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5594d2c-14fc-482c-8e43-d00c27e2292d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:14:54.041748 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5594d2c-14fc-482c-8e43-d00c27e2292d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:54.043167 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5594d2c-14fc-482c-8e43-d00c27e2292d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:54.061243 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 482/945] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Oct 25 13:14:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:14:54.067194 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253dc6f9-d067-4969-a13a-a3923ab8d4a9 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:54.179482 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253dc6f9-d067-4969-a13a-a3923ab8d4a9 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:54.181067 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:14:54.219532 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861891b0-b682-43d6-b42b-789d4454cf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:54.220405 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861891b0-b682-43d6-b42b-789d4454cf2c None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:54.220535 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861891b0-b682-43d6-b42b-789d4454cf2c None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:54.220819 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861891b0-b682-43d6-b42b-789d4454cf2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:54.233410 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861891b0-b682-43d6-b42b-789d4454cf2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:54.234850 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861891b0-b682-43d6-b42b-789d4454cf2c None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:54.254292 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-861891b0-b682-43d6-b42b-789d4454cf2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:14:54.254292 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:14:54.254292 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:14:54.254292 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:14:54.254292 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:14:54.254292 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:14:54.254292 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:14:54.254292 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:14:54.254292 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:14:54.254292 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:14:54.254292 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:14:54.254292 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:14:54.254292 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:14:54.254292 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:14:54.254292 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:14:54.254292 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:14:54.255437 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:14:54.255437 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:14:54.255437 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:14:54.255437 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:14:54.255437 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:14:54.255437 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:14:54.255437 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:14:54.255437 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:14:54.255437 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:14:54.255437 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:14:54.255437 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:14:54.255437 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:14:54.255437 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:14:54.255437 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:14:54.255437 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:14:54.255437 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:14:54.255437 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:14:54.256574 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:14:54.256574 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:14:54.256574 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:14:54.256574 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 464/946] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:14:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 13:14:54.261638 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5594d2c-14fc-482c-8e43-d00c27e2292d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:54.371001 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5594d2c-14fc-482c-8e43-d00c27e2292d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:54.398874 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:14:54.414286 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06f2d9-9121-49e9-9f35-d2e68706372c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:54.414907 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06f2d9-9121-49e9-9f35-d2e68706372c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:54.415188 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06f2d9-9121-49e9-9f35-d2e68706372c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:54.415467 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06f2d9-9121-49e9-9f35-d2e68706372c None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:54.416141 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa06f2d9-9121-49e9-9f35-d2e68706372c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:14:54.416446 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa06f2d9-9121-49e9-9f35-d2e68706372c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:54.417989 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa06f2d9-9121-49e9-9f35-d2e68706372c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:54.436260 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 483/947] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:14:54.437057 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861891b0-b682-43d6-b42b-789d4454cf2c None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:54.545987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861891b0-b682-43d6-b42b-789d4454cf2c None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:54.584017 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db25ac-d1b6-4bf8-85e2-95d1c846b91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:54.584637 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db25ac-d1b6-4bf8-85e2-95d1c846b91b None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:54.584891 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db25ac-d1b6-4bf8-85e2-95d1c846b91b None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:54.585251 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db25ac-d1b6-4bf8-85e2-95d1c846b91b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:54.593747 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db25ac-d1b6-4bf8-85e2-95d1c846b91b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:54.595299 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db25ac-d1b6-4bf8-85e2-95d1c846b91b None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:54.607958 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-d3db25ac-d1b6-4bf8-85e2-95d1c846b91b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:14:54.607958 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:14:54.607958 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:14:54.607958 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:14:54.607958 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:14:54.607958 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:14:54.607958 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:14:54.607958 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:14:54.607958 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:14:54.607958 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:14:54.607958 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:14:54.607958 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:14:54.607958 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 25 13:14:54.607958 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 25 13:14:54.607958 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 25 13:14:54.609046 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 25 13:14:54.609046 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:14:54.609046 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:14:54.609046 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:14:54.609046 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:14:54.609046 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:14:54.609046 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:14:54.609046 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:14:54.609046 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:14:54.609046 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:14:54.609046 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:14:54.609046 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:14:54.609046 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:14:54.609046 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:14:54.609046 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:14:54.609046 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:14:54.609046 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:14:54.610748 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 25 13:14:54.610748 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 25 13:14:54.610748 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 25 13:14:54.610748 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 25 13:14:54.610748 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 25 13:14:54.610748 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 25 13:14:54.610748 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:14:54.610748 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:14:54.615931 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 465/948] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 25 13:14:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:14:54.616107 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06f2d9-9121-49e9-9f35-d2e68706372c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:54.729735 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06f2d9-9121-49e9-9f35-d2e68706372c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:54.768071 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657307c-b332-4ec1-925e-733353ef5d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:54.768687 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657307c-b332-4ec1-925e-733353ef5d86 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:54.768992 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657307c-b332-4ec1-925e-733353ef5d86 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:54.769274 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657307c-b332-4ec1-925e-733353ef5d86 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:54.769963 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1657307c-b332-4ec1-925e-733353ef5d86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:14:54.770271 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1657307c-b332-4ec1-925e-733353ef5d86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:54.772296 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1657307c-b332-4ec1-925e-733353ef5d86 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:54.785606 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 484/949] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 25 13:14:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:14:54.791876 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db25ac-d1b6-4bf8-85e2-95d1c846b91b None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:54.809534 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:14:54.904450 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db25ac-d1b6-4bf8-85e2-95d1c846b91b None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:54.940404 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1837244-7190-4e9e-b65b-0ff737a023bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:54.941059 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1837244-7190-4e9e-b65b-0ff737a023bb None admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:54.941338 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1837244-7190-4e9e-b65b-0ff737a023bb None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:54.941610 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1837244-7190-4e9e-b65b-0ff737a023bb None admin] PATH_INFO: `/v3/projects/616ecfe8d2c74aad9386720718392e81/users/f10c161ef74c4a0d809346a5c4b53aa3/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:54.943482 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1837244-7190-4e9e-b65b-0ff737a023bb None admin] RBAC: Authorizing `identity:create_grant(project_id=616ecfe8d2c74aad9386720718392e81, user_id=f10c161ef74c4a0d809346a5c4b53aa3, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:54.944939 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1837244-7190-4e9e-b65b-0ff737a023bb None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:54.957858 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 466/950] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 25 13:14:54 2022] PUT /identity/v3/projects/616ecfe8d2c74aad9386720718392e81/users/f10c161ef74c4a0d809346a5c4b53aa3/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:14:57.528598 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6fe27a-65ab-4d67-84a8-f0bd4f326aa5 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:57.529892 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6fe27a-65ab-4d67-84a8-f0bd4f326aa5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:57.530187 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6fe27a-65ab-4d67-84a8-f0bd4f326aa5 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:57.531993 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 485/951] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:14:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:14:57.538476 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda62d38-70db-44ec-87b5-3038906a9fc8 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:57.538934 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda62d38-70db-44ec-87b5-3038906a9fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:57.539047 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda62d38-70db-44ec-87b5-3038906a9fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:57.558171 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-cda62d38-70db-44ec-87b5-3038906a9fc8 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:14:57.559394 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-cda62d38-70db-44ec-87b5-3038906a9fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:14:57.639204 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 467/952] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:14:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 13:14:57.936422 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6fe27a-65ab-4d67-84a8-f0bd4f326aa5 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:57.981061 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:14:58.046698 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6fe27a-65ab-4d67-84a8-f0bd4f326aa5 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:58.084290 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373d693-39f3-4206-8d26-81bba5ce7b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:58.084925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373d693-39f3-4206-8d26-81bba5ce7b40 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:58.085199 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373d693-39f3-4206-8d26-81bba5ce7b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:58.085472 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373d693-39f3-4206-8d26-81bba5ce7b40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:58.096176 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1373d693-39f3-4206-8d26-81bba5ce7b40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 25 13:14:58.100970 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-1373d693-39f3-4206-8d26-81bba5ce7b40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 13:14:58.100970 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:14:58.100970 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:14:58.100970 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:14:58.100970 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:14:58.100970 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:14:58.100970 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:14:58.100970 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:14:58.100970 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:14:58.100970 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:14:58.100970 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:14:58.100970 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:14:58.100970 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 25 13:14:58.100970 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 25 13:14:58.100970 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 25 13:14:58.100970 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 25 13:14:58.102174 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 25 13:14:58.102174 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 25 13:14:58.102174 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 25 13:14:58.102174 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 25 13:14:58.102174 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:14:58.102174 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:14:58.102174 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:14:58.102174 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:14:58.102174 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:14:58.102174 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:14:58.102174 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:14:58.102174 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:14:58.102174 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:14:58.102174 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:14:58.102174 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:14:58.102174 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:14:58.103183 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:14:58.103183 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:14:58.103183 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:14:58.103183 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:14:58.103183 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 25 13:14:58.103183 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 25 13:14:58.103183 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 25 13:14:58.103183 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 25 13:14:58.103183 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 25 13:14:58.103183 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 25 13:14:58.103183 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 25 13:14:58.103183 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:14:58.103183 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 486/953] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 25 13:14:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:14:58.108813 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda62d38-70db-44ec-87b5-3038906a9fc8 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:58.112173 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:14:58.217984 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda62d38-70db-44ec-87b5-3038906a9fc8 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:58.254065 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9abb818-85e3-4852-9f9a-65e1b2aab673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:58.254663 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abb818-85e3-4852-9f9a-65e1b2aab673 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:58.254939 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abb818-85e3-4852-9f9a-65e1b2aab673 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:58.255209 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abb818-85e3-4852-9f9a-65e1b2aab673 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:58.255874 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9abb818-85e3-4852-9f9a-65e1b2aab673 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:14:58.256190 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9abb818-85e3-4852-9f9a-65e1b2aab673 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:58.257549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9abb818-85e3-4852-9f9a-65e1b2aab673 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:58.266531 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 468/954] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 25 13:14:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:14:58.272786 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373d693-39f3-4206-8d26-81bba5ce7b40 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:58.388574 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:14:58.393235 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373d693-39f3-4206-8d26-81bba5ce7b40 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:58.432161 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991b99b-8583-497c-a627-93ac979ad3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:58.432784 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991b99b-8583-497c-a627-93ac979ad3bd None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:58.433067 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991b99b-8583-497c-a627-93ac979ad3bd None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:58.433355 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991b99b-8583-497c-a627-93ac979ad3bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:58.444576 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991b99b-8583-497c-a627-93ac979ad3bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:58.446159 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991b99b-8583-497c-a627-93ac979ad3bd None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:58.461221 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-c991b99b-8583-497c-a627-93ac979ad3bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:14:58.461221 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:14:58.461221 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:14:58.461221 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:14:58.461221 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:14:58.461221 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:14:58.461221 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:14:58.461221 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:14:58.461221 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:14:58.461221 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:14:58.461221 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:14:58.461221 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:14:58.461221 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:14:58.461221 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:14:58.461221 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:14:58.461221 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:14:58.462472 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:14:58.462472 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:14:58.462472 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:14:58.462472 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:14:58.462472 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:14:58.462472 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:14:58.462472 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:14:58.462472 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:14:58.462472 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:14:58.462472 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:14:58.462472 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:14:58.462472 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:14:58.462472 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:14:58.462472 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:14:58.462472 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:14:58.462472 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:14:58.462472 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:14:58.463402 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:14:58.463402 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:14:58.463402 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:14:58.463402 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 487/955] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:14:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 25 13:14:58.469860 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9abb818-85e3-4852-9f9a-65e1b2aab673 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:58.543014 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:14:58.581282 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9abb818-85e3-4852-9f9a-65e1b2aab673 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:58.617807 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad965dd-79e3-49a3-84ef-887c39c01ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:58.618414 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad965dd-79e3-49a3-84ef-887c39c01ecc None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:58.618692 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad965dd-79e3-49a3-84ef-887c39c01ecc None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:58.618965 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad965dd-79e3-49a3-84ef-887c39c01ecc None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:58.619605 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad965dd-79e3-49a3-84ef-887c39c01ecc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:14:58.619921 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad965dd-79e3-49a3-84ef-887c39c01ecc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:58.621285 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad965dd-79e3-49a3-84ef-887c39c01ecc None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:58.634267 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 469/956] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:14:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:14:58.640876 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991b99b-8583-497c-a627-93ac979ad3bd None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:58.746788 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991b99b-8583-497c-a627-93ac979ad3bd None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:58.784528 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4650183-c232-443b-9180-73e038d2f599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:58.785157 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4650183-c232-443b-9180-73e038d2f599 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:58.785431 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4650183-c232-443b-9180-73e038d2f599 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:58.785694 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4650183-c232-443b-9180-73e038d2f599 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:58.793999 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4650183-c232-443b-9180-73e038d2f599 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:58.797094 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4650183-c232-443b-9180-73e038d2f599 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:58.811524 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-b4650183-c232-443b-9180-73e038d2f599 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 25 13:14:58.811524 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:14:58.811524 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:14:58.811524 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:14:58.811524 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:14:58.811524 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:14:58.811524 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:14:58.811524 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:14:58.811524 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:14:58.811524 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:14:58.811524 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:14:58.811524 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:14:58.811524 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 25 13:14:58.811524 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 25 13:14:58.811524 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 25 13:14:58.811524 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 25 13:14:58.812844 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:14:58.812844 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:14:58.812844 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 25 13:14:58.812844 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:14:58.812844 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 25 13:14:58.812844 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 25 13:14:58.812844 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:14:58.812844 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:14:58.812844 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:14:58.812844 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:14:58.812844 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:14:58.812844 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:14:58.812844 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:14:58.812844 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:14:58.812844 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:14:58.812844 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:14:58.812844 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:14:58.812844 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:14:58.814004 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:14:58.814004 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:14:58.814004 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 25 13:14:58.814004 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 25 13:14:58.814004 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 25 13:14:58.814004 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 25 13:14:58.814004 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 25 13:14:58.814004 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 25 13:14:58.814004 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 25 13:14:58.814004 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:14:58.814004 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 488/957] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:14:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:14:58.821450 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad965dd-79e3-49a3-84ef-887c39c01ecc None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:58.932560 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad965dd-79e3-49a3-84ef-887c39c01ecc None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:58.962302 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:14:58.973079 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e00fd-eb25-428e-9a88-df3623fbceb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:58.973730 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e00fd-eb25-428e-9a88-df3623fbceb1 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:58.974038 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e00fd-eb25-428e-9a88-df3623fbceb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:58.974342 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e00fd-eb25-428e-9a88-df3623fbceb1 None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:58.975174 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e00fd-eb25-428e-9a88-df3623fbceb1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:14:58.975557 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e00fd-eb25-428e-9a88-df3623fbceb1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:58.977024 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e00fd-eb25-428e-9a88-df3623fbceb1 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:58.996426 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 470/958] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Oct 25 13:14:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:14:59.002993 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4650183-c232-443b-9180-73e038d2f599 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:59.018869 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:14:59.114024 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4650183-c232-443b-9180-73e038d2f599 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:59.152408 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ad068-cb9c-47fc-bb18-5eca5dbf0ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:59.153007 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ad068-cb9c-47fc-bb18-5eca5dbf0ba7 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:59.153283 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ad068-cb9c-47fc-bb18-5eca5dbf0ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:59.153552 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ad068-cb9c-47fc-bb18-5eca5dbf0ba7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:59.230061 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ad068-cb9c-47fc-bb18-5eca5dbf0ba7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:59.231645 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ad068-cb9c-47fc-bb18-5eca5dbf0ba7 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:59.247728 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:14:59.343817 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 489/959] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 25 13:14:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 25 13:14:59.350223 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e00fd-eb25-428e-9a88-df3623fbceb1 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:59.470665 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e00fd-eb25-428e-9a88-df3623fbceb1 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:59.507350 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a0b6b-d771-4538-b7fa-a3d7704c2b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:59.507999 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a0b6b-d771-4538-b7fa-a3d7704c2b55 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:59.508261 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a0b6b-d771-4538-b7fa-a3d7704c2b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:59.508589 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a0b6b-d771-4538-b7fa-a3d7704c2b55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:59.520437 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a0b6b-d771-4538-b7fa-a3d7704c2b55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:59.521906 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a0b6b-d771-4538-b7fa-a3d7704c2b55 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:59.538758 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-566a0b6b-d771-4538-b7fa-a3d7704c2b55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:14:59.538758 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:14:59.538758 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:14:59.538758 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:14:59.538758 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:14:59.538758 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:14:59.538758 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:14:59.538758 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:14:59.538758 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:14:59.538758 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:14:59.538758 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:14:59.538758 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:14:59.538758 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 25 13:14:59.538758 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 25 13:14:59.538758 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 25 13:14:59.538758 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 25 13:14:59.539979 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:14:59.539979 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:14:59.539979 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:14:59.539979 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:14:59.539979 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:14:59.539979 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:14:59.539979 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:14:59.539979 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:14:59.539979 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:14:59.539979 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:14:59.539979 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:14:59.539979 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:14:59.539979 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:14:59.539979 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:14:59.539979 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:14:59.539979 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:14:59.539979 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 25 13:14:59.541114 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 25 13:14:59.541114 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 25 13:14:59.541114 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:14:59.541114 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 471/960] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:14:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:14:59.546657 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ad068-cb9c-47fc-bb18-5eca5dbf0ba7 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:59.660973 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ad068-cb9c-47fc-bb18-5eca5dbf0ba7 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:59.676086 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:14:59.699862 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4a824-1d47-415d-aa02-fb05f34bab9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:59.700540 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4a824-1d47-415d-aa02-fb05f34bab9f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:59.700833 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4a824-1d47-415d-aa02-fb05f34bab9f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:59.701193 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4a824-1d47-415d-aa02-fb05f34bab9f None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:59.701863 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4a824-1d47-415d-aa02-fb05f34bab9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:14:59.702167 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4a824-1d47-415d-aa02-fb05f34bab9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:59.703566 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4a824-1d47-415d-aa02-fb05f34bab9f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:59.718344 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 490/961] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 25 13:14:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:14:59.723098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a0b6b-d771-4538-b7fa-a3d7704c2b55 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:14:59.761047 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:14:59.831318 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a0b6b-d771-4538-b7fa-a3d7704c2b55 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:14:59.867637 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2e144-93e0-4773-a6fa-ab9187f28f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:14:59.868311 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2e144-93e0-4773-a6fa-ab9187f28f14 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:14:59.868591 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2e144-93e0-4773-a6fa-ab9187f28f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:14:59.868865 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2e144-93e0-4773-a6fa-ab9187f28f14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:14:59.877222 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2e144-93e0-4773-a6fa-ab9187f28f14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:14:59.878684 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2e144-93e0-4773-a6fa-ab9187f28f14 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:14:59.892242 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-a6e2e144-93e0-4773-a6fa-ab9187f28f14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:14:59.892242 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:14:59.892242 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:14:59.892242 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:14:59.892242 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:14:59.892242 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:14:59.892242 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:14:59.892242 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:14:59.892242 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:14:59.892242 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:14:59.892242 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:14:59.892242 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:14:59.892242 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 25 13:14:59.892242 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 25 13:14:59.892242 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 25 13:14:59.893243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 25 13:14:59.893243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:14:59.893243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:14:59.893243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:14:59.893243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:14:59.893243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:14:59.893243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:14:59.893243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:14:59.893243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Oct 25 13:14:59.893243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:14:59.893243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:14:59.893243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:14:59.893243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:14:59.893243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:14:59.893243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:14:59.893243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:14:59.893243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:14:59.894138 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 25 13:14:59.894138 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 25 13:14:59.894138 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 25 13:14:59.894138 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 25 13:14:59.894138 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 25 13:14:59.894138 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 25 13:14:59.894138 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 25 13:14:59.894138 dv-cinder-862432-2-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Oct 25 13:14:59.894138 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 472/962] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 25 13:14:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:14:59.899536 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4a824-1d47-415d-aa02-fb05f34bab9f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:15:00.008918 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4a824-1d47-415d-aa02-fb05f34bab9f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:15:00.046119 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0f726-aaa7-497c-8350-759a963dc892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:15:00.046652 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0f726-aaa7-497c-8350-759a963dc892 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:15:00.046931 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0f726-aaa7-497c-8350-759a963dc892 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:15:00.047205 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0f726-aaa7-497c-8350-759a963dc892 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:15:00.047944 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d0f726-aaa7-497c-8350-759a963dc892 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:15:00.048235 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d0f726-aaa7-497c-8350-759a963dc892 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:15:00.049675 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d0f726-aaa7-497c-8350-759a963dc892 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:15:00.063772 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 491/963] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 25 13:14:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:15:00.070393 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2e144-93e0-4773-a6fa-ab9187f28f14 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:15:00.167874 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:15:00.175184 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2e144-93e0-4773-a6fa-ab9187f28f14 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:15:00.210412 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229643c-5282-4c19-857b-d130f93e8e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:15:00.211006 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229643c-5282-4c19-857b-d130f93e8e92 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:15:00.211280 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229643c-5282-4c19-857b-d130f93e8e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:15:00.211548 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229643c-5282-4c19-857b-d130f93e8e92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:15:00.212294 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5229643c-5282-4c19-857b-d130f93e8e92 None admin] RBAC: Adding query filter params (role.id=4c7114fda3ec4652abed55516b5f4315, scope.project.id=616ecfe8d2c74aad9386720718392e81, user.id=f10c161ef74c4a0d809346a5c4b53aa3) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:15:00.212593 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5229643c-5282-4c19-857b-d130f93e8e92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:15:00.214009 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5229643c-5282-4c19-857b-d130f93e8e92 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:15:00.220551 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 473/964] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 25 13:15:00 2022] GET /identity/v3/role_assignments?user.id=f10c161ef74c4a0d809346a5c4b53aa3&scope.project.id=616ecfe8d2c74aad9386720718392e81&role.id=4c7114fda3ec4652abed55516b5f4315 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:15:02.384168 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a003c78-dc61-452e-b57f-d1c6c5fff245 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:15:02.384856 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a003c78-dc61-452e-b57f-d1c6c5fff245 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:15:02.384856 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a003c78-dc61-452e-b57f-d1c6c5fff245 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:15:02.386425 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 492/965] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:15:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:15:02.392199 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88767780-c80b-43af-b8ff-1ce57c94a00d None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:15:02.392620 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88767780-c80b-43af-b8ff-1ce57c94a00d None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:15:02.392752 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88767780-c80b-43af-b8ff-1ce57c94a00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:15:02.412499 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-88767780-c80b-43af-b8ff-1ce57c94a00d None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:15:02.414032 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-88767780-c80b-43af-b8ff-1ce57c94a00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:15:02.487000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 474/966] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:15:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 13:15:02.755255 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a003c78-dc61-452e-b57f-d1c6c5fff245 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:15:02.786666 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:15:02.856239 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a003c78-dc61-452e-b57f-d1c6c5fff245 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:15:02.890270 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7bf11-1e1c-4689-8135-090da91b00a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:15:02.890886 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7bf11-1e1c-4689-8135-090da91b00a2 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:15:02.891170 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7bf11-1e1c-4689-8135-090da91b00a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:15:02.891442 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7bf11-1e1c-4689-8135-090da91b00a2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:15:02.892041 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d7bf11-1e1c-4689-8135-090da91b00a2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:15:02.893390 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d7bf11-1e1c-4689-8135-090da91b00a2 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:15:02.901832 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-40d7bf11-1e1c-4689-8135-090da91b00a2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 25 13:15:02.901832 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:15:02.901832 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 13:15:02.901832 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 13:15:02.901832 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 13:15:02.901832 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 13:15:02.901832 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 13:15:02.901832 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:15:02.901832 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 25 13:15:02.901832 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:15:02.901832 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 13:15:02.901832 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:15:02.901832 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:15:02.901832 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:15:02.901832 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:15:02.901832 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:15:02.901832 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:15:02.904211 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:15:02.904211 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:15:02.904211 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:15:02.904211 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:15:02.904211 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:15:02.904211 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:15:02.904211 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 13:15:02.904211 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 13:15:02.904211 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 13:15:02.904211 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 13:15:02.904211 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:15:02.904211 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:15:02.904211 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:15:02.904211 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:15:02.904211 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:15:02.904211 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:15:02.905206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:15:02.905206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:15:02.905206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:15:02.905206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:15:02.905206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:15:02.905206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:15:02.905206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:15:02.905206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:15:02.905206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:15:02.905206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:15:02.905206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 13:15:02.905206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:15:02.905206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 25 13:15:02.905206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:15:02.905206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 493/967] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Oct 25 13:15:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:15:02.909214 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88767780-c80b-43af-b8ff-1ce57c94a00d None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:15:02.995607 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:15:03.005776 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88767780-c80b-43af-b8ff-1ce57c94a00d None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:15:03.037517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b381f8-09e3-46eb-a43e-e29d9c768924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:15:03.038102 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b381f8-09e3-46eb-a43e-e29d9c768924 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:15:03.038374 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b381f8-09e3-46eb-a43e-e29d9c768924 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:15:03.038639 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b381f8-09e3-46eb-a43e-e29d9c768924 None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:15:03.039251 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b381f8-09e3-46eb-a43e-e29d9c768924 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:15:03.039629 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b381f8-09e3-46eb-a43e-e29d9c768924 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:15:03.041001 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b381f8-09e3-46eb-a43e-e29d9c768924 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:15:03.046337 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 475/968] 10.222.0.25 () {56 vars in 1116 bytes} [Tue Oct 25 13:15:02 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:15:03.051997 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7bf11-1e1c-4689-8135-090da91b00a2 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:15:03.142293 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:15:03.148458 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7bf11-1e1c-4689-8135-090da91b00a2 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:15:03.181573 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0442357-2603-42c5-a040-e957e66974b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:15:03.182169 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0442357-2603-42c5-a040-e957e66974b8 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:15:03.182446 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0442357-2603-42c5-a040-e957e66974b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:15:03.182717 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0442357-2603-42c5-a040-e957e66974b8 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:15:03.183356 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0442357-2603-42c5-a040-e957e66974b8 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:15:03.183660 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0442357-2603-42c5-a040-e957e66974b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:15:03.185763 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0442357-2603-42c5-a040-e957e66974b8 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:15:03.190166 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 494/969] 10.222.0.25 () {56 vars in 1116 bytes} [Tue Oct 25 13:15:03 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:15:05.318606 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6be5cd-f36e-465d-8d12-561439c4ab8f None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:15:05.319242 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6be5cd-f36e-465d-8d12-561439c4ab8f None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:15:05.319242 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6be5cd-f36e-465d-8d12-561439c4ab8f None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:15:05.320503 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 476/970] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:15:05.326050 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef5319-317a-4c3d-93e5-905622f40462 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:15:05.326483 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef5319-317a-4c3d-93e5-905622f40462 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:15:05.326657 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef5319-317a-4c3d-93e5-905622f40462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:15:05.348135 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c6ef5319-317a-4c3d-93e5-905622f40462 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:15:05.349537 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c6ef5319-317a-4c3d-93e5-905622f40462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:15:05.416518 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 495/971] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:15:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 13:15:05.683346 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6be5cd-f36e-465d-8d12-561439c4ab8f None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:15:05.783548 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6be5cd-f36e-465d-8d12-561439c4ab8f None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:15:05.816858 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b69d67-3f92-4bc3-abdc-0b31c2864916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:15:05.817453 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b69d67-3f92-4bc3-abdc-0b31c2864916 None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:15:05.817734 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b69d67-3f92-4bc3-abdc-0b31c2864916 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:15:05.818007 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b69d67-3f92-4bc3-abdc-0b31c2864916 None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:15:05.818648 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b69d67-3f92-4bc3-abdc-0b31c2864916 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:15:05.820033 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b69d67-3f92-4bc3-abdc-0b31c2864916 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:15:05.834405 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 477/972] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Oct 25 13:15:05 2022] POST /identity/v3/services => generated 246 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:15:07.977089 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd27f7e-4c6f-4361-8373-5f0cb620e851 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:15:07.977603 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd27f7e-4c6f-4361-8373-5f0cb620e851 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:15:07.977603 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd27f7e-4c6f-4361-8373-5f0cb620e851 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:15:07.978871 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 496/973] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:15:07.984528 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae4a51-e7fc-4252-ad4f-782a910044db None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:15:07.984930 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae4a51-e7fc-4252-ad4f-782a910044db None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:15:07.985086 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae4a51-e7fc-4252-ad4f-782a910044db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:15:08.002793 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-72ae4a51-e7fc-4252-ad4f-782a910044db None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:15:08.003994 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-72ae4a51-e7fc-4252-ad4f-782a910044db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:15:08.013080 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:15:08.076511 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 478/974] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:15:07 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 13:15:08.348828 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd27f7e-4c6f-4361-8373-5f0cb620e851 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:15:08.445749 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:15:08.457045 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd27f7e-4c6f-4361-8373-5f0cb620e851 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:15:08.490905 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca86f1-f357-4fa6-8d85-ed8bc8dd0fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:15:08.491519 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca86f1-f357-4fa6-8d85-ed8bc8dd0fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:15:08.491793 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca86f1-f357-4fa6-8d85-ed8bc8dd0fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:15:08.492088 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca86f1-f357-4fa6-8d85-ed8bc8dd0fb5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:15:08.492653 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca86f1-f357-4fa6-8d85-ed8bc8dd0fb5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:15:08.494003 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca86f1-f357-4fa6-8d85-ed8bc8dd0fb5 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:15:08.502883 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-9aca86f1-f357-4fa6-8d85-ed8bc8dd0fb5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 25 13:15:08.502883 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:15:08.502883 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 13:15:08.502883 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 13:15:08.502883 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 13:15:08.502883 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 13:15:08.502883 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 13:15:08.502883 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:15:08.502883 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 25 13:15:08.502883 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:15:08.502883 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 13:15:08.502883 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:15:08.502883 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:15:08.502883 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:15:08.502883 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:15:08.502883 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:15:08.502883 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:15:08.504066 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:15:08.504066 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:15:08.504066 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:15:08.504066 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:15:08.504066 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:15:08.504066 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:15:08.504066 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 13:15:08.504066 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 13:15:08.504066 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 13:15:08.504066 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 13:15:08.504066 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:15:08.504066 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:15:08.504066 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:15:08.504066 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:15:08.504066 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:15:08.504066 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:15:08.505288 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:15:08.505288 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:15:08.505288 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:15:08.505288 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:15:08.505288 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:15:08.505288 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:15:08.505288 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:15:08.505288 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:15:08.505288 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:15:08.505288 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:15:08.505288 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 13:15:08.505288 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:15:08.505288 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 25 13:15:08.505288 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:15:08.505288 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 497/975] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Oct 25 13:15:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:15:08.510122 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae4a51-e7fc-4252-ad4f-782a910044db None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:15:08.609860 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae4a51-e7fc-4252-ad4f-782a910044db None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:15:08.644300 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e35fa8-de00-4a9a-879f-cc688d4d4784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:15:08.644892 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e35fa8-de00-4a9a-879f-cc688d4d4784 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:15:08.645173 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e35fa8-de00-4a9a-879f-cc688d4d4784 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:15:08.645448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e35fa8-de00-4a9a-879f-cc688d4d4784 None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:15:08.646070 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e35fa8-de00-4a9a-879f-cc688d4d4784 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:15:08.646373 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e35fa8-de00-4a9a-879f-cc688d4d4784 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:15:08.647737 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e35fa8-de00-4a9a-879f-cc688d4d4784 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:15:08.652773 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 479/976] 10.222.0.25 () {56 vars in 1116 bytes} [Tue Oct 25 13:15:08 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:15:08.658709 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca86f1-f357-4fa6-8d85-ed8bc8dd0fb5 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:15:08.756048 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca86f1-f357-4fa6-8d85-ed8bc8dd0fb5 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:15:08.788666 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a5761-bb31-434a-a64b-a3404e8b5bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:15:08.789264 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a5761-bb31-434a-a64b-a3404e8b5bc4 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:15:08.789547 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a5761-bb31-434a-a64b-a3404e8b5bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:15:08.789823 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a5761-bb31-434a-a64b-a3404e8b5bc4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:15:08.790513 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a5761-bb31-434a-a64b-a3404e8b5bc4 None admin] RBAC: Adding query filter params (interface=public, service_id=303779e4673c41b5bcc97cb84b0ca42c, region_id=RegionOne) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:15:08.790822 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a5761-bb31-434a-a64b-a3404e8b5bc4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:15:08.792198 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a5761-bb31-434a-a64b-a3404e8b5bc4 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:15:08.797347 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 498/977] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Oct 25 13:15:08 2022] GET /identity/v3/endpoints?service_id=303779e4673c41b5bcc97cb84b0ca42c&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:15:08.802950 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e35fa8-de00-4a9a-879f-cc688d4d4784 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:15:08.806679 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:15:08.900780 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e35fa8-de00-4a9a-879f-cc688d4d4784 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:15:08.933955 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2270792-b707-4904-b5c1-f335ac7c0b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:15:08.934548 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2270792-b707-4904-b5c1-f335ac7c0b2c None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:15:08.935406 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2270792-b707-4904-b5c1-f335ac7c0b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:15:08.935682 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2270792-b707-4904-b5c1-f335ac7c0b2c None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:15:08.936310 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2270792-b707-4904-b5c1-f335ac7c0b2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:15:08.937664 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2270792-b707-4904-b5c1-f335ac7c0b2c None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:15:08.944331 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 480/978] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Oct 25 13:15:08 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:15:11.083425 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6304ff3-d80d-4073-ac3b-0bc5acdf5a1f None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:15:11.083960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6304ff3-d80d-4073-ac3b-0bc5acdf5a1f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:15:11.083960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6304ff3-d80d-4073-ac3b-0bc5acdf5a1f None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:15:11.085256 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 499/979] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:15:11.090439 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d76f5a-488c-4613-a60e-a7430add5403 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:15:11.090867 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d76f5a-488c-4613-a60e-a7430add5403 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:15:11.091497 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d76f5a-488c-4613-a60e-a7430add5403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:15:11.109889 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-91d76f5a-488c-4613-a60e-a7430add5403 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:15:11.111058 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-91d76f5a-488c-4613-a60e-a7430add5403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:15:11.171051 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:15:11.176880 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 481/980] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:15:11 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 25 13:15:11.458702 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6304ff3-d80d-4073-ac3b-0bc5acdf5a1f None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:15:11.478720 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:15:11.559527 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6304ff3-d80d-4073-ac3b-0bc5acdf5a1f None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:15:11.593084 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e0ade-ae02-415b-a103-3911a406a172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:15:11.593697 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e0ade-ae02-415b-a103-3911a406a172 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:15:11.593974 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e0ade-ae02-415b-a103-3911a406a172 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:15:11.594244 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e0ade-ae02-415b-a103-3911a406a172 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:15:11.594813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e0ade-ae02-415b-a103-3911a406a172 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:15:11.596195 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e0ade-ae02-415b-a103-3911a406a172 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:15:11.604615 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-070e0ade-ae02-415b-a103-3911a406a172 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 25 13:15:11.604615 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:15:11.604615 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 25 13:15:11.604615 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 25 13:15:11.604615 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 25 13:15:11.604615 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 25 13:15:11.604615 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 25 13:15:11.604615 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:15:11.604615 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 25 13:15:11.604615 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:15:11.604615 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 25 13:15:11.604615 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:15:11.604615 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 25 13:15:11.604615 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 25 13:15:11.604615 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 25 13:15:11.604615 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 25 13:15:11.604615 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 25 13:15:11.605800 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 25 13:15:11.605800 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 25 13:15:11.605800 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 25 13:15:11.605800 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 25 13:15:11.605800 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 25 13:15:11.605800 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 25 13:15:11.605800 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 25 13:15:11.605800 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 25 13:15:11.605800 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 25 13:15:11.605800 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 25 13:15:11.605800 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 25 13:15:11.605800 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 25 13:15:11.605800 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 25 13:15:11.605800 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 25 13:15:11.605800 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 25 13:15:11.605800 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 25 13:15:11.607003 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 25 13:15:11.607003 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 25 13:15:11.607003 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 25 13:15:11.607003 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 25 13:15:11.607003 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 25 13:15:11.607003 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 25 13:15:11.607003 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 25 13:15:11.607003 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 25 13:15:11.607003 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 25 13:15:11.607003 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 25 13:15:11.607003 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 25 13:15:11.607003 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 25 13:15:11.607003 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 25 13:15:11.607003 dv-cinder-862432-2-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 25 13:15:11.607003 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 500/981] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Oct 25 13:15:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 25 13:15:11.611806 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d76f5a-488c-4613-a60e-a7430add5403 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:15:11.709622 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d76f5a-488c-4613-a60e-a7430add5403 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:15:11.743266 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f4a89-de98-4515-9561-0b475c6629be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:15:11.743864 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f4a89-de98-4515-9561-0b475c6629be None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:15:11.744175 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f4a89-de98-4515-9561-0b475c6629be None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:15:11.744447 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f4a89-de98-4515-9561-0b475c6629be None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:15:11.745066 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f4a89-de98-4515-9561-0b475c6629be None admin] RBAC: Adding query filter params (name=placement) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:15:11.745365 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f4a89-de98-4515-9561-0b475c6629be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:15:11.746716 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f4a89-de98-4515-9561-0b475c6629be None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:15:11.752280 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 482/982] 10.222.0.25 () {56 vars in 1116 bytes} [Tue Oct 25 13:15:11 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:15:11.757940 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e0ade-ae02-415b-a103-3911a406a172 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:15:11.836686 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:15:11.854188 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e0ade-ae02-415b-a103-3911a406a172 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:15:11.886171 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772461c-4607-4ce7-ade2-e0ecc1f931d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:15:11.886754 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772461c-4607-4ce7-ade2-e0ecc1f931d8 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:15:11.887032 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772461c-4607-4ce7-ade2-e0ecc1f931d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:15:11.887304 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772461c-4607-4ce7-ade2-e0ecc1f931d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:15:11.888260 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772461c-4607-4ce7-ade2-e0ecc1f931d8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:15:11.889617 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772461c-4607-4ce7-ade2-e0ecc1f931d8 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:15:11.908360 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 501/983] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:15:11 2022] POST /identity/v3/endpoints => generated 331 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:15:21.749275 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=69 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:15:21.904303 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:16:16.937988 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ddfb9-c0f1-484b-ad18-e849c76be8da None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:16:16.938459 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ddfb9-c0f1-484b-ad18-e849c76be8da None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:16:16.938546 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ddfb9-c0f1-484b-ad18-e849c76be8da None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:16:16.945046 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63fb17-01ce-427b-8562-1ced341995a6 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:16:16.945438 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63fb17-01ce-427b-8562-1ced341995a6 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:16:16.945560 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63fb17-01ce-427b-8562-1ced341995a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:16:16.948725 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 483/984] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:16:16 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:16:17.112043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-ea63fb17-01ce-427b-8562-1ced341995a6 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:16:17.114978 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ea63fb17-01ce-427b-8562-1ced341995a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:16:17.324077 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 502/985] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:16:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:16:17.648248 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb605a4-cbad-4e9b-9893-981d55d0fc7f None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:16:17.648946 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb605a4-cbad-4e9b-9893-981d55d0fc7f None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:16:17.649432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb605a4-cbad-4e9b-9893-981d55d0fc7f None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:16:17.651416 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 484/986] 10.222.0.25 () {54 vars in 964 bytes} [Tue Oct 25 13:16:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:16:17.660652 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15dc31-4f3b-4537-b27f-e579b3a3009f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:16:17.660980 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15dc31-4f3b-4537-b27f-e579b3a3009f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:16:17.661209 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15dc31-4f3b-4537-b27f-e579b3a3009f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:16:17.761120 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-8b15dc31-4f3b-4537-b27f-e579b3a3009f None None] MFA Rules not processed for user `cec40e8c81fe4eafb474d40bc7bf38fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:16:17.762540 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8b15dc31-4f3b-4537-b27f-e579b3a3009f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:16:17.789433 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:16:17.855404 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 503/987] 10.222.0.25 () {58 vars in 1061 bytes} [Tue Oct 25 13:16:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:16:17.864904 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb605a4-cbad-4e9b-9893-981d55d0fc7f None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:16:17.866701 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-8bb605a4-cbad-4e9b-9893-981d55d0fc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:16:17.990727 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb605a4-cbad-4e9b-9893-981d55d0fc7f None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:16:18.070569 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f840998-492f-4754-a557-28157f44b935 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:16:18.071179 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f840998-492f-4754-a557-28157f44b935 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:16:18.071454 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f840998-492f-4754-a557-28157f44b935 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:16:18.071722 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f840998-492f-4754-a557-28157f44b935 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:16:18.073369 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-0f840998-492f-4754-a557-28157f44b935 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:16:18.133872 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:16:18.194590 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f840998-492f-4754-a557-28157f44b935 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:16:18.196152 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f840998-492f-4754-a557-28157f44b935 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:16:18.217455 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 485/988] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:16:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:16:20.727024 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d7278-8709-48df-b62f-560367cdc241 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:16:20.727508 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d7278-8709-48df-b62f-560367cdc241 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:16:20.727602 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d7278-8709-48df-b62f-560367cdc241 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:16:20.728922 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 504/989] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:16:20.734929 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4f6bd-be49-4535-b2e5-d6a7c5f97088 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:16:20.735320 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4f6bd-be49-4535-b2e5-d6a7c5f97088 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:16:20.735507 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4f6bd-be49-4535-b2e5-d6a7c5f97088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:16:20.806054 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-6de4f6bd-be49-4535-b2e5-d6a7c5f97088 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:16:20.807477 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-6de4f6bd-be49-4535-b2e5-d6a7c5f97088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:16:20.900688 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 486/990] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:16:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:16:21.184968 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d7278-8709-48df-b62f-560367cdc241 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:16:21.186508 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-135d7278-8709-48df-b62f-560367cdc241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:16:21.288162 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d7278-8709-48df-b62f-560367cdc241 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:16:21.360288 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:16:21.362721 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8be414-399d-4e57-927f-79f29b6e645a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:16:21.363506 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8be414-399d-4e57-927f-79f29b6e645a service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:16:21.363825 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8be414-399d-4e57-927f-79f29b6e645a service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:16:21.364311 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8be414-399d-4e57-927f-79f29b6e645a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:16:21.366134 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-eb8be414-399d-4e57-927f-79f29b6e645a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:16:21.476246 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8be414-399d-4e57-927f-79f29b6e645a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:16:21.477585 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8be414-399d-4e57-927f-79f29b6e645a service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:16:21.495973 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 505/991] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:16:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:16:24.058167 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc0491-5d8c-4150-8f95-c04e819dc81a None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:16:24.058708 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc0491-5d8c-4150-8f95-c04e819dc81a None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:16:24.058708 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc0491-5d8c-4150-8f95-c04e819dc81a None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:16:24.060157 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 487/992] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:16:24.065256 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ee255-9db2-439e-9cc9-f9abe959be38 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:16:24.065704 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ee255-9db2-439e-9cc9-f9abe959be38 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:16:24.065841 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ee255-9db2-439e-9cc9-f9abe959be38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:16:24.131127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-761ee255-9db2-439e-9cc9-f9abe959be38 None None] MFA Rules not processed for user `6a911634c03e45ff8c7a4949e74b4c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:16:24.132351 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-761ee255-9db2-439e-9cc9-f9abe959be38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:16:24.185321 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:16:24.230018 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 506/993] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:16:24 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:16:24.515302 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc0491-5d8c-4150-8f95-c04e819dc81a None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:16:24.516860 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-7bfc0491-5d8c-4150-8f95-c04e819dc81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:16:24.526532 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:16:24.618097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc0491-5d8c-4150-8f95-c04e819dc81a None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:16:24.693183 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e3587-3b9c-432c-b1dc-7768fa142b33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:16:24.693775 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e3587-3b9c-432c-b1dc-7768fa142b33 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:16:24.694050 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e3587-3b9c-432c-b1dc-7768fa142b33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:16:24.694317 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e3587-3b9c-432c-b1dc-7768fa142b33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:16:24.695873 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-416e3587-3b9c-432c-b1dc-7768fa142b33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:16:24.759261 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:16:24.806441 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e3587-3b9c-432c-b1dc-7768fa142b33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:16:24.807853 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e3587-3b9c-432c-b1dc-7768fa142b33 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:16:24.826010 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 488/994] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:16:24 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:16:27.524198 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95468a-5d2b-43fd-9f3d-0e949384fc2b None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:16:27.524754 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95468a-5d2b-43fd-9f3d-0e949384fc2b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:16:27.524754 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95468a-5d2b-43fd-9f3d-0e949384fc2b None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:16:27.526061 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 507/995] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:16:27.532521 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343a7db-6243-45ff-bf2c-cdd90d096ec1 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:16:27.532936 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343a7db-6243-45ff-bf2c-cdd90d096ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:16:27.533073 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343a7db-6243-45ff-bf2c-cdd90d096ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:16:27.598071 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-c343a7db-6243-45ff-bf2c-cdd90d096ec1 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:16:27.599265 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c343a7db-6243-45ff-bf2c-cdd90d096ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:16:27.693953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 489/996] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:16:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:16:27.989026 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc95468a-5d2b-43fd-9f3d-0e949384fc2b None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:16:27.990576 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-bc95468a-5d2b-43fd-9f3d-0e949384fc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:16:28.094750 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc95468a-5d2b-43fd-9f3d-0e949384fc2b None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:16:28.167271 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244d121-f08e-46d1-a006-332506a0a0e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:16:28.167866 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244d121-f08e-46d1-a006-332506a0a0e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:16:28.168176 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244d121-f08e-46d1-a006-332506a0a0e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:16:28.168894 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244d121-f08e-46d1-a006-332506a0a0e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:16:28.170472 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d244d121-f08e-46d1-a006-332506a0a0e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:16:28.177414 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:16:28.280381 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d244d121-f08e-46d1-a006-332506a0a0e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:16:28.281721 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d244d121-f08e-46d1-a006-332506a0a0e4 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:16:28.300183 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 508/997] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:16:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:16:31.107747 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571edf6-3d70-4909-871d-26f9ef528c38 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:16:31.108288 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571edf6-3d70-4909-871d-26f9ef528c38 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:16:31.108288 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571edf6-3d70-4909-871d-26f9ef528c38 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:16:31.109579 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 490/998] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:16:31.114744 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53f9e0-a192-4e1a-b459-a0ced4e6a662 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:16:31.115181 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53f9e0-a192-4e1a-b459-a0ced4e6a662 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:16:31.115287 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53f9e0-a192-4e1a-b459-a0ced4e6a662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:16:31.189775 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-bc53f9e0-a192-4e1a-b459-a0ced4e6a662 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:16:31.191017 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-bc53f9e0-a192-4e1a-b459-a0ced4e6a662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:16:31.256133 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:16:31.298007 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 509/999] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:16:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:16:31.600131 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212b4b0-4362-4d8b-8144-6fc64930ded8 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:16:31.600501 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212b4b0-4362-4d8b-8144-6fc64930ded8 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:16:31.600844 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212b4b0-4362-4d8b-8144-6fc64930ded8 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:16:31.602263 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 491/1000] 10.222.0.25 () {54 vars in 964 bytes} [Tue Oct 25 13:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:16:31.608765 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656da5e-c87a-4369-a89b-e006caf221ba None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:16:31.609052 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656da5e-c87a-4369-a89b-e006caf221ba None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:16:31.609327 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656da5e-c87a-4369-a89b-e006caf221ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:16:31.687166 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f656da5e-c87a-4369-a89b-e006caf221ba None None] MFA Rules not processed for user `cec40e8c81fe4eafb474d40bc7bf38fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:16:31.688399 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f656da5e-c87a-4369-a89b-e006caf221ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:16:31.766575 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 510/1001] 10.222.0.25 () {58 vars in 1061 bytes} [Tue Oct 25 13:16:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:16:31.775345 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212b4b0-4362-4d8b-8144-6fc64930ded8 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:16:31.776903 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c212b4b0-4362-4d8b-8144-6fc64930ded8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:16:31.797432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:16:31.882591 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212b4b0-4362-4d8b-8144-6fc64930ded8 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:16:31.958009 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acaeaa2-d51c-450a-8c46-c3c784258121 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:16:31.958606 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acaeaa2-d51c-450a-8c46-c3c784258121 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:16:31.958883 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acaeaa2-d51c-450a-8c46-c3c784258121 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:16:31.959152 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acaeaa2-d51c-450a-8c46-c3c784258121 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:16:31.960830 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2acaeaa2-d51c-450a-8c46-c3c784258121 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:16:32.039793 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:16:32.079299 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acaeaa2-d51c-450a-8c46-c3c784258121 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:16:32.080767 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acaeaa2-d51c-450a-8c46-c3c784258121 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:16:32.099164 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 492/1002] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:16:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:16:34.542704 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f9516-a786-463f-bf31-883a397dab3d None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:16:34.543256 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f9516-a786-463f-bf31-883a397dab3d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:16:34.543256 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f9516-a786-463f-bf31-883a397dab3d None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:16:34.545120 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 511/1003] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:16:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:16:34.550609 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cc67d-e7dc-44ef-9f38-a525a5ceb081 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:16:34.551018 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cc67d-e7dc-44ef-9f38-a525a5ceb081 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:16:34.551161 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cc67d-e7dc-44ef-9f38-a525a5ceb081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:16:34.617777 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-676cc67d-e7dc-44ef-9f38-a525a5ceb081 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:16:34.618979 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-676cc67d-e7dc-44ef-9f38-a525a5ceb081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:16:34.718626 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 493/1004] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:16:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:16:34.999125 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f9516-a786-463f-bf31-883a397dab3d None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:16:35.000704 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cf1f9516-a786-463f-bf31-883a397dab3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:16:35.063712 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:16:35.111361 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f9516-a786-463f-bf31-883a397dab3d None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:16:35.192468 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867e389-7375-45bd-a9c1-5c9d050e99f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:16:35.193097 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867e389-7375-45bd-a9c1-5c9d050e99f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:16:35.193371 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867e389-7375-45bd-a9c1-5c9d050e99f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:16:35.193638 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867e389-7375-45bd-a9c1-5c9d050e99f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:16:35.195285 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9867e389-7375-45bd-a9c1-5c9d050e99f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:16:35.313817 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:16:35.316423 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867e389-7375-45bd-a9c1-5c9d050e99f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:16:35.318039 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867e389-7375-45bd-a9c1-5c9d050e99f3 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:16:35.339061 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 512/1005] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:16:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 13:16:37.581521 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da0318-1d94-497a-9463-dd54de8000d0 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:16:37.582009 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da0318-1d94-497a-9463-dd54de8000d0 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:16:37.582093 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da0318-1d94-497a-9463-dd54de8000d0 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:16:37.583725 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 494/1006] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:16:37.589159 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f648dd3-1574-4a67-b9d8-eb97cf4768be None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:16:37.589646 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f648dd3-1574-4a67-b9d8-eb97cf4768be None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:16:37.589740 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f648dd3-1574-4a67-b9d8-eb97cf4768be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:16:37.659482 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-6f648dd3-1574-4a67-b9d8-eb97cf4768be None None] MFA Rules not processed for user `6a911634c03e45ff8c7a4949e74b4c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:16:37.661126 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6f648dd3-1574-4a67-b9d8-eb97cf4768be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:16:37.763142 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 513/1007] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:16:37 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:16:38.058283 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da0318-1d94-497a-9463-dd54de8000d0 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:16:38.060890 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-32da0318-1d94-497a-9463-dd54de8000d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:16:38.093316 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:16:38.169484 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da0318-1d94-497a-9463-dd54de8000d0 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:16:38.245579 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac09021-830a-40ed-9d1c-cc8614337544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:16:38.246176 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac09021-830a-40ed-9d1c-cc8614337544 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:16:38.247076 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac09021-830a-40ed-9d1c-cc8614337544 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:16:38.247349 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac09021-830a-40ed-9d1c-cc8614337544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:16:38.248964 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-0ac09021-830a-40ed-9d1c-cc8614337544 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:16:38.331750 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:16:38.364239 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac09021-830a-40ed-9d1c-cc8614337544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:16:38.365604 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac09021-830a-40ed-9d1c-cc8614337544 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:16:38.385403 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 495/1008] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:16:38 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:16:40.792004 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b83239-ae1e-4beb-8ea0-3c66e38ca316 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:16:40.792488 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b83239-ae1e-4beb-8ea0-3c66e38ca316 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:16:40.792595 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b83239-ae1e-4beb-8ea0-3c66e38ca316 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:16:40.794407 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 514/1009] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:16:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:16:40.800002 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9de53-b867-46bd-a974-548c78f83e8b None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:16:40.800454 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9de53-b867-46bd-a974-548c78f83e8b None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:16:40.800555 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9de53-b867-46bd-a974-548c78f83e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:16:40.867303 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-d4e9de53-b867-46bd-a974-548c78f83e8b None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:16:40.868521 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-d4e9de53-b867-46bd-a974-548c78f83e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:16:40.964812 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 496/1010] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:16:41.248801 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b83239-ae1e-4beb-8ea0-3c66e38ca316 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:16:41.250339 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-95b83239-ae1e-4beb-8ea0-3c66e38ca316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:16:41.320131 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:16:41.353827 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b83239-ae1e-4beb-8ea0-3c66e38ca316 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:16:41.426722 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdecb85c-5dc1-4c52-8249-7e9879cd2749 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:16:41.427325 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecb85c-5dc1-4c52-8249-7e9879cd2749 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:16:41.427602 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecb85c-5dc1-4c52-8249-7e9879cd2749 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:16:41.427873 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecb85c-5dc1-4c52-8249-7e9879cd2749 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:16:41.429487 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cdecb85c-5dc1-4c52-8249-7e9879cd2749 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:16:41.540485 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdecb85c-5dc1-4c52-8249-7e9879cd2749 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:16:41.541835 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdecb85c-5dc1-4c52-8249-7e9879cd2749 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:16:41.553318 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:16:41.562627 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 515/1011] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:16:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:16:43.798758 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269fc93-b5ff-43dd-add1-e12c3d531d16 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:16:43.799269 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269fc93-b5ff-43dd-add1-e12c3d531d16 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:16:43.799269 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269fc93-b5ff-43dd-add1-e12c3d531d16 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:16:43.800609 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 497/1012] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:16:43.805894 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1bb6e1-6654-49d1-baac-83e15d67d7b4 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:16:43.806285 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1bb6e1-6654-49d1-baac-83e15d67d7b4 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:16:43.806447 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1bb6e1-6654-49d1-baac-83e15d67d7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:16:43.872677 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-9a1bb6e1-6654-49d1-baac-83e15d67d7b4 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:16:43.873884 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9a1bb6e1-6654-49d1-baac-83e15d67d7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:16:43.969663 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 516/1013] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:16:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:16:44.254730 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6269fc93-b5ff-43dd-add1-e12c3d531d16 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:16:44.256300 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-6269fc93-b5ff-43dd-add1-e12c3d531d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:16:44.296848 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:16:44.361401 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6269fc93-b5ff-43dd-add1-e12c3d531d16 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:16:44.432875 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a266bc-c8ee-4db1-bc2c-104f400da75f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:16:44.433466 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a266bc-c8ee-4db1-bc2c-104f400da75f service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:16:44.433740 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a266bc-c8ee-4db1-bc2c-104f400da75f service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:16:44.434590 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a266bc-c8ee-4db1-bc2c-104f400da75f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:16:44.436367 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-20a266bc-c8ee-4db1-bc2c-104f400da75f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:16:44.518299 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:16:44.544652 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a266bc-c8ee-4db1-bc2c-104f400da75f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:16:44.546100 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a266bc-c8ee-4db1-bc2c-104f400da75f service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:16:44.565076 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 498/1014] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:16:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:16:47.026515 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5e45d-c4dc-4ce4-ad02-b041c8f44a9e None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:16:47.027042 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5e45d-c4dc-4ce4-ad02-b041c8f44a9e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:16:47.027042 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5e45d-c4dc-4ce4-ad02-b041c8f44a9e None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:16:47.028916 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 517/1015] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:16:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:16:47.034057 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b7008-3c21-4fbb-8ad5-2fbedc770ae5 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:16:47.034459 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b7008-3c21-4fbb-8ad5-2fbedc770ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:16:47.034618 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b7008-3c21-4fbb-8ad5-2fbedc770ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:16:47.099843 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-cc8b7008-3c21-4fbb-8ad5-2fbedc770ae5 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:16:47.101046 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-cc8b7008-3c21-4fbb-8ad5-2fbedc770ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:16:47.196715 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 499/1016] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:16:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:16:47.487125 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5e45d-c4dc-4ce4-ad02-b041c8f44a9e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:16:47.488731 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-47d5e45d-c4dc-4ce4-ad02-b041c8f44a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:16:47.569291 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:16:47.598178 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5e45d-c4dc-4ce4-ad02-b041c8f44a9e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:16:47.671060 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a154636-73a9-4437-a9d9-aeb44d96b980 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:16:47.671651 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a154636-73a9-4437-a9d9-aeb44d96b980 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:16:47.671951 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a154636-73a9-4437-a9d9-aeb44d96b980 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:16:47.672489 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a154636-73a9-4437-a9d9-aeb44d96b980 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:16:47.674067 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6a154636-73a9-4437-a9d9-aeb44d96b980 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:16:47.781494 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a154636-73a9-4437-a9d9-aeb44d96b980 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:16:47.782857 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a154636-73a9-4437-a9d9-aeb44d96b980 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:16:47.801485 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 518/1017] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:16:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:16:51.885243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b5548-3bd4-4115-a1cd-64bc0cfea832 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:16:51.885790 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b5548-3bd4-4115-a1cd-64bc0cfea832 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:16:51.885790 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b5548-3bd4-4115-a1cd-64bc0cfea832 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:16:51.888368 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 500/1018] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:16:51.893455 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a274e-a9c7-4816-be86-5d5049f76d31 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:16:51.893855 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a274e-a9c7-4816-be86-5d5049f76d31 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:16:51.894119 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a274e-a9c7-4816-be86-5d5049f76d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:16:51.899668 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:16:51.962057 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e50a274e-a9c7-4816-be86-5d5049f76d31 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:16:51.963160 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e50a274e-a9c7-4816-be86-5d5049f76d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:16:52.061216 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 519/1019] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:16:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:16:52.346480 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b5548-3bd4-4115-a1cd-64bc0cfea832 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:16:52.348415 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-577b5548-3bd4-4115-a1cd-64bc0cfea832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:16:52.398479 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:16:52.456520 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b5548-3bd4-4115-a1cd-64bc0cfea832 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:16:52.532327 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9af65-9c5a-4635-8e6a-438292b4bb3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:16:52.532928 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9af65-9c5a-4635-8e6a-438292b4bb3f service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:16:52.533201 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9af65-9c5a-4635-8e6a-438292b4bb3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:16:52.533471 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9af65-9c5a-4635-8e6a-438292b4bb3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:16:52.535031 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-bcf9af65-9c5a-4635-8e6a-438292b4bb3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:16:52.628919 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:16:52.646147 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9af65-9c5a-4635-8e6a-438292b4bb3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:16:52.647588 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9af65-9c5a-4635-8e6a-438292b4bb3f service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:16:52.666680 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 501/1020] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:16:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:16:55.497296 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f13136-4416-4d69-a6fc-a18f4c928fff None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:16:55.497851 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f13136-4416-4d69-a6fc-a18f4c928fff None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:16:55.497851 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f13136-4416-4d69-a6fc-a18f4c928fff None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:16:55.499324 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 520/1021] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:16:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:16:55.504593 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c3406-672a-4421-935b-1d019a8cc242 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:16:55.504980 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c3406-672a-4421-935b-1d019a8cc242 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:16:55.505133 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c3406-672a-4421-935b-1d019a8cc242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:16:55.571864 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-6a9c3406-672a-4421-935b-1d019a8cc242 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:16:55.573087 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-6a9c3406-672a-4421-935b-1d019a8cc242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:16:55.671834 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 502/1022] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:16:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:16:55.956957 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f13136-4416-4d69-a6fc-a18f4c928fff None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:16:55.958534 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a3f13136-4416-4d69-a6fc-a18f4c928fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:16:56.053254 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:16:56.071877 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f13136-4416-4d69-a6fc-a18f4c928fff None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:16:56.148747 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debaf1ef-be7c-4636-bad6-09b9274699b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:16:56.149348 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debaf1ef-be7c-4636-bad6-09b9274699b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:16:56.149624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debaf1ef-be7c-4636-bad6-09b9274699b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:16:56.149893 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debaf1ef-be7c-4636-bad6-09b9274699b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:16:56.151457 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-debaf1ef-be7c-4636-bad6-09b9274699b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:16:56.267613 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debaf1ef-be7c-4636-bad6-09b9274699b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:16:56.269088 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debaf1ef-be7c-4636-bad6-09b9274699b1 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:16:56.287526 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 521/1023] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:16:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:17:00.441952 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d82ecc-7493-421a-b4f8-6874b343e1c8 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:00.442448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d82ecc-7493-421a-b4f8-6874b343e1c8 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:00.442540 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d82ecc-7493-421a-b4f8-6874b343e1c8 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:00.443853 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 503/1024] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:17:00.448995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81c103-bdcf-49dd-acf0-9afe265351d2 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:00.450001 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81c103-bdcf-49dd-acf0-9afe265351d2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:00.450247 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81c103-bdcf-49dd-acf0-9afe265351d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:00.467016 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:17:00.518904 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-5e81c103-bdcf-49dd-acf0-9afe265351d2 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:17:00.520152 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5e81c103-bdcf-49dd-acf0-9afe265351d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:00.621258 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 522/1025] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:17:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:17:00.910588 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d82ecc-7493-421a-b4f8-6874b343e1c8 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:17:00.912852 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b6d82ecc-7493-421a-b4f8-6874b343e1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:00.972362 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:17:01.017664 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d82ecc-7493-421a-b4f8-6874b343e1c8 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:17:01.089448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda631d-5840-48d8-bf18-5447c2ea9d19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:17:01.090088 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda631d-5840-48d8-bf18-5447c2ea9d19 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:01.090360 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda631d-5840-48d8-bf18-5447c2ea9d19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:01.090624 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda631d-5840-48d8-bf18-5447c2ea9d19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:01.092225 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-4fda631d-5840-48d8-bf18-5447c2ea9d19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:01.197255 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:17:01.201485 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda631d-5840-48d8-bf18-5447c2ea9d19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:17:01.202913 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda631d-5840-48d8-bf18-5447c2ea9d19 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:17:01.222057 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 504/1026] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:17:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:17:06.158865 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e501f3-1d09-4b7c-9f71-7df62be805e4 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:06.159409 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e501f3-1d09-4b7c-9f71-7df62be805e4 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:06.159409 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e501f3-1d09-4b7c-9f71-7df62be805e4 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:06.160984 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 523/1027] 10.222.0.25 () {54 vars in 921 bytes} [Tue Oct 25 13:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:17:06.165962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa92cdd-601c-4d50-a92f-c06b0e12b2eb None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:06.166348 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa92cdd-601c-4d50-a92f-c06b0e12b2eb None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:06.166515 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa92cdd-601c-4d50-a92f-c06b0e12b2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:06.247604 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-bfa92cdd-601c-4d50-a92f-c06b0e12b2eb None None] MFA Rules not processed for user `f10c161ef74c4a0d809346a5c4b53aa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:17:06.248787 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-bfa92cdd-601c-4d50-a92f-c06b0e12b2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:06.409823 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 505/1028] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Oct 25 13:17:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:17:10.619610 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=59 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:17:10.677322 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da54a2-2830-4428-b027-1bd62e0f0559 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:10.677668 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da54a2-2830-4428-b027-1bd62e0f0559 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:10.677889 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da54a2-2830-4428-b027-1bd62e0f0559 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:10.679365 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 524/1029] 10.222.0.25 () {54 vars in 921 bytes} [Tue Oct 25 13:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:17:10.684571 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d482c0-d682-4291-a93c-b7cf782e20c8 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:10.685051 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d482c0-d682-4291-a93c-b7cf782e20c8 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:10.685051 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d482c0-d682-4291-a93c-b7cf782e20c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:10.758036 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:17:10.784397 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-b6d482c0-d682-4291-a93c-b7cf782e20c8 None None] MFA Rules not processed for user `f10c161ef74c4a0d809346a5c4b53aa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:17:10.785694 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b6d482c0-d682-4291-a93c-b7cf782e20c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:10.907544 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 506/1030] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Oct 25 13:17:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:17:12.206823 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bd105-2cf2-438c-ac66-b7cd4c3f54da None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:12.207340 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bd105-2cf2-438c-ac66-b7cd4c3f54da None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:12.207421 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bd105-2cf2-438c-ac66-b7cd4c3f54da None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:12.208741 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 525/1031] 10.222.0.25 () {54 vars in 921 bytes} [Tue Oct 25 13:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 13:17:12.213554 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f78ea-2b1c-4406-bff0-179c052e1081 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:12.213957 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f78ea-2b1c-4406-bff0-179c052e1081 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:12.214210 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f78ea-2b1c-4406-bff0-179c052e1081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:12.291955 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-0e0f78ea-2b1c-4406-bff0-179c052e1081 None None] MFA Rules not processed for user `f10c161ef74c4a0d809346a5c4b53aa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:17:12.293187 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-0e0f78ea-2b1c-4406-bff0-179c052e1081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:12.335499 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:17:12.401483 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 507/1032] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Oct 25 13:17:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:17:15.931646 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b3844-033e-4441-8312-b3e2d0d03f15 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:15.932232 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b3844-033e-4441-8312-b3e2d0d03f15 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:15.932232 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b3844-033e-4441-8312-b3e2d0d03f15 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:15.933639 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 526/1033] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:17:15.939710 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8f02a-41a4-4bdf-8eb1-6a6b9ffa2a37 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:15.940211 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8f02a-41a4-4bdf-8eb1-6a6b9ffa2a37 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:15.940305 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8f02a-41a4-4bdf-8eb1-6a6b9ffa2a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:16.013512 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-b3b8f02a-41a4-4bdf-8eb1-6a6b9ffa2a37 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:17:16.014614 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b3b8f02a-41a4-4bdf-8eb1-6a6b9ffa2a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:16.115248 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 508/1034] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:17:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:17:16.431945 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc81fb-172f-4238-a606-4bbb6d1d5bcf None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:16.432500 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc81fb-172f-4238-a606-4bbb6d1d5bcf None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:16.432925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc81fb-172f-4238-a606-4bbb6d1d5bcf None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:16.435634 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 527/1035] 10.222.0.25 () {54 vars in 961 bytes} [Tue Oct 25 13:17:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:17:16.445373 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16177711-7dff-4b92-9ace-8e5877af4ae3 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:16.445939 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16177711-7dff-4b92-9ace-8e5877af4ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:16.446398 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16177711-7dff-4b92-9ace-8e5877af4ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:16.464029 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:17:16.528205 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-16177711-7dff-4b92-9ace-8e5877af4ae3 None None] MFA Rules not processed for user `63e73c00cadb4deea934db6111ed76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:17:16.529469 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-16177711-7dff-4b92-9ace-8e5877af4ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:16.654244 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 509/1036] 10.222.0.25 () {58 vars in 1058 bytes} [Tue Oct 25 13:17:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:17:16.661842 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc81fb-172f-4238-a606-4bbb6d1d5bcf None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:17:16.663470 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c0bc81fb-172f-4238-a606-4bbb6d1d5bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:16.831361 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc81fb-172f-4238-a606-4bbb6d1d5bcf None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:17:16.907519 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:17:16.951925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f9c852-bce2-4751-bad0-9249941e527a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:17:16.953414 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9c852-bce2-4751-bad0-9249941e527a service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:16.953916 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9c852-bce2-4751-bad0-9249941e527a service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:16.954417 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9c852-bce2-4751-bad0-9249941e527a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:16.956382 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f5f9c852-bce2-4751-bad0-9249941e527a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:17.060003 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f9c852-bce2-4751-bad0-9249941e527a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:17:17.061577 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f9c852-bce2-4751-bad0-9249941e527a service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:17:17.080509 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 528/1037] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:17:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 13:17:19.480084 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a7408-1124-412d-99f9-c21c881455e2 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:19.481113 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a7408-1124-412d-99f9-c21c881455e2 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:19.481113 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a7408-1124-412d-99f9-c21c881455e2 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:19.482894 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 510/1038] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:17:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:17:19.487955 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e9c7f-97d1-4ceb-a699-c5bc934a6a94 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:19.488348 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e9c7f-97d1-4ceb-a699-c5bc934a6a94 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:19.488829 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e9c7f-97d1-4ceb-a699-c5bc934a6a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:19.558114 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f39e9c7f-97d1-4ceb-a699-c5bc934a6a94 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:17:19.559413 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f39e9c7f-97d1-4ceb-a699-c5bc934a6a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:19.602076 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:17:19.666497 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 529/1039] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:17:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:17:19.958982 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a7408-1124-412d-99f9-c21c881455e2 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:17:19.960536 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-cd2a7408-1124-412d-99f9-c21c881455e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:20.036966 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:17:20.147777 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a7408-1124-412d-99f9-c21c881455e2 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:17:20.275420 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805c0b1-ec68-4663-b4cc-9baac78ef676 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:17:20.276186 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805c0b1-ec68-4663-b4cc-9baac78ef676 service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:20.276463 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805c0b1-ec68-4663-b4cc-9baac78ef676 service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:20.276728 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805c0b1-ec68-4663-b4cc-9baac78ef676 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:20.279317 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-7805c0b1-ec68-4663-b4cc-9baac78ef676 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:20.302515 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:17:20.372641 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7805c0b1-ec68-4663-b4cc-9baac78ef676 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:17:20.374243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7805c0b1-ec68-4663-b4cc-9baac78ef676 service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:17:20.392679 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 511/1040] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:17:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:17:22.977821 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67496baf-7920-4c22-9a8f-e966432c6d6e None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:22.978376 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67496baf-7920-4c22-9a8f-e966432c6d6e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:22.978376 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67496baf-7920-4c22-9a8f-e966432c6d6e None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:22.979749 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 530/1041] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:17:22.986033 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2d3e7-b788-45a5-a92e-063d52bd9a73 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:22.986588 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2d3e7-b788-45a5-a92e-063d52bd9a73 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:22.986588 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2d3e7-b788-45a5-a92e-063d52bd9a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:23.055821 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-16a2d3e7-b788-45a5-a92e-063d52bd9a73 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:17:23.057050 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-16a2d3e7-b788-45a5-a92e-063d52bd9a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:23.159497 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:17:23.162082 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 512/1042] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:17:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:17:23.453401 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15565b57-bd86-411f-a91b-55423aaac148 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:23.453846 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15565b57-bd86-411f-a91b-55423aaac148 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:23.454262 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15565b57-bd86-411f-a91b-55423aaac148 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:23.455756 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 531/1043] 10.222.0.25 () {54 vars in 961 bytes} [Tue Oct 25 13:17:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:17:23.461647 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efd754-5984-4c7f-84fa-ef65b4a08b35 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:23.461950 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efd754-5984-4c7f-84fa-ef65b4a08b35 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:23.462206 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efd754-5984-4c7f-84fa-ef65b4a08b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:23.542786 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-47efd754-5984-4c7f-84fa-ef65b4a08b35 None None] MFA Rules not processed for user `63e73c00cadb4deea934db6111ed76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:17:23.544052 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-47efd754-5984-4c7f-84fa-ef65b4a08b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:23.669578 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 513/1044] 10.222.0.25 () {58 vars in 1058 bytes} [Tue Oct 25 13:17:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:17:23.677610 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15565b57-bd86-411f-a91b-55423aaac148 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:17:23.679127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-15565b57-bd86-411f-a91b-55423aaac148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:23.843594 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15565b57-bd86-411f-a91b-55423aaac148 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:17:23.865245 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:17:23.966942 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb97299-f5b8-4840-af09-7824ce947867 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:17:23.967780 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb97299-f5b8-4840-af09-7824ce947867 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:23.968196 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb97299-f5b8-4840-af09-7824ce947867 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:23.968574 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb97299-f5b8-4840-af09-7824ce947867 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:23.970277 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-bfb97299-f5b8-4840-af09-7824ce947867 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:24.068346 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb97299-f5b8-4840-af09-7824ce947867 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:17:24.069984 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb97299-f5b8-4840-af09-7824ce947867 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:17:24.091263 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 532/1045] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:17:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:17:24.275501 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1f680-c2bd-4102-ae1b-66b336a9e530 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:24.276104 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1f680-c2bd-4102-ae1b-66b336a9e530 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:24.276104 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1f680-c2bd-4102-ae1b-66b336a9e530 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:24.279942 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 514/1046] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:17:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:17:24.284463 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1964d-97e4-47d9-99e9-5d5313da3c7b None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:24.284750 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1964d-97e4-47d9-99e9-5d5313da3c7b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:24.285029 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1964d-97e4-47d9-99e9-5d5313da3c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:24.322495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:17:24.368027 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-31b1964d-97e4-47d9-99e9-5d5313da3c7b None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:17:24.369237 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-31b1964d-97e4-47d9-99e9-5d5313da3c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:24.486330 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 533/1047] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:17:24.828440 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3370a60-c16a-4bda-a8ce-e37a3a4dfb20 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:24.828440 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3370a60-c16a-4bda-a8ce-e37a3a4dfb20 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:24.828440 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3370a60-c16a-4bda-a8ce-e37a3a4dfb20 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:24.830895 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 515/1048] 10.222.0.25 () {54 vars in 963 bytes} [Tue Oct 25 13:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:17:24.834158 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e0f5f-9ba0-4033-aa93-2cbe7c1d36d2 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:24.834442 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e0f5f-9ba0-4033-aa93-2cbe7c1d36d2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:24.834718 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e0f5f-9ba0-4033-aa93-2cbe7c1d36d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:24.919684 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d37e0f5f-9ba0-4033-aa93-2cbe7c1d36d2 None None] MFA Rules not processed for user `858fa61f39fa4d3daf4125f6099e7721`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:17:24.921128 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d37e0f5f-9ba0-4033-aa93-2cbe7c1d36d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:24.975111 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:17:25.009349 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 534/1049] 10.222.0.25 () {58 vars in 1060 bytes} [Tue Oct 25 13:17:24 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:17:25.017133 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3370a60-c16a-4bda-a8ce-e37a3a4dfb20 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:17:25.018659 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a3370a60-c16a-4bda-a8ce-e37a3a4dfb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:25.075383 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:17:25.134744 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3370a60-c16a-4bda-a8ce-e37a3a4dfb20 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:17:25.220105 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce61ce3-1902-47ab-9090-e2317b7074f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:17:25.220711 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce61ce3-1902-47ab-9090-e2317b7074f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:25.220996 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce61ce3-1902-47ab-9090-e2317b7074f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:25.221254 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce61ce3-1902-47ab-9090-e2317b7074f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:25.222905 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-9ce61ce3-1902-47ab-9090-e2317b7074f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:25.349250 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:17:25.364222 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce61ce3-1902-47ab-9090-e2317b7074f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:17:25.365546 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce61ce3-1902-47ab-9090-e2317b7074f1 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:17:25.385015 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 516/1050] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:17:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:17:26.388550 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351ced3-71c2-4044-93dd-472dd6b70254 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:26.389053 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351ced3-71c2-4044-93dd-472dd6b70254 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:26.389053 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351ced3-71c2-4044-93dd-472dd6b70254 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:26.390374 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 535/1051] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:17:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:17:26.395982 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc803edd-8afc-4109-9db8-7ab1e466f5ff None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:26.396387 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc803edd-8afc-4109-9db8-7ab1e466f5ff None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:26.396602 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc803edd-8afc-4109-9db8-7ab1e466f5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:26.463714 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-fc803edd-8afc-4109-9db8-7ab1e466f5ff None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:17:26.465496 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-fc803edd-8afc-4109-9db8-7ab1e466f5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:26.560745 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 517/1052] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:17:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:17:26.865679 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9351ced3-71c2-4044-93dd-472dd6b70254 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:17:26.867233 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9351ced3-71c2-4044-93dd-472dd6b70254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:27.033002 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9351ced3-71c2-4044-93dd-472dd6b70254 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:17:27.085915 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:17:27.154575 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584641eb-658b-4028-b7fa-28973082d48c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:17:27.155170 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584641eb-658b-4028-b7fa-28973082d48c service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:27.155442 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584641eb-658b-4028-b7fa-28973082d48c service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:27.155715 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584641eb-658b-4028-b7fa-28973082d48c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:27.157379 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-584641eb-658b-4028-b7fa-28973082d48c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:27.256785 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584641eb-658b-4028-b7fa-28973082d48c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:17:27.258677 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584641eb-658b-4028-b7fa-28973082d48c service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:17:27.279127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 536/1053] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:17:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:17:29.534557 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a39600-b468-427e-a719-835cb0994aff None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:29.535105 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a39600-b468-427e-a719-835cb0994aff None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:29.535105 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a39600-b468-427e-a719-835cb0994aff None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:29.536629 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 518/1054] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:17:29.541660 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978be00c-ce33-45c6-9917-a07e7cdbef90 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:29.542041 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978be00c-ce33-45c6-9917-a07e7cdbef90 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:29.542217 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978be00c-ce33-45c6-9917-a07e7cdbef90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:29.612864 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-978be00c-ce33-45c6-9917-a07e7cdbef90 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:17:29.614076 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-978be00c-ce33-45c6-9917-a07e7cdbef90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:29.621585 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:17:29.735239 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 537/1055] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:17:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:17:30.030459 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a39600-b468-427e-a719-835cb0994aff None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:17:30.032247 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b6a39600-b468-427e-a719-835cb0994aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:30.098385 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:17:30.189469 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a39600-b468-427e-a719-835cb0994aff None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:17:30.308085 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72ed97-f1c2-465e-959c-1a1a5cb69657 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:17:30.309186 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72ed97-f1c2-465e-959c-1a1a5cb69657 service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:30.309469 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72ed97-f1c2-465e-959c-1a1a5cb69657 service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:30.309748 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72ed97-f1c2-465e-959c-1a1a5cb69657 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:30.311322 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-4d72ed97-f1c2-465e-959c-1a1a5cb69657 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:30.330476 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:17:30.409852 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72ed97-f1c2-465e-959c-1a1a5cb69657 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:17:30.411433 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72ed97-f1c2-465e-959c-1a1a5cb69657 service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:17:30.431120 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 519/1056] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:17:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:17:32.678129 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb34c90-7bef-48bf-b8bf-77e9d6411973 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:32.678624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb34c90-7bef-48bf-b8bf-77e9d6411973 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:32.678730 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb34c90-7bef-48bf-b8bf-77e9d6411973 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:32.680462 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 538/1057] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:17:32.686059 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907fa6e-1f1b-4b7e-b770-aef866fde379 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:32.686489 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907fa6e-1f1b-4b7e-b770-aef866fde379 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:32.686737 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907fa6e-1f1b-4b7e-b770-aef866fde379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:32.759097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-3907fa6e-1f1b-4b7e-b770-aef866fde379 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:17:32.760732 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-3907fa6e-1f1b-4b7e-b770-aef866fde379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:32.908813 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:17:32.914594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 520/1058] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:17:33.233576 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb34c90-7bef-48bf-b8bf-77e9d6411973 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:17:33.235086 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-bcb34c90-7bef-48bf-b8bf-77e9d6411973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:33.383641 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:17:33.395053 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb34c90-7bef-48bf-b8bf-77e9d6411973 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:17:33.523923 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e12e8-09f2-4423-8ca5-952afe2465cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:17:33.524709 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e12e8-09f2-4423-8ca5-952afe2465cd service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:33.525066 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e12e8-09f2-4423-8ca5-952afe2465cd service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:33.525420 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e12e8-09f2-4423-8ca5-952afe2465cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:33.528371 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-df8e12e8-09f2-4423-8ca5-952afe2465cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:33.640776 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e12e8-09f2-4423-8ca5-952afe2465cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:17:33.642384 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e12e8-09f2-4423-8ca5-952afe2465cd service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:17:33.652851 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:17:33.662692 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 539/1059] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:17:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:17:36.224400 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ecc22-e78c-415a-985d-a8545cf22719 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:36.224933 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ecc22-e78c-415a-985d-a8545cf22719 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:36.224933 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ecc22-e78c-415a-985d-a8545cf22719 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:36.226275 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 521/1060] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:17:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:17:36.232601 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710b58d-e234-4525-b7ae-eaae405123bc None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:36.233036 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710b58d-e234-4525-b7ae-eaae405123bc None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:36.233228 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710b58d-e234-4525-b7ae-eaae405123bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:36.303787 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-2710b58d-e234-4525-b7ae-eaae405123bc None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:17:36.305728 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2710b58d-e234-4525-b7ae-eaae405123bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:36.427940 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 540/1061] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:17:36.714332 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ecc22-e78c-415a-985d-a8545cf22719 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:17:36.716652 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a52ecc22-e78c-415a-985d-a8545cf22719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:36.897662 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ecc22-e78c-415a-985d-a8545cf22719 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:17:36.985400 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:17:37.043871 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e5c73-8cd8-4bba-a9b0-83ca5603d81e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:17:37.044657 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e5c73-8cd8-4bba-a9b0-83ca5603d81e service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:37.045024 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e5c73-8cd8-4bba-a9b0-83ca5603d81e service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:37.045636 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e5c73-8cd8-4bba-a9b0-83ca5603d81e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:37.047728 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2c4e5c73-8cd8-4bba-a9b0-83ca5603d81e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:37.161576 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e5c73-8cd8-4bba-a9b0-83ca5603d81e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:17:37.163166 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e5c73-8cd8-4bba-a9b0-83ca5603d81e service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:17:37.181961 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 522/1062] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:17:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:17:39.428258 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f5f13-b0f4-48aa-a8c6-16007215f763 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:39.428856 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f5f13-b0f4-48aa-a8c6-16007215f763 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:39.428856 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f5f13-b0f4-48aa-a8c6-16007215f763 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:39.430117 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 541/1063] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:17:39.436526 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeecfb4-37aa-4aac-b173-7dcb8367d2dd None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:39.436938 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeecfb4-37aa-4aac-b173-7dcb8367d2dd None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:39.437087 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeecfb4-37aa-4aac-b173-7dcb8367d2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:39.504035 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-4aeecfb4-37aa-4aac-b173-7dcb8367d2dd None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:17:39.505239 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-4aeecfb4-37aa-4aac-b173-7dcb8367d2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:39.538402 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:17:39.604837 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 523/1064] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:17:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:17:39.897344 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f5f13-b0f4-48aa-a8c6-16007215f763 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:17:39.898869 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-708f5f13-b0f4-48aa-a8c6-16007215f763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:39.977521 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:17:40.049490 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f5f13-b0f4-48aa-a8c6-16007215f763 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:17:40.167376 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a887a1-b568-48c7-918b-1e0fa4a8009c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:17:40.168891 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a887a1-b568-48c7-918b-1e0fa4a8009c service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:40.169060 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a887a1-b568-48c7-918b-1e0fa4a8009c service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:40.169231 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a887a1-b568-48c7-918b-1e0fa4a8009c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:40.170839 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-76a887a1-b568-48c7-918b-1e0fa4a8009c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:40.209678 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:17:40.260894 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a887a1-b568-48c7-918b-1e0fa4a8009c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:17:40.262987 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a887a1-b568-48c7-918b-1e0fa4a8009c service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:17:40.281090 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 542/1065] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:17:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:17:40.672894 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8916e56-c878-4e1c-8770-fb3d00bfd7fa None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:40.673679 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8916e56-c878-4e1c-8770-fb3d00bfd7fa None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:40.673679 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8916e56-c878-4e1c-8770-fb3d00bfd7fa None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:40.675114 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 524/1066] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:17:40.680553 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7ff90-7493-426f-8dc9-eb8ec32621fa None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:40.680998 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7ff90-7493-426f-8dc9-eb8ec32621fa None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:40.681096 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7ff90-7493-426f-8dc9-eb8ec32621fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:40.750362 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-15c7ff90-7493-426f-8dc9-eb8ec32621fa None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:17:40.751567 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-15c7ff90-7493-426f-8dc9-eb8ec32621fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:40.848812 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 543/1067] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:17:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:17:41.151131 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e37f0c-813b-47ea-98e9-49353bd689b2 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:41.151413 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e37f0c-813b-47ea-98e9-49353bd689b2 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:41.151689 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e37f0c-813b-47ea-98e9-49353bd689b2 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:41.153284 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 525/1068] 10.222.0.25 () {54 vars in 962 bytes} [Tue Oct 25 13:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:17:41.158872 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0767a-73bb-4d97-b044-eba70c215b4b None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:41.159166 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0767a-73bb-4d97-b044-eba70c215b4b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:41.159446 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0767a-73bb-4d97-b044-eba70c215b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:41.175753 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:17:41.242118 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-30d0767a-73bb-4d97-b044-eba70c215b4b None None] MFA Rules not processed for user `89f67d808ffb4641b03f96406b3fe9e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:17:41.243210 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-30d0767a-73bb-4d97-b044-eba70c215b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:41.317971 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 544/1069] 10.222.0.25 () {58 vars in 1059 bytes} [Tue Oct 25 13:17:41 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:17:41.326422 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e37f0c-813b-47ea-98e9-49353bd689b2 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:17:41.327930 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b3e37f0c-813b-47ea-98e9-49353bd689b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:41.432292 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e37f0c-813b-47ea-98e9-49353bd689b2 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:17:41.491451 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:17:41.507025 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9ad3d-c90d-4016-84f7-00771cd476f2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f67d808ffb4641b03f96406b3fe9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:17:41.507565 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9ad3d-c90d-4016-84f7-00771cd476f2 service glance] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:41.507838 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9ad3d-c90d-4016-84f7-00771cd476f2 service glance] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:41.508140 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9ad3d-c90d-4016-84f7-00771cd476f2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:41.509762 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-f3a9ad3d-c90d-4016-84f7-00771cd476f2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:41.620730 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a9ad3d-c90d-4016-84f7-00771cd476f2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:17:41.622788 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a9ad3d-c90d-4016-84f7-00771cd476f2 service glance] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:17:41.641088 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 526/1070] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:17:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:17:42.393383 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbc6c0-de2d-4c42-9287-8927a546138e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:42.394020 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbc6c0-de2d-4c42-9287-8927a546138e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:42.394020 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbc6c0-de2d-4c42-9287-8927a546138e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:42.463534 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-27fbc6c0-de2d-4c42-9287-8927a546138e None None] MFA Rules not processed for user `9d5d4691dca848d58bd280d2fad79fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:17:42.465410 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-27fbc6c0-de2d-4c42-9287-8927a546138e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:42.506219 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ceafc-77ca-4f27-8816-cde1aae202c0 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:42.506784 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ceafc-77ca-4f27-8816-cde1aae202c0 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:42.506784 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ceafc-77ca-4f27-8816-cde1aae202c0 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:42.508204 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 527/1071] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 13:17:42.513388 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fd44f-7037-439a-8db3-2fcb7d7d338c None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:42.513671 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fd44f-7037-439a-8db3-2fcb7d7d338c None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:42.513950 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fd44f-7037-439a-8db3-2fcb7d7d338c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:42.521018 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:17:42.555390 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 545/1072] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 25 13:17:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:17:42.584876 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-704fd44f-7037-439a-8db3-2fcb7d7d338c None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:17:42.586091 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-704fd44f-7037-439a-8db3-2fcb7d7d338c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:42.603825 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6f453-2231-47cb-b7c6-66334e088472 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:42.604161 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6f453-2231-47cb-b7c6-66334e088472 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:42.604441 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6f453-2231-47cb-b7c6-66334e088472 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:42.606812 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 546/1073] 10.222.0.25 () {54 vars in 943 bytes} [Tue Oct 25 13:17:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 13:17:42.613339 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582977c-f02f-490d-93f5-878ec31a1c2e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:42.613626 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582977c-f02f-490d-93f5-878ec31a1c2e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:42.613902 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582977c-f02f-490d-93f5-878ec31a1c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:42.630388 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:17:42.690208 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 528/1074] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:17:42.691777 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d582977c-f02f-490d-93f5-878ec31a1c2e None None] MFA Rules not processed for user `07413369b0c14e878d04ee528487801d`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:17:42.693025 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d582977c-f02f-490d-93f5-878ec31a1c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:42.804730 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 547/1075] 10.222.0.25 () {58 vars in 1040 bytes} [Tue Oct 25 13:17:42 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:17:42.814191 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fd44f-7037-439a-8db3-2fcb7d7d338c None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:17:42.815446 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-704fd44f-7037-439a-8db3-2fcb7d7d338c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:42.918474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fd44f-7037-439a-8db3-2fcb7d7d338c None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:17:42.981362 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582977c-f02f-490d-93f5-878ec31a1c2e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:17:42.982554 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d582977c-f02f-490d-93f5-878ec31a1c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:42.983669 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:17:43.015342 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:17:43.026739 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a7578-2123-4a92-93f5-bc5f953bae9f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07413369b0c14e878d04ee528487801d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:17:43.028100 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a7578-2123-4a92-93f5-bc5f953bae9f service swift] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:43.028369 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a7578-2123-4a92-93f5-bc5f953bae9f service swift] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:43.028637 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a7578-2123-4a92-93f5-bc5f953bae9f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:43.030306 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-661a7578-2123-4a92-93f5-bc5f953bae9f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:43.083812 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582977c-f02f-490d-93f5-878ec31a1c2e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:17:43.116147 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a7578-2123-4a92-93f5-bc5f953bae9f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:17:43.117721 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a7578-2123-4a92-93f5-bc5f953bae9f service swift] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:17:43.126460 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 529/1076] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 25 13:17:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 25 13:17:43.207359 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5776962-c6c8-400e-a151-e429cafd4c84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:17:43.208010 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5776962-c6c8-400e-a151-e429cafd4c84 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:43.208689 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5776962-c6c8-400e-a151-e429cafd4c84 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:43.208689 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5776962-c6c8-400e-a151-e429cafd4c84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:43.210165 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c5776962-c6c8-400e-a151-e429cafd4c84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:43.267316 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:17:43.323914 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5776962-c6c8-400e-a151-e429cafd4c84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:17:43.325776 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5776962-c6c8-400e-a151-e429cafd4c84 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:17:43.346494 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 548/1077] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:17:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 13:17:45.601039 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28115ccd-0037-479d-aeaa-5546ce29e5e2 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:45.601768 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28115ccd-0037-479d-aeaa-5546ce29e5e2 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:45.602075 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28115ccd-0037-479d-aeaa-5546ce29e5e2 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:45.603445 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 530/1078] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:17:45.608849 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b815c0-c4ae-45c1-b221-d36b981970ab None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:45.612830 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b815c0-c4ae-45c1-b221-d36b981970ab None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:45.612830 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b815c0-c4ae-45c1-b221-d36b981970ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:45.685335 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d6b815c0-c4ae-45c1-b221-d36b981970ab None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:17:45.686565 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d6b815c0-c4ae-45c1-b221-d36b981970ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:45.810397 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 549/1079] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:17:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:17:46.102655 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28115ccd-0037-479d-aeaa-5546ce29e5e2 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:17:46.104230 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-28115ccd-0037-479d-aeaa-5546ce29e5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:46.217197 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:17:46.284993 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28115ccd-0037-479d-aeaa-5546ce29e5e2 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:17:46.465356 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ec4ff-095e-40e1-a6c3-cdbc480f1ab6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:17:46.465967 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ec4ff-095e-40e1-a6c3-cdbc480f1ab6 service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:46.466258 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ec4ff-095e-40e1-a6c3-cdbc480f1ab6 service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:46.466538 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ec4ff-095e-40e1-a6c3-cdbc480f1ab6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:46.468238 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-4b9ec4ff-095e-40e1-a6c3-cdbc480f1ab6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:46.542770 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:17:46.573115 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ec4ff-095e-40e1-a6c3-cdbc480f1ab6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:17:46.575456 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ec4ff-095e-40e1-a6c3-cdbc480f1ab6 service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:17:46.595828 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 531/1080] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:17:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:17:48.859196 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c7a34-cddf-42e6-a1fe-9a1bcd8f54c9 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:48.859778 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c7a34-cddf-42e6-a1fe-9a1bcd8f54c9 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:48.859778 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c7a34-cddf-42e6-a1fe-9a1bcd8f54c9 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:48.861323 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 550/1081] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:17:48.866775 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966d417-4261-4792-9171-76fce526c84d None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:48.867251 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966d417-4261-4792-9171-76fce526c84d None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:48.867346 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966d417-4261-4792-9171-76fce526c84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:48.953859 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-c966d417-4261-4792-9171-76fce526c84d None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:17:48.955093 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c966d417-4261-4792-9171-76fce526c84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:49.068855 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 532/1082] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:17:49.365524 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c7a34-cddf-42e6-a1fe-9a1bcd8f54c9 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:17:49.367064 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-205c7a34-cddf-42e6-a1fe-9a1bcd8f54c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:49.394160 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:17:49.535840 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c7a34-cddf-42e6-a1fe-9a1bcd8f54c9 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:17:49.643074 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:17:49.668775 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afbf2d-b2f8-4188-999b-2385ddc59d00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:17:49.669538 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afbf2d-b2f8-4188-999b-2385ddc59d00 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:49.669819 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afbf2d-b2f8-4188-999b-2385ddc59d00 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:49.670094 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afbf2d-b2f8-4188-999b-2385ddc59d00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:49.671705 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-58afbf2d-b2f8-4188-999b-2385ddc59d00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:49.779548 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afbf2d-b2f8-4188-999b-2385ddc59d00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:17:49.781294 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afbf2d-b2f8-4188-999b-2385ddc59d00 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:17:49.801763 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 551/1083] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:17:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:17:52.063273 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7e42e-d775-4462-9507-d394ed351fe8 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:52.063850 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7e42e-d775-4462-9507-d394ed351fe8 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:52.063850 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7e42e-d775-4462-9507-d394ed351fe8 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:52.065194 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 533/1084] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:17:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:17:52.070578 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa81b37-5507-44d5-9422-fc27a9cda926 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:52.070970 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa81b37-5507-44d5-9422-fc27a9cda926 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:52.071134 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa81b37-5507-44d5-9422-fc27a9cda926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:52.147429 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-afa81b37-5507-44d5-9422-fc27a9cda926 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:17:52.148679 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-afa81b37-5507-44d5-9422-fc27a9cda926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:52.207167 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:17:52.260020 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 552/1085] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:17:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:17:52.562146 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7e42e-d775-4462-9507-d394ed351fe8 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:17:52.563715 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-47e7e42e-d775-4462-9507-d394ed351fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:52.613823 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:17:52.739113 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7e42e-d775-4462-9507-d394ed351fe8 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:17:52.869823 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533fe2f8-ded0-4a11-8876-6d94ff598a60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:17:52.870520 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fe2f8-ded0-4a11-8876-6d94ff598a60 service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:17:52.871496 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fe2f8-ded0-4a11-8876-6d94ff598a60 service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:17:52.871799 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fe2f8-ded0-4a11-8876-6d94ff598a60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:17:52.873456 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-533fe2f8-ded0-4a11-8876-6d94ff598a60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:17:52.875772 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:17:52.979292 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533fe2f8-ded0-4a11-8876-6d94ff598a60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:17:52.979692 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533fe2f8-ded0-4a11-8876-6d94ff598a60 service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:17:53.000075 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 534/1086] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:17:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:18:02.256484 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=19 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:02.996102 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=44 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:06.098501 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecf8c1-f388-4465-875a-285b18dbfe89 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:06.099040 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecf8c1-f388-4465-875a-285b18dbfe89 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:06.099040 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecf8c1-f388-4465-875a-285b18dbfe89 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:06.100379 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 553/1087] 10.222.0.25 () {54 vars in 918 bytes} [Tue Oct 25 13:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:18:06.105843 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa840e-df2b-4e9c-b790-a9e8e8fbcd61 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:06.106302 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa840e-df2b-4e9c-b790-a9e8e8fbcd61 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:06.106407 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa840e-df2b-4e9c-b790-a9e8e8fbcd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:06.182261 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-f3fa840e-df2b-4e9c-b790-a9e8e8fbcd61 None None] MFA Rules not processed for user `f10c161ef74c4a0d809346a5c4b53aa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:18:06.183444 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-f3fa840e-df2b-4e9c-b790-a9e8e8fbcd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:06.288751 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 535/1088] 10.222.0.25 () {58 vars in 1015 bytes} [Tue Oct 25 13:18:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:18:06.303043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf8ba7-4dcf-4543-bee0-389670659ac6 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:06.303325 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf8ba7-4dcf-4543-bee0-389670659ac6 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:06.303600 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf8ba7-4dcf-4543-bee0-389670659ac6 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:06.304956 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 554/1089] 10.222.0.25 () {54 vars in 918 bytes} [Tue Oct 25 13:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:18:06.310221 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464f968-3137-4177-8ed0-85f972572319 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:06.310512 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464f968-3137-4177-8ed0-85f972572319 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:06.310794 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464f968-3137-4177-8ed0-85f972572319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:06.384104 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:06.387393 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-9464f968-3137-4177-8ed0-85f972572319 None None] MFA Rules not processed for user `63e73c00cadb4deea934db6111ed76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:18:06.389253 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-9464f968-3137-4177-8ed0-85f972572319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:06.507291 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 536/1090] 10.222.0.25 () {58 vars in 1015 bytes} [Tue Oct 25 13:18:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:18:09.089563 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2f4aa-f371-4226-97cd-8988fc506989 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:09.090091 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2f4aa-f371-4226-97cd-8988fc506989 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:09.090091 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2f4aa-f371-4226-97cd-8988fc506989 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:09.092308 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 555/1091] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 25 13:18:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 13:18:09.097566 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f585b-9393-49d6-9a18-a8e82a53c679 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:09.097977 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f585b-9393-49d6-9a18-a8e82a53c679 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:09.098122 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f585b-9393-49d6-9a18-a8e82a53c679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:09.163717 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-0c2f585b-9393-49d6-9a18-a8e82a53c679 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:18:09.164938 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-0c2f585b-9393-49d6-9a18-a8e82a53c679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:09.219855 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:09.261621 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 537/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 25 13:18:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:18:09.554357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec2f4aa-f371-4226-97cd-8988fc506989 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:18:09.556109 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4ec2f4aa-f371-4226-97cd-8988fc506989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:09.699799 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec2f4aa-f371-4226-97cd-8988fc506989 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:18:09.771584 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:09.811984 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3aa79-c394-45eb-aaf3-06131e9e41b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:18:09.812514 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3aa79-c394-45eb-aaf3-06131e9e41b5 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:09.812790 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3aa79-c394-45eb-aaf3-06131e9e41b5 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:09.813057 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3aa79-c394-45eb-aaf3-06131e9e41b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:09.814634 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7aa3aa79-c394-45eb-aaf3-06131e9e41b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:09.902654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3aa79-c394-45eb-aaf3-06131e9e41b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:18:09.904862 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3aa79-c394-45eb-aaf3-06131e9e41b5 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:18:09.922241 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 556/1093] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:18:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:18:11.054703 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a0692-aa2b-4c85-a91b-a6bd0ad5b076 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:11.055237 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a0692-aa2b-4c85-a91b-a6bd0ad5b076 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:11.055237 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a0692-aa2b-4c85-a91b-a6bd0ad5b076 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:11.056536 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 538/1094] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 25 13:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:18:11.062260 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9eb3b-6059-42c7-a8d5-1771dca474c3 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:11.062647 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9eb3b-6059-42c7-a8d5-1771dca474c3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:11.062811 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9eb3b-6059-42c7-a8d5-1771dca474c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:11.138136 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d5d9eb3b-6059-42c7-a8d5-1771dca474c3 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:18:11.139334 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d5d9eb3b-6059-42c7-a8d5-1771dca474c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:11.165804 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:11.236796 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 557/1095] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 25 13:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:18:11.394810 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a0692-aa2b-4c85-a91b-a6bd0ad5b076 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:18:11.396347 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2e5a0692-aa2b-4c85-a91b-a6bd0ad5b076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:11.541063 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a0692-aa2b-4c85-a91b-a6bd0ad5b076 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:18:11.581998 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:11.655349 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbf7f9-152d-440f-85d8-90e07e0006e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:18:11.655867 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbf7f9-152d-440f-85d8-90e07e0006e1 service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:11.656171 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbf7f9-152d-440f-85d8-90e07e0006e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:11.656439 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbf7f9-152d-440f-85d8-90e07e0006e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:11.658009 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b6fbf7f9-152d-440f-85d8-90e07e0006e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:11.749394 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbf7f9-152d-440f-85d8-90e07e0006e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:18:11.751023 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbf7f9-152d-440f-85d8-90e07e0006e1 service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:18:11.769412 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 539/1096] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:18:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:18:12.909489 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f54437-617b-40a7-a215-c0d40af7ea83 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:12.910048 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f54437-617b-40a7-a215-c0d40af7ea83 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:12.910048 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f54437-617b-40a7-a215-c0d40af7ea83 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:12.911393 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 558/1097] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 25 13:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:18:12.916315 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68e66f-87f1-4096-88d6-e2fab0d08d1b None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:12.916763 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68e66f-87f1-4096-88d6-e2fab0d08d1b None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:12.916877 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68e66f-87f1-4096-88d6-e2fab0d08d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:12.972536 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:12.995113 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-8d68e66f-87f1-4096-88d6-e2fab0d08d1b None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:18:12.996262 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-8d68e66f-87f1-4096-88d6-e2fab0d08d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:13.092586 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 540/1098] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 25 13:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:18:13.243678 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f54437-617b-40a7-a215-c0d40af7ea83 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:18:13.245303 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-35f54437-617b-40a7-a215-c0d40af7ea83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:13.390690 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f54437-617b-40a7-a215-c0d40af7ea83 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:18:13.402589 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:13.504507 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713b5cb-db46-4155-8372-da4845d891f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:18:13.505043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713b5cb-db46-4155-8372-da4845d891f0 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:13.505325 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713b5cb-db46-4155-8372-da4845d891f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:13.505619 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713b5cb-db46-4155-8372-da4845d891f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:13.507224 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0713b5cb-db46-4155-8372-da4845d891f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:13.596865 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713b5cb-db46-4155-8372-da4845d891f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:18:13.598482 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713b5cb-db46-4155-8372-da4845d891f0 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:18:13.616628 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 559/1099] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:18:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:18:14.721178 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713ac9b-7dcc-4f1c-b39a-ed8bd47fa63a None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:14.721741 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713ac9b-7dcc-4f1c-b39a-ed8bd47fa63a None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:14.721741 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713ac9b-7dcc-4f1c-b39a-ed8bd47fa63a None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:14.723079 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 541/1100] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 25 13:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:18:14.728166 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7c496-7aec-42a0-93b4-45eb6ef8547a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:14.728579 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7c496-7aec-42a0-93b4-45eb6ef8547a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:14.728727 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7c496-7aec-42a0-93b4-45eb6ef8547a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:14.748864 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:14.806600 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e3e7c496-7aec-42a0-93b4-45eb6ef8547a None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:18:14.807794 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e3e7c496-7aec-42a0-93b4-45eb6ef8547a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:14.905630 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 560/1101] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 25 13:18:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:18:15.057516 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713ac9b-7dcc-4f1c-b39a-ed8bd47fa63a None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:18:15.058943 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-9713ac9b-7dcc-4f1c-b39a-ed8bd47fa63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:15.170099 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:15.206296 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713ac9b-7dcc-4f1c-b39a-ed8bd47fa63a None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:18:15.318447 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6bba2-2967-4f07-b06d-f68aaf1d2afd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:18:15.318964 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6bba2-2967-4f07-b06d-f68aaf1d2afd service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:15.319237 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6bba2-2967-4f07-b06d-f68aaf1d2afd service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:15.319513 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6bba2-2967-4f07-b06d-f68aaf1d2afd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:15.321124 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-88f6bba2-2967-4f07-b06d-f68aaf1d2afd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:15.396688 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:15.410852 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f6bba2-2967-4f07-b06d-f68aaf1d2afd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:18:15.412479 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f6bba2-2967-4f07-b06d-f68aaf1d2afd service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:18:15.430860 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 542/1102] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:18:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:18:16.531424 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed68b0-5869-4330-be58-00f11873168d None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:16.532027 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed68b0-5869-4330-be58-00f11873168d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:16.532027 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed68b0-5869-4330-be58-00f11873168d None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:16.533321 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 561/1103] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 25 13:18:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:18:16.538257 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a33a0-b077-4bfb-b980-d76ac413e615 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:16.538699 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a33a0-b077-4bfb-b980-d76ac413e615 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:16.538832 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a33a0-b077-4bfb-b980-d76ac413e615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:16.614219 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-cf8a33a0-b077-4bfb-b980-d76ac413e615 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:18:16.615400 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-cf8a33a0-b077-4bfb-b980-d76ac413e615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:16.710833 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 543/1104] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 25 13:18:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:18:16.861626 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed68b0-5869-4330-be58-00f11873168d None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:18:16.863066 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-14ed68b0-5869-4330-be58-00f11873168d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:16.946376 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:17.008200 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed68b0-5869-4330-be58-00f11873168d None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:18:17.119685 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46419a7-72ad-4817-b290-ab4b926e2da5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:18:17.120247 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46419a7-72ad-4817-b290-ab4b926e2da5 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:17.120532 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46419a7-72ad-4817-b290-ab4b926e2da5 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:17.120806 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46419a7-72ad-4817-b290-ab4b926e2da5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:17.122972 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b46419a7-72ad-4817-b290-ab4b926e2da5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:17.171678 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:17.213689 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46419a7-72ad-4817-b290-ab4b926e2da5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:18:17.215485 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46419a7-72ad-4817-b290-ab4b926e2da5 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:18:17.234122 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 562/1105] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:18:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:18:18.277473 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31b0ff-d052-470c-991f-a272a485619c None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:18.278549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31b0ff-d052-470c-991f-a272a485619c None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:18.278549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31b0ff-d052-470c-991f-a272a485619c None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:18.280419 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 544/1106] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 25 13:18:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:18:18.285515 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf9d37-e188-4e62-b25b-4e0c40debe98 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:18.285916 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf9d37-e188-4e62-b25b-4e0c40debe98 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:18.286066 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf9d37-e188-4e62-b25b-4e0c40debe98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:18.362798 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-22bf9d37-e188-4e62-b25b-4e0c40debe98 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:18:18.364037 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-22bf9d37-e188-4e62-b25b-4e0c40debe98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:18.460067 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 563/1107] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 25 13:18:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:18:18.613209 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31b0ff-d052-470c-991f-a272a485619c None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:18:18.614647 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ad31b0ff-d052-470c-991f-a272a485619c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:18.665278 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:18.761626 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31b0ff-d052-470c-991f-a272a485619c None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:18:18.876210 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d42300-fc3a-4d53-a506-8b976cc2f79a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:18:18.876725 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d42300-fc3a-4d53-a506-8b976cc2f79a service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:18.876996 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d42300-fc3a-4d53-a506-8b976cc2f79a service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:18.877260 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d42300-fc3a-4d53-a506-8b976cc2f79a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:18.878832 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-69d42300-fc3a-4d53-a506-8b976cc2f79a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:18.885578 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:18.972710 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d42300-fc3a-4d53-a506-8b976cc2f79a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:18:18.974283 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d42300-fc3a-4d53-a506-8b976cc2f79a service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:18:18.992158 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 545/1108] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:18:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:18:20.046226 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09baeb4f-a5f1-4e16-9a42-c8d50548af60 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:20.046759 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09baeb4f-a5f1-4e16-9a42-c8d50548af60 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:20.046759 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09baeb4f-a5f1-4e16-9a42-c8d50548af60 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:20.048062 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 564/1109] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 25 13:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 13:18:20.053302 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb5872-9399-4c53-902e-2e631294b51c None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:20.053702 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb5872-9399-4c53-902e-2e631294b51c None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:20.053855 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb5872-9399-4c53-902e-2e631294b51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:20.130114 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-a7bb5872-9399-4c53-902e-2e631294b51c None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:18:20.131295 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a7bb5872-9399-4c53-902e-2e631294b51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:20.200252 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:20.230773 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 546/1110] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 25 13:18:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:18:20.380967 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09baeb4f-a5f1-4e16-9a42-c8d50548af60 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:18:20.382435 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-09baeb4f-a5f1-4e16-9a42-c8d50548af60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:20.400046 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:20.526697 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09baeb4f-a5f1-4e16-9a42-c8d50548af60 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:18:20.612720 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:20.639084 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7d80b-130e-48f4-8475-6375bd9ab2f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:18:20.639695 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7d80b-130e-48f4-8475-6375bd9ab2f2 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:20.639995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7d80b-130e-48f4-8475-6375bd9ab2f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:20.640272 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7d80b-130e-48f4-8475-6375bd9ab2f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:20.641856 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c2a7d80b-130e-48f4-8475-6375bd9ab2f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:20.729691 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a7d80b-130e-48f4-8475-6375bd9ab2f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:18:20.731295 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a7d80b-130e-48f4-8475-6375bd9ab2f2 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:18:20.749967 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 565/1111] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:18:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:18:21.805342 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab0669-aa9f-4024-ab0c-d919036006db None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:21.805913 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab0669-aa9f-4024-ab0c-d919036006db None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:21.805913 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab0669-aa9f-4024-ab0c-d919036006db None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:21.807287 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 547/1112] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 25 13:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:18:21.813291 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033d11c-3aa3-42c5-a9c3-9aa16d2e65ff None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:21.813725 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033d11c-3aa3-42c5-a9c3-9aa16d2e65ff None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:21.813846 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033d11c-3aa3-42c5-a9c3-9aa16d2e65ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:21.909511 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c033d11c-3aa3-42c5-a9c3-9aa16d2e65ff None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:18:21.911026 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c033d11c-3aa3-42c5-a9c3-9aa16d2e65ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:21.963134 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:22.027913 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 566/1113] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 25 13:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:18:22.207476 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab0669-aa9f-4024-ab0c-d919036006db None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:18:22.209553 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-67ab0669-aa9f-4024-ab0c-d919036006db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:22.383777 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab0669-aa9f-4024-ab0c-d919036006db None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:18:22.446941 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:22.509199 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3838ff-ae70-4e44-9da8-ce51e0d953dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:18:22.509807 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3838ff-ae70-4e44-9da8-ce51e0d953dd service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:22.510082 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3838ff-ae70-4e44-9da8-ce51e0d953dd service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:22.510351 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3838ff-ae70-4e44-9da8-ce51e0d953dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:22.511957 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-6c3838ff-ae70-4e44-9da8-ce51e0d953dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:22.600978 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3838ff-ae70-4e44-9da8-ce51e0d953dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:18:22.602558 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3838ff-ae70-4e44-9da8-ce51e0d953dd service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:18:22.620631 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 548/1114] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:18:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:18:23.662848 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa102e00-eda6-4475-af05-1d6ddfd727b0 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:23.663411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa102e00-eda6-4475-af05-1d6ddfd727b0 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:23.663411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa102e00-eda6-4475-af05-1d6ddfd727b0 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:23.664785 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 567/1115] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 25 13:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:18:23.670228 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec0b2d-5ec4-4c11-bc04-8ac407cbc7be None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:23.670639 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec0b2d-5ec4-4c11-bc04-8ac407cbc7be None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:23.670773 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec0b2d-5ec4-4c11-bc04-8ac407cbc7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:23.747379 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-9eec0b2d-5ec4-4c11-bc04-8ac407cbc7be None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:18:23.748629 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-9eec0b2d-5ec4-4c11-bc04-8ac407cbc7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:23.750665 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:23.847294 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 549/1116] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 25 13:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:18:24.002722 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa102e00-eda6-4475-af05-1d6ddfd727b0 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:18:24.004214 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-aa102e00-eda6-4475-af05-1d6ddfd727b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:24.148648 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa102e00-eda6-4475-af05-1d6ddfd727b0 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:18:24.175959 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:24.265945 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1dc0eb-34fc-483b-b3b5-d9cc1df4f5e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:18:24.266470 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dc0eb-34fc-483b-b3b5-d9cc1df4f5e1 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:24.266750 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dc0eb-34fc-483b-b3b5-d9cc1df4f5e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:24.267020 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dc0eb-34fc-483b-b3b5-d9cc1df4f5e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:24.268651 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5d1dc0eb-34fc-483b-b3b5-d9cc1df4f5e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:24.358340 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1dc0eb-34fc-483b-b3b5-d9cc1df4f5e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:18:24.359931 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1dc0eb-34fc-483b-b3b5-d9cc1df4f5e1 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:18:24.378705 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 568/1117] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:18:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:18:26.442913 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadccccf-120c-432a-a8b0-6c78283f476e None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:26.443530 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadccccf-120c-432a-a8b0-6c78283f476e None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:26.443530 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadccccf-120c-432a-a8b0-6c78283f476e None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:26.444857 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 550/1118] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 25 13:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:18:26.450340 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81422739-99ad-434e-a803-fca37222db31 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:26.450747 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81422739-99ad-434e-a803-fca37222db31 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:26.450930 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81422739-99ad-434e-a803-fca37222db31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:26.491914 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:26.519046 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-81422739-99ad-434e-a803-fca37222db31 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:18:26.520298 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-81422739-99ad-434e-a803-fca37222db31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:26.617617 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 569/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 25 13:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:18:26.902539 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadccccf-120c-432a-a8b0-6c78283f476e None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:18:26.904883 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-cadccccf-120c-432a-a8b0-6c78283f476e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:27.006541 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadccccf-120c-432a-a8b0-6c78283f476e None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:18:27.038553 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:27.081236 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a8b69-9f50-483f-8f1b-6688dfcf48f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:18:27.081843 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a8b69-9f50-483f-8f1b-6688dfcf48f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:27.082127 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a8b69-9f50-483f-8f1b-6688dfcf48f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:27.082398 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a8b69-9f50-483f-8f1b-6688dfcf48f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:27.084023 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-733a8b69-9f50-483f-8f1b-6688dfcf48f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:27.193248 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a8b69-9f50-483f-8f1b-6688dfcf48f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:18:27.194677 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a8b69-9f50-483f-8f1b-6688dfcf48f3 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:18:27.212190 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 551/1120] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:18:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:18:29.513616 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5567651-8f5d-4c96-a5da-0236ac929805 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:29.514204 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5567651-8f5d-4c96-a5da-0236ac929805 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:29.514204 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5567651-8f5d-4c96-a5da-0236ac929805 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:29.515514 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 570/1121] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 25 13:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 13:18:29.520829 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826660f2-a9af-4969-ac4e-157fd0b81fff None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:29.521254 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826660f2-a9af-4969-ac4e-157fd0b81fff None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:29.521382 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826660f2-a9af-4969-ac4e-157fd0b81fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:29.586940 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-826660f2-a9af-4969-ac4e-157fd0b81fff None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:18:29.588153 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-826660f2-a9af-4969-ac4e-157fd0b81fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:29.601491 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:29.687623 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 552/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 25 13:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:18:29.974346 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5567651-8f5d-4c96-a5da-0236ac929805 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:18:29.975944 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c5567651-8f5d-4c96-a5da-0236ac929805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:30.084315 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5567651-8f5d-4c96-a5da-0236ac929805 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:18:30.096977 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:30.157516 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ddfe0-8be0-466f-a274-9c37689b89ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:18:30.158118 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ddfe0-8be0-466f-a274-9c37689b89ce service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:30.158397 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ddfe0-8be0-466f-a274-9c37689b89ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:30.158664 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ddfe0-8be0-466f-a274-9c37689b89ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:30.160286 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9b6ddfe0-8be0-466f-a274-9c37689b89ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:30.271563 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ddfe0-8be0-466f-a274-9c37689b89ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:18:30.272946 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ddfe0-8be0-466f-a274-9c37689b89ce service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:18:30.291753 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 571/1123] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:18:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:18:32.756226 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca9e07-05f3-4b9f-a1da-c261d45e6fe2 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:32.756738 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca9e07-05f3-4b9f-a1da-c261d45e6fe2 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:32.756849 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca9e07-05f3-4b9f-a1da-c261d45e6fe2 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:32.758094 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 553/1124] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 25 13:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:18:32.763625 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c7f3c-b5c6-45b3-b8f2-56d08374e283 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:32.764045 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c7f3c-b5c6-45b3-b8f2-56d08374e283 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:32.764239 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c7f3c-b5c6-45b3-b8f2-56d08374e283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:32.813683 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:32.831441 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-cd1c7f3c-b5c6-45b3-b8f2-56d08374e283 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:18:32.832664 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cd1c7f3c-b5c6-45b3-b8f2-56d08374e283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:32.930758 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 572/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 25 13:18:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:18:33.213180 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca9e07-05f3-4b9f-a1da-c261d45e6fe2 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:18:33.214702 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ddca9e07-05f3-4b9f-a1da-c261d45e6fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:33.318112 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca9e07-05f3-4b9f-a1da-c261d45e6fe2 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:18:33.358610 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:33.393587 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c1ba9-aa2c-4fbd-8e87-8e04d1e7d551 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:18:33.394185 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c1ba9-aa2c-4fbd-8e87-8e04d1e7d551 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:33.394458 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c1ba9-aa2c-4fbd-8e87-8e04d1e7d551 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:33.394727 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c1ba9-aa2c-4fbd-8e87-8e04d1e7d551 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:33.396326 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-629c1ba9-aa2c-4fbd-8e87-8e04d1e7d551 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:33.503928 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c1ba9-aa2c-4fbd-8e87-8e04d1e7d551 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:18:33.505288 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c1ba9-aa2c-4fbd-8e87-8e04d1e7d551 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:18:33.523770 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 554/1126] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:18:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:18:35.843967 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af45fc-ff26-4cff-95d9-4f892302f0a5 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:35.844495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af45fc-ff26-4cff-95d9-4f892302f0a5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:35.844610 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af45fc-ff26-4cff-95d9-4f892302f0a5 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:35.845862 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 573/1127] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 25 13:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:18:35.851229 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f79c2-816d-41a5-af28-2971bf8ed7a1 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:35.851638 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f79c2-816d-41a5-af28-2971bf8ed7a1 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:35.851779 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f79c2-816d-41a5-af28-2971bf8ed7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:35.919233 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-ec8f79c2-816d-41a5-af28-2971bf8ed7a1 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:18:35.920498 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ec8f79c2-816d-41a5-af28-2971bf8ed7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:35.942920 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:36.021243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 555/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 25 13:18:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:18:36.313978 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af45fc-ff26-4cff-95d9-4f892302f0a5 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:18:36.315617 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-56af45fc-ff26-4cff-95d9-4f892302f0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:36.420776 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af45fc-ff26-4cff-95d9-4f892302f0a5 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:18:36.441867 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:36.495330 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d6d8d-6300-4150-b9dc-d9cd106c4d9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:18:36.495951 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d6d8d-6300-4150-b9dc-d9cd106c4d9d service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:36.496231 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d6d8d-6300-4150-b9dc-d9cd106c4d9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:36.497194 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d6d8d-6300-4150-b9dc-d9cd106c4d9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:36.498897 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cb3d6d8d-6300-4150-b9dc-d9cd106c4d9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:36.605625 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d6d8d-6300-4150-b9dc-d9cd106c4d9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:18:36.607182 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d6d8d-6300-4150-b9dc-d9cd106c4d9d service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:18:36.625010 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 574/1129] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:18:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:18:38.832344 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233a87c-b6f0-40ab-a0d7-a6b47945c306 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:38.832859 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233a87c-b6f0-40ab-a0d7-a6b47945c306 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:38.832983 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233a87c-b6f0-40ab-a0d7-a6b47945c306 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:38.834235 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 556/1130] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 25 13:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:18:38.839603 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e0cbb-deb6-4b65-9618-0cdfc226fd20 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:38.840590 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e0cbb-deb6-4b65-9618-0cdfc226fd20 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:38.840819 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e0cbb-deb6-4b65-9618-0cdfc226fd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:38.904191 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:38.906936 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-734e0cbb-deb6-4b65-9618-0cdfc226fd20 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:18:38.908705 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-734e0cbb-deb6-4b65-9618-0cdfc226fd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:39.008817 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 575/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 25 13:18:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:18:39.292682 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c233a87c-b6f0-40ab-a0d7-a6b47945c306 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:18:39.294292 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c233a87c-b6f0-40ab-a0d7-a6b47945c306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:39.398668 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c233a87c-b6f0-40ab-a0d7-a6b47945c306 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:18:39.448077 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:39.472499 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70ed4d-62b9-499a-9c26-da7994e629b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:18:39.473096 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70ed4d-62b9-499a-9c26-da7994e629b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:39.473375 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70ed4d-62b9-499a-9c26-da7994e629b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:39.473646 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70ed4d-62b9-499a-9c26-da7994e629b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:39.475239 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-1c70ed4d-62b9-499a-9c26-da7994e629b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:39.583533 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70ed4d-62b9-499a-9c26-da7994e629b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:18:39.585043 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70ed4d-62b9-499a-9c26-da7994e629b7 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:18:39.602744 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 557/1132] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:18:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:18:41.923057 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444199c-fed4-44bb-9546-ce0a3857c6bb None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:41.923628 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444199c-fed4-44bb-9546-ce0a3857c6bb None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:41.923628 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444199c-fed4-44bb-9546-ce0a3857c6bb None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:41.925200 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 576/1133] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 25 13:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:18:41.930505 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e472f-5b9d-43fa-914f-1d9d5ab1b56b None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:41.930964 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e472f-5b9d-43fa-914f-1d9d5ab1b56b None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:41.931083 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e472f-5b9d-43fa-914f-1d9d5ab1b56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:41.997753 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-9f8e472f-5b9d-43fa-914f-1d9d5ab1b56b None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:18:41.999024 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-9f8e472f-5b9d-43fa-914f-1d9d5ab1b56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:42.027610 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:42.097165 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 558/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 25 13:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:18:42.381631 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444199c-fed4-44bb-9546-ce0a3857c6bb None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:18:42.383183 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5444199c-fed4-44bb-9546-ce0a3857c6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:42.485209 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444199c-fed4-44bb-9546-ce0a3857c6bb None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:18:42.514193 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:42.558242 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc977f-3d38-42cf-8e66-b3e84e09ef8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:18:42.559388 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc977f-3d38-42cf-8e66-b3e84e09ef8a service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:42.559650 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc977f-3d38-42cf-8e66-b3e84e09ef8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:42.559944 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc977f-3d38-42cf-8e66-b3e84e09ef8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:42.561547 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-31fc977f-3d38-42cf-8e66-b3e84e09ef8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:42.668630 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc977f-3d38-42cf-8e66-b3e84e09ef8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:18:42.670053 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc977f-3d38-42cf-8e66-b3e84e09ef8a service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:18:42.688400 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 577/1135] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:18:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:18:44.898562 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd14d3-3814-43e9-9718-78ac6884fe8f None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:44.899094 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd14d3-3814-43e9-9718-78ac6884fe8f None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:44.899094 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd14d3-3814-43e9-9718-78ac6884fe8f None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:44.900492 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 559/1136] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 25 13:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:18:44.905860 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30176d0c-7548-47fc-a194-82ef66636ea3 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:44.906267 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30176d0c-7548-47fc-a194-82ef66636ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:44.906421 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30176d0c-7548-47fc-a194-82ef66636ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:44.973420 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-30176d0c-7548-47fc-a194-82ef66636ea3 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:18:44.974636 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-30176d0c-7548-47fc-a194-82ef66636ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:44.983545 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:45.071476 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 578/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 25 13:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:18:45.359278 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd14d3-3814-43e9-9718-78ac6884fe8f None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:18:45.360872 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-3dcd14d3-3814-43e9-9718-78ac6884fe8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:45.463098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd14d3-3814-43e9-9718-78ac6884fe8f None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:18:45.520427 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:45.538550 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743277c-d9fe-42a0-a09a-553584d399a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:18:45.539145 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743277c-d9fe-42a0-a09a-553584d399a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:45.539419 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743277c-d9fe-42a0-a09a-553584d399a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:45.539689 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743277c-d9fe-42a0-a09a-553584d399a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:45.541304 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-4743277c-d9fe-42a0-a09a-553584d399a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:45.649045 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743277c-d9fe-42a0-a09a-553584d399a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:18:45.650463 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743277c-d9fe-42a0-a09a-553584d399a2 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:18:45.668685 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 560/1138] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:18:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:18:47.925054 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6da3a1-724a-4d86-a3b2-f41bf937e9dc None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:47.925587 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6da3a1-724a-4d86-a3b2-f41bf937e9dc None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:47.925587 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6da3a1-724a-4d86-a3b2-f41bf937e9dc None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:47.926921 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 579/1139] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 25 13:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:18:47.932114 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50781fec-3e2c-4bee-b524-170f78d2829a None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:47.932558 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50781fec-3e2c-4bee-b524-170f78d2829a None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:47.932663 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50781fec-3e2c-4bee-b524-170f78d2829a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:47.998673 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-50781fec-3e2c-4bee-b524-170f78d2829a None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:18:47.999794 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-50781fec-3e2c-4bee-b524-170f78d2829a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:48.038477 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:48.102133 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 561/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 25 13:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:18:48.395606 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6da3a1-724a-4d86-a3b2-f41bf937e9dc None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:18:48.397178 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ac6da3a1-724a-4d86-a3b2-f41bf937e9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:48.499821 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6da3a1-724a-4d86-a3b2-f41bf937e9dc None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:18:48.537186 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:48.572800 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08242f85-1e2f-4688-a6f5-2abc74f3eefa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:18:48.573398 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08242f85-1e2f-4688-a6f5-2abc74f3eefa service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:48.574113 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08242f85-1e2f-4688-a6f5-2abc74f3eefa service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:48.574113 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08242f85-1e2f-4688-a6f5-2abc74f3eefa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:48.575773 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-08242f85-1e2f-4688-a6f5-2abc74f3eefa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:48.685457 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08242f85-1e2f-4688-a6f5-2abc74f3eefa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:18:48.686792 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08242f85-1e2f-4688-a6f5-2abc74f3eefa service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:18:48.704359 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 580/1141] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:18:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:18:51.076927 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc0046-b1ad-4b20-87e4-70e6e67367a0 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:51.077456 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc0046-b1ad-4b20-87e4-70e6e67367a0 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:51.077456 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc0046-b1ad-4b20-87e4-70e6e67367a0 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:51.078734 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 562/1142] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 25 13:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:18:51.084206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea6ffa-b669-44f3-9b53-b1702e6b6260 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:51.084616 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea6ffa-b669-44f3-9b53-b1702e6b6260 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:51.084757 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea6ffa-b669-44f3-9b53-b1702e6b6260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:51.149872 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-bfea6ffa-b669-44f3-9b53-b1702e6b6260 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:18:51.151065 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-bfea6ffa-b669-44f3-9b53-b1702e6b6260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:51.170104 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:51.247643 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 581/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 25 13:18:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:18:51.531939 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc0046-b1ad-4b20-87e4-70e6e67367a0 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:18:51.533523 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-7dbc0046-b1ad-4b20-87e4-70e6e67367a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:51.637827 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc0046-b1ad-4b20-87e4-70e6e67367a0 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:18:51.705986 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:51.713093 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1c1c2-7e65-4df3-abc6-82c28a42206f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:18:51.713689 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1c1c2-7e65-4df3-abc6-82c28a42206f service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:51.714063 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1c1c2-7e65-4df3-abc6-82c28a42206f service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:51.714574 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1c1c2-7e65-4df3-abc6-82c28a42206f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:51.716690 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c9f1c1c2-7e65-4df3-abc6-82c28a42206f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:51.825921 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f1c1c2-7e65-4df3-abc6-82c28a42206f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:18:51.827282 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f1c1c2-7e65-4df3-abc6-82c28a42206f service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:18:51.845524 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 563/1144] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:18:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:18:53.997372 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42917e99-3ee4-4b52-b6ff-c6296aa69275 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:53.997891 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42917e99-3ee4-4b52-b6ff-c6296aa69275 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:53.997891 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42917e99-3ee4-4b52-b6ff-c6296aa69275 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:53.999186 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 582/1145] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 25 13:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:18:54.004450 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7de837-2a46-49d0-80e6-47e52b7f6c13 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:54.004879 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7de837-2a46-49d0-80e6-47e52b7f6c13 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:54.004989 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7de837-2a46-49d0-80e6-47e52b7f6c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:54.069824 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-ff7de837-2a46-49d0-80e6-47e52b7f6c13 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:18:54.071005 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ff7de837-2a46-49d0-80e6-47e52b7f6c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:54.119933 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:54.170637 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 564/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 25 13:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:18:54.453301 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42917e99-3ee4-4b52-b6ff-c6296aa69275 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:18:54.454845 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-42917e99-3ee4-4b52-b6ff-c6296aa69275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:54.558860 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42917e99-3ee4-4b52-b6ff-c6296aa69275 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:18:54.608528 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:18:54.634673 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8cc7b9-aede-4a97-b29c-9ed72bf0d0e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:18:54.635274 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cc7b9-aede-4a97-b29c-9ed72bf0d0e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:18:54.635549 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cc7b9-aede-4a97-b29c-9ed72bf0d0e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:18:54.636402 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cc7b9-aede-4a97-b29c-9ed72bf0d0e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:18:54.638012 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5d8cc7b9-aede-4a97-b29c-9ed72bf0d0e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:18:54.746608 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8cc7b9-aede-4a97-b29c-9ed72bf0d0e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:18:54.748072 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8cc7b9-aede-4a97-b29c-9ed72bf0d0e7 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:18:54.766190 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 583/1147] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:18:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:19:04.168680 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=22 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:19:04.763934 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=66 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:19:14.769593 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3dd5ab-8b03-49fc-8865-5deae5a91fed None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:19:14.770143 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3dd5ab-8b03-49fc-8865-5deae5a91fed None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:19:14.770143 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3dd5ab-8b03-49fc-8865-5deae5a91fed None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:19:14.771795 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 565/1148] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:19:14.777494 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623dca96-c236-41e9-a5ba-37f198f092dd None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:19:14.777919 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623dca96-c236-41e9-a5ba-37f198f092dd None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:19:14.778033 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623dca96-c236-41e9-a5ba-37f198f092dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:19:14.845101 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-623dca96-c236-41e9-a5ba-37f198f092dd None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:19:14.846327 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-623dca96-c236-41e9-a5ba-37f198f092dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:19:14.940203 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 584/1149] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:19:15.246751 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcd5cb-59cf-44dd-a3e1-2ecf48b65793 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:19:15.247030 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcd5cb-59cf-44dd-a3e1-2ecf48b65793 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:19:15.247303 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcd5cb-59cf-44dd-a3e1-2ecf48b65793 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:19:15.248678 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 566/1150] 10.222.0.25 () {54 vars in 962 bytes} [Tue Oct 25 13:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:19:15.253642 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70466bde-1ac7-4c56-b0b9-9653319beca3 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:19:15.253958 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70466bde-1ac7-4c56-b0b9-9653319beca3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:19:15.254242 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70466bde-1ac7-4c56-b0b9-9653319beca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:19:15.331689 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-70466bde-1ac7-4c56-b0b9-9653319beca3 None None] MFA Rules not processed for user `89f67d808ffb4641b03f96406b3fe9e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:19:15.332906 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-70466bde-1ac7-4c56-b0b9-9653319beca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:19:15.353749 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:19:15.411403 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 585/1151] 10.222.0.25 () {58 vars in 1059 bytes} [Tue Oct 25 13:19:15 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:19:15.419492 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bcd5cb-59cf-44dd-a3e1-2ecf48b65793 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:19:15.421042 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-61bcd5cb-59cf-44dd-a3e1-2ecf48b65793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:19:15.522799 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bcd5cb-59cf-44dd-a3e1-2ecf48b65793 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:19:15.595708 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b919028-9f40-4d78-a626-036366c49305 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f67d808ffb4641b03f96406b3fe9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:19:15.596331 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b919028-9f40-4d78-a626-036366c49305 service glance] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:19:15.596607 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b919028-9f40-4d78-a626-036366c49305 service glance] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:19:15.596876 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b919028-9f40-4d78-a626-036366c49305 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:19:15.598459 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-9b919028-9f40-4d78-a626-036366c49305 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:19:15.654078 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:19:15.709401 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b919028-9f40-4d78-a626-036366c49305 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:19:15.710838 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b919028-9f40-4d78-a626-036366c49305 service glance] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:19:15.730669 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 567/1152] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:19:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 13:19:17.995431 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5e1fe-2247-4f3f-9061-200a53c9b3c7 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:19:17.995979 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5e1fe-2247-4f3f-9061-200a53c9b3c7 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:19:17.995979 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5e1fe-2247-4f3f-9061-200a53c9b3c7 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:19:17.997257 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 586/1153] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:19:18.002876 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b8fd7-ed14-42db-98ce-948a575e61fc None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:19:18.003289 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b8fd7-ed14-42db-98ce-948a575e61fc None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:19:18.003422 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b8fd7-ed14-42db-98ce-948a575e61fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:19:18.068532 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-924b8fd7-ed14-42db-98ce-948a575e61fc None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:19:18.069718 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-924b8fd7-ed14-42db-98ce-948a575e61fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:19:18.165212 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 568/1154] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:19:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:19:18.445745 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5e1fe-2247-4f3f-9061-200a53c9b3c7 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:19:18.447327 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f1e5e1fe-2247-4f3f-9061-200a53c9b3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:19:18.570600 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5e1fe-2247-4f3f-9061-200a53c9b3c7 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:19:18.621041 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:19:18.665537 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417a25b-f9c3-4aaa-9a3a-11c0a7444f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:19:18.666164 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417a25b-f9c3-4aaa-9a3a-11c0a7444f3f admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:19:18.666441 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417a25b-f9c3-4aaa-9a3a-11c0a7444f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:19:18.666713 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417a25b-f9c3-4aaa-9a3a-11c0a7444f3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:19:18.667334 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417a25b-f9c3-4aaa-9a3a-11c0a7444f3f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:19:18.668374 dv-cinder-862432-2-smb devstack@keystone.service[81362]: WARNING py.warnings [None req-5417a25b-f9c3-4aaa-9a3a-11c0a7444f3f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 13:19:18.668374 dv-cinder-862432-2-smb devstack@keystone.service[81362]: warnings.warn(msg) Oct 25 13:19:18.668374 dv-cinder-862432-2-smb devstack@keystone.service[81362]: Oct 25 13:19:18.669505 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417a25b-f9c3-4aaa-9a3a-11c0a7444f3f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:19:18.688499 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 587/1155] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 25 13:19:18 2022] GET /identity/v3/projects => generated 2553 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:19:20.858651 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11073e0e-bf45-4f68-8aef-4c4094c8447a None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:19:20.859182 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11073e0e-bf45-4f68-8aef-4c4094c8447a None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:19:20.859182 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11073e0e-bf45-4f68-8aef-4c4094c8447a None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:19:20.860576 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 569/1156] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:19:20.865956 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d867c-614e-465c-b67f-83a9c4e798b1 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:19:20.866372 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d867c-614e-465c-b67f-83a9c4e798b1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:19:20.866551 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d867c-614e-465c-b67f-83a9c4e798b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:19:20.932775 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-083d867c-614e-465c-b67f-83a9c4e798b1 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:19:20.933967 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-083d867c-614e-465c-b67f-83a9c4e798b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:19:21.029467 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 588/1157] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:19:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:19:21.331148 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11073e0e-bf45-4f68-8aef-4c4094c8447a None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:19:21.332758 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-11073e0e-bf45-4f68-8aef-4c4094c8447a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:19:21.342702 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:19:21.477134 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11073e0e-bf45-4f68-8aef-4c4094c8447a None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:19:21.557376 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:19:21.591364 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887efe8-1080-4b19-b0e9-e2597cdf4b26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:19:21.591975 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887efe8-1080-4b19-b0e9-e2597cdf4b26 service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:19:21.592197 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887efe8-1080-4b19-b0e9-e2597cdf4b26 service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:19:21.592481 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887efe8-1080-4b19-b0e9-e2597cdf4b26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:19:21.594058 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c887efe8-1080-4b19-b0e9-e2597cdf4b26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:19:21.683476 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887efe8-1080-4b19-b0e9-e2597cdf4b26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:19:21.685084 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887efe8-1080-4b19-b0e9-e2597cdf4b26 service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:19:21.703271 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 570/1158] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:19:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:19:24.122762 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164f8e8-b97f-4b6d-9825-a61ab8be4e17 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:19:24.123294 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164f8e8-b97f-4b6d-9825-a61ab8be4e17 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:19:24.123294 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164f8e8-b97f-4b6d-9825-a61ab8be4e17 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:19:24.124642 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 589/1159] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:19:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:19:24.130491 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43020dfc-6274-4272-b937-eecb19e222ee None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:19:24.130905 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43020dfc-6274-4272-b937-eecb19e222ee None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:19:24.131012 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43020dfc-6274-4272-b937-eecb19e222ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:19:24.207231 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-43020dfc-6274-4272-b937-eecb19e222ee None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:19:24.208766 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-43020dfc-6274-4272-b937-eecb19e222ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:19:24.261262 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:19:24.319813 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 571/1160] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:19:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:19:24.627817 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164f8e8-b97f-4b6d-9825-a61ab8be4e17 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:19:24.629389 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7164f8e8-b97f-4b6d-9825-a61ab8be4e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:19:24.654461 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:19:24.736019 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164f8e8-b97f-4b6d-9825-a61ab8be4e17 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:19:24.811627 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76b7ab-f019-4e04-a35c-b283d7cdfddd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:19:24.812274 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76b7ab-f019-4e04-a35c-b283d7cdfddd service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:19:24.812558 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76b7ab-f019-4e04-a35c-b283d7cdfddd service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:19:24.812832 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76b7ab-f019-4e04-a35c-b283d7cdfddd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:19:24.814486 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cc76b7ab-f019-4e04-a35c-b283d7cdfddd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:19:24.888158 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:19:24.922997 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc76b7ab-f019-4e04-a35c-b283d7cdfddd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:19:24.924475 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc76b7ab-f019-4e04-a35c-b283d7cdfddd service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:19:24.942658 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 590/1161] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:19:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:19:27.199559 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4209c6-716c-4a14-93fa-c98a6c94d8ba None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:19:27.200149 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4209c6-716c-4a14-93fa-c98a6c94d8ba None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:19:27.200149 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4209c6-716c-4a14-93fa-c98a6c94d8ba None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:19:27.201506 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 572/1162] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:19:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:19:27.206908 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3d345-7885-442e-b739-31915a0aca93 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:19:27.207312 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3d345-7885-442e-b739-31915a0aca93 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:19:27.207463 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3d345-7885-442e-b739-31915a0aca93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:19:27.272506 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-37d3d345-7885-442e-b739-31915a0aca93 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:19:27.273705 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-37d3d345-7885-442e-b739-31915a0aca93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:19:27.368983 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 591/1163] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:19:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:19:27.659587 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4209c6-716c-4a14-93fa-c98a6c94d8ba None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:19:27.661129 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ab4209c6-716c-4a14-93fa-c98a6c94d8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:19:27.767264 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4209c6-716c-4a14-93fa-c98a6c94d8ba None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:19:27.841754 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:19:27.843552 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274acc8f-df91-40a2-b322-6ed86dd799fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:19:27.844446 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274acc8f-df91-40a2-b322-6ed86dd799fc service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:19:27.844898 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274acc8f-df91-40a2-b322-6ed86dd799fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:19:27.845328 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274acc8f-df91-40a2-b322-6ed86dd799fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:19:27.847117 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-274acc8f-df91-40a2-b322-6ed86dd799fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:19:27.960535 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274acc8f-df91-40a2-b322-6ed86dd799fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:19:27.961877 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274acc8f-df91-40a2-b322-6ed86dd799fc service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:19:27.980037 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 573/1164] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:19:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:19:30.251157 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689078b-e9e6-4e57-857d-044c07f9305f None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:19:30.251734 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689078b-e9e6-4e57-857d-044c07f9305f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:19:30.251734 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689078b-e9e6-4e57-857d-044c07f9305f None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:19:30.253068 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 592/1165] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:19:30.258327 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96abb05-824f-46d2-8bd6-dffb8a59859e None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:19:30.258761 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96abb05-824f-46d2-8bd6-dffb8a59859e None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:19:30.258864 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96abb05-824f-46d2-8bd6-dffb8a59859e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:19:30.325094 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-e96abb05-824f-46d2-8bd6-dffb8a59859e None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:19:30.326283 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-e96abb05-824f-46d2-8bd6-dffb8a59859e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:19:30.378613 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:19:30.422697 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 574/1166] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:19:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:19:30.715880 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689078b-e9e6-4e57-857d-044c07f9305f None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:19:30.717511 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8689078b-e9e6-4e57-857d-044c07f9305f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:19:30.754507 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:19:30.822362 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689078b-e9e6-4e57-857d-044c07f9305f None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:19:30.896526 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb3bdc-cd9e-41fa-820a-3ca96acfe433 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:19:30.897129 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb3bdc-cd9e-41fa-820a-3ca96acfe433 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:19:30.897412 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb3bdc-cd9e-41fa-820a-3ca96acfe433 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:19:30.897682 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb3bdc-cd9e-41fa-820a-3ca96acfe433 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:19:30.900022 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-06eb3bdc-cd9e-41fa-820a-3ca96acfe433 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:19:30.979003 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:19:31.008813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb3bdc-cd9e-41fa-820a-3ca96acfe433 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:19:31.010277 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb3bdc-cd9e-41fa-820a-3ca96acfe433 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:19:31.028528 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 593/1167] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:19:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:19:33.375367 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ba663-fc64-4e0c-bf10-1eb3a312c22d None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:19:33.375959 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ba663-fc64-4e0c-bf10-1eb3a312c22d None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:19:33.375959 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ba663-fc64-4e0c-bf10-1eb3a312c22d None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:19:33.377270 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 575/1168] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 25 13:19:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:19:33.382591 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3285b2-acf2-48f0-aef2-4d3340c571a6 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:19:33.383023 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3285b2-acf2-48f0-aef2-4d3340c571a6 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:19:33.384075 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3285b2-acf2-48f0-aef2-4d3340c571a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:19:33.450657 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-9f3285b2-acf2-48f0-aef2-4d3340c571a6 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:19:33.451861 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9f3285b2-acf2-48f0-aef2-4d3340c571a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:19:33.546787 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 594/1169] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 25 13:19:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:19:33.838527 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ba663-fc64-4e0c-bf10-1eb3a312c22d None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:19:33.840117 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-cc8ba663-fc64-4e0c-bf10-1eb3a312c22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:19:33.944449 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ba663-fc64-4e0c-bf10-1eb3a312c22d None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:19:34.016552 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4f288-5381-4d8e-9899-92effe24b844 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:19:34.017068 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4f288-5381-4d8e-9899-92effe24b844 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:19:34.017342 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4f288-5381-4d8e-9899-92effe24b844 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:19:34.017612 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4f288-5381-4d8e-9899-92effe24b844 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:19:34.019179 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-52d4f288-5381-4d8e-9899-92effe24b844 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:19:34.028021 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:19:34.127924 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4f288-5381-4d8e-9899-92effe24b844 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:19:34.129347 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4f288-5381-4d8e-9899-92effe24b844 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:19:34.146864 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 576/1170] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:19:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:19:43.545283 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=82 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:19:44.144672 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=50 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:20:47.202358 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa94af1-a86c-45c9-928f-67fc369273e9 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:20:47.202948 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa94af1-a86c-45c9-928f-67fc369273e9 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:20:47.202948 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa94af1-a86c-45c9-928f-67fc369273e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:20:47.281226 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-faa94af1-a86c-45c9-928f-67fc369273e9 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:20:47.282431 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-faa94af1-a86c-45c9-928f-67fc369273e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:20:47.381204 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 595/1171] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:20:47.389199 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1def052-60be-4233-9d65-1be222746dc5 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:20:47.389693 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1def052-60be-4233-9d65-1be222746dc5 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:20:47.389796 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1def052-60be-4233-9d65-1be222746dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:20:47.465895 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-e1def052-60be-4233-9d65-1be222746dc5 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:20:47.467017 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-e1def052-60be-4233-9d65-1be222746dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:20:47.562361 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 577/1172] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:20:47.567559 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa94af1-a86c-45c9-928f-67fc369273e9 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:20:47.568785 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-faa94af1-a86c-45c9-928f-67fc369273e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:20:47.579827 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa94af1-a86c-45c9-928f-67fc369273e9 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:20:47.639398 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:20:47.672959 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7211a-14b9-4eb1-b885-7557babab217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:20:47.673564 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7211a-14b9-4eb1-b885-7557babab217 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:20:47.673842 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7211a-14b9-4eb1-b885-7557babab217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:20:47.674117 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7211a-14b9-4eb1-b885-7557babab217 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:20:47.674749 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef7211a-14b9-4eb1-b885-7557babab217 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:20:47.675058 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef7211a-14b9-4eb1-b885-7557babab217 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:20:47.676583 dv-cinder-862432-2-smb devstack@keystone.service[81362]: WARNING py.warnings [None req-aef7211a-14b9-4eb1-b885-7557babab217 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 25 13:20:47.676583 dv-cinder-862432-2-smb devstack@keystone.service[81362]: warnings.warn(msg) Oct 25 13:20:47.676583 dv-cinder-862432-2-smb devstack@keystone.service[81362]: Oct 25 13:20:47.677463 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef7211a-14b9-4eb1-b885-7557babab217 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:20:47.688444 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 596/1173] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:20:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:20:47.698316 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1def052-60be-4233-9d65-1be222746dc5 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:20:47.707491 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1def052-60be-4233-9d65-1be222746dc5 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:20:47.768492 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:20:47.805084 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360bffc4-514c-4f8c-8c85-348c66b1e341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:20:47.805694 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bffc4-514c-4f8c-8c85-348c66b1e341 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:20:47.805987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bffc4-514c-4f8c-8c85-348c66b1e341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:20:47.806241 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bffc4-514c-4f8c-8c85-348c66b1e341 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:20:47.806880 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360bffc4-514c-4f8c-8c85-348c66b1e341 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:20:47.808050 dv-cinder-862432-2-smb devstack@keystone.service[81363]: WARNING py.warnings [None req-360bffc4-514c-4f8c-8c85-348c66b1e341 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 13:20:47.808050 dv-cinder-862432-2-smb devstack@keystone.service[81363]: warnings.warn(msg) Oct 25 13:20:47.808050 dv-cinder-862432-2-smb devstack@keystone.service[81363]: Oct 25 13:20:47.809224 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360bffc4-514c-4f8c-8c85-348c66b1e341 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:20:47.864791 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 578/1174] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:20:47 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:20:47.869002 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7211a-14b9-4eb1-b885-7557babab217 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:20:47.870525 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-aef7211a-14b9-4eb1-b885-7557babab217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:20:47.904190 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7211a-14b9-4eb1-b885-7557babab217 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:20:47.998270 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3a382-b09c-4974-af28-d0650ab78ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:20:47.998816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3a382-b09c-4974-af28-d0650ab78ec1 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:20:47.999090 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3a382-b09c-4974-af28-d0650ab78ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:20:47.999358 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3a382-b09c-4974-af28-d0650ab78ec1 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:20:48.000002 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d3a382-b09c-4974-af28-d0650ab78ec1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:20:48.001002 dv-cinder-862432-2-smb devstack@keystone.service[81362]: WARNING py.warnings [None req-c0d3a382-b09c-4974-af28-d0650ab78ec1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 13:20:48.001002 dv-cinder-862432-2-smb devstack@keystone.service[81362]: warnings.warn(msg) Oct 25 13:20:48.001002 dv-cinder-862432-2-smb devstack@keystone.service[81362]: Oct 25 13:20:48.002188 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d3a382-b09c-4974-af28-d0650ab78ec1 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:20:48.049510 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 597/1175] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:20:47 2022] POST /identity/v3/users => generated 290 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:20:48.054122 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360bffc4-514c-4f8c-8c85-348c66b1e341 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:20:48.055634 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-360bffc4-514c-4f8c-8c85-348c66b1e341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:20:48.117091 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360bffc4-514c-4f8c-8c85-348c66b1e341 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:20:48.200192 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:20:48.211970 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6f271-090c-4903-b194-7dc83b7d7fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:20:48.212576 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6f271-090c-4903-b194-7dc83b7d7fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:20:48.212852 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6f271-090c-4903-b194-7dc83b7d7fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:20:48.213123 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6f271-090c-4903-b194-7dc83b7d7fc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:20:48.213761 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6f271-090c-4903-b194-7dc83b7d7fc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:20:48.215351 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6f271-090c-4903-b194-7dc83b7d7fc9 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:20:48.228242 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 579/1176] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:20:48.232389 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3a382-b09c-4974-af28-d0650ab78ec1 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:20:48.233943 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c0d3a382-b09c-4974-af28-d0650ab78ec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:20:48.245415 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3a382-b09c-4974-af28-d0650ab78ec1 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:20:48.270812 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:20:48.340170 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44392a6-6fd8-4b00-bc59-d64d4449d7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:20:48.340770 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44392a6-6fd8-4b00-bc59-d64d4449d7dd admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:20:48.341048 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44392a6-6fd8-4b00-bc59-d64d4449d7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:20:48.341318 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44392a6-6fd8-4b00-bc59-d64d4449d7dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:20:48.341941 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44392a6-6fd8-4b00-bc59-d64d4449d7dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:20:48.343522 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44392a6-6fd8-4b00-bc59-d64d4449d7dd admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:20:48.355923 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 598/1177] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:20:48.360149 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6f271-090c-4903-b194-7dc83b7d7fc9 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:20:48.361658 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-1df6f271-090c-4903-b194-7dc83b7d7fc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:20:48.395565 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6f271-090c-4903-b194-7dc83b7d7fc9 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:20:48.493969 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0030bf-3597-4b2a-8f3c-56c44020013f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:20:48.494626 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0030bf-3597-4b2a-8f3c-56c44020013f admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:20:48.494902 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0030bf-3597-4b2a-8f3c-56c44020013f admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:20:48.495176 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0030bf-3597-4b2a-8f3c-56c44020013f admin admin] PATH_INFO: `/v3/projects/476b7d65d083413e91e7a20c915a0c71/users/759064b08dbb491683116afa13d491b9/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:20:48.518167 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0030bf-3597-4b2a-8f3c-56c44020013f admin admin] RBAC: Authorizing `identity:create_grant(project_id=476b7d65d083413e91e7a20c915a0c71, user_id=759064b08dbb491683116afa13d491b9, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:20:48.520965 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0030bf-3597-4b2a-8f3c-56c44020013f admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:20:48.545647 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 580/1178] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:20:48 2022] PUT /identity/v3/projects/476b7d65d083413e91e7a20c915a0c71/users/759064b08dbb491683116afa13d491b9/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:20:48.559164 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01665f-cdc0-409c-877b-97a21fcab4de None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:20:48.559477 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01665f-cdc0-409c-877b-97a21fcab4de None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:20:48.559751 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01665f-cdc0-409c-877b-97a21fcab4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:20:48.617165 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-1b01665f-cdc0-409c-877b-97a21fcab4de None None] MFA Rules not processed for user `759064b08dbb491683116afa13d491b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:20:48.618354 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1b01665f-cdc0-409c-877b-97a21fcab4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:20:48.704030 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 599/1179] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:20:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:20:48.717620 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b63fa5-5591-4549-96aa-3981367db536 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:20:48.717897 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b63fa5-5591-4549-96aa-3981367db536 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:20:48.718167 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b63fa5-5591-4549-96aa-3981367db536 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:20:48.719504 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 581/1180] 10.222.0.25 () {54 vars in 963 bytes} [Tue Oct 25 13:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:20:48.725051 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c21341-b91f-4a2b-a2ad-404051c4edd9 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:20:48.725346 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c21341-b91f-4a2b-a2ad-404051c4edd9 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:20:48.725626 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c21341-b91f-4a2b-a2ad-404051c4edd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:20:48.757772 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:20:48.803272 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-50c21341-b91f-4a2b-a2ad-404051c4edd9 None None] MFA Rules not processed for user `858fa61f39fa4d3daf4125f6099e7721`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:20:48.804436 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-50c21341-b91f-4a2b-a2ad-404051c4edd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:20:48.879683 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 600/1181] 10.222.0.25 () {58 vars in 1060 bytes} [Tue Oct 25 13:20:48 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:20:48.887401 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b63fa5-5591-4549-96aa-3981367db536 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:20:48.888945 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-26b63fa5-5591-4549-96aa-3981367db536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:20:48.939289 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:20:48.992580 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b63fa5-5591-4549-96aa-3981367db536 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:20:49.067564 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2376e56-6823-43a3-93fb-6f4415c4ead8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:20:49.068129 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2376e56-6823-43a3-93fb-6f4415c4ead8 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:20:49.068405 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2376e56-6823-43a3-93fb-6f4415c4ead8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:20:49.068671 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2376e56-6823-43a3-93fb-6f4415c4ead8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:20:49.070244 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b2376e56-6823-43a3-93fb-6f4415c4ead8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:20:49.173912 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2376e56-6823-43a3-93fb-6f4415c4ead8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:20:49.175373 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2376e56-6823-43a3-93fb-6f4415c4ead8 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:20:49.178812 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:20:49.193596 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 582/1182] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:20:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:20:49.240085 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec519509-c3df-4836-9ad0-dd5af74d0611 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:20:49.240497 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec519509-c3df-4836-9ad0-dd5af74d0611 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:20:49.240648 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec519509-c3df-4836-9ad0-dd5af74d0611 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:20:49.241890 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 601/1183] 10.222.0.25 () {52 vars in 830 bytes} [Tue Oct 25 13:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:20:49.245465 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2376e56-6823-43a3-93fb-6f4415c4ead8 service cinder] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:20:49.246673 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b2376e56-6823-43a3-93fb-6f4415c4ead8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:20:49.349842 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2376e56-6823-43a3-93fb-6f4415c4ead8 service cinder] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:20:49.442650 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b663ad-5d24-4e7c-8d55-2700314ea7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:20:49.443332 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b663ad-5d24-4e7c-8d55-2700314ea7bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:20:49.443537 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b663ad-5d24-4e7c-8d55-2700314ea7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:20:49.443833 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b663ad-5d24-4e7c-8d55-2700314ea7bb admin admin] PATH_INFO: `/v3/users/759064b08dbb491683116afa13d491b9` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:20:49.456328 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b663ad-5d24-4e7c-8d55-2700314ea7bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=759064b08dbb491683116afa13d491b9)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:20:49.457733 dv-cinder-862432-2-smb devstack@keystone.service[81363]: WARNING py.warnings [None req-22b663ad-5d24-4e7c-8d55-2700314ea7bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 13:20:49.457733 dv-cinder-862432-2-smb devstack@keystone.service[81363]: warnings.warn(msg) Oct 25 13:20:49.457733 dv-cinder-862432-2-smb devstack@keystone.service[81363]: Oct 25 13:20:49.458965 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b663ad-5d24-4e7c-8d55-2700314ea7bb admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:20:49.468630 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:20:49.525393 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-22b663ad-5d24-4e7c-8d55-2700314ea7bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '759064b08dbb491683116afa13d491b9'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:20:49.548134 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-22b663ad-5d24-4e7c-8d55-2700314ea7bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '759064b08dbb491683116afa13d491b9'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:20:49.548608 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-22b663ad-5d24-4e7c-8d55-2700314ea7bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '759064b08dbb491683116afa13d491b9'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:20:49.558343 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-22b663ad-5d24-4e7c-8d55-2700314ea7bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '759064b08dbb491683116afa13d491b9'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:20:49.558914 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-22b663ad-5d24-4e7c-8d55-2700314ea7bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '759064b08dbb491683116afa13d491b9'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:20:49.579035 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 583/1184] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:20:49 2022] DELETE /identity/v3/users/759064b08dbb491683116afa13d491b9 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:20:49.584067 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d279a659-35e5-4bd4-a7cc-be410fd26080 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:20:49.584362 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d279a659-35e5-4bd4-a7cc-be410fd26080 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:20:49.584644 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d279a659-35e5-4bd4-a7cc-be410fd26080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:20:49.640581 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d279a659-35e5-4bd4-a7cc-be410fd26080 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:20:49.641787 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d279a659-35e5-4bd4-a7cc-be410fd26080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:20:49.717495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:20:49.730853 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 602/1185] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:20:49.740921 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b663ad-5d24-4e7c-8d55-2700314ea7bb admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:20:49.742146 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-22b663ad-5d24-4e7c-8d55-2700314ea7bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:20:49.845758 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b663ad-5d24-4e7c-8d55-2700314ea7bb admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:20:49.900722 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:20:49.922173 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14fb04-c2ba-4612-8b88-d5d228e023a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:20:49.922775 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14fb04-c2ba-4612-8b88-d5d228e023a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:20:49.923047 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14fb04-c2ba-4612-8b88-d5d228e023a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:20:49.923314 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14fb04-c2ba-4612-8b88-d5d228e023a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:20:49.924941 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-cc14fb04-c2ba-4612-8b88-d5d228e023a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:20:50.033635 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14fb04-c2ba-4612-8b88-d5d228e023a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:20:50.035059 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14fb04-c2ba-4612-8b88-d5d228e023a3 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:20:50.053885 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 584/1186] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:20:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:20:50.428976 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d279a659-35e5-4bd4-a7cc-be410fd26080 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:20:50.430272 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d279a659-35e5-4bd4-a7cc-be410fd26080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:20:50.441371 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d279a659-35e5-4bd4-a7cc-be410fd26080 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:20:50.547444 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252011a-db40-4e09-ab24-72fcdba3b6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:20:50.548099 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252011a-db40-4e09-ab24-72fcdba3b6e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:20:50.548387 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252011a-db40-4e09-ab24-72fcdba3b6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:20:50.548653 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252011a-db40-4e09-ab24-72fcdba3b6e2 admin admin] PATH_INFO: `/v3/projects/476b7d65d083413e91e7a20c915a0c71` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:20:50.558640 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252011a-db40-4e09-ab24-72fcdba3b6e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=476b7d65d083413e91e7a20c915a0c71)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:20:50.559659 dv-cinder-862432-2-smb devstack@keystone.service[81362]: WARNING py.warnings [None req-c252011a-db40-4e09-ab24-72fcdba3b6e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 13:20:50.559659 dv-cinder-862432-2-smb devstack@keystone.service[81362]: warnings.warn(msg) Oct 25 13:20:50.559659 dv-cinder-862432-2-smb devstack@keystone.service[81362]: Oct 25 13:20:50.560896 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252011a-db40-4e09-ab24-72fcdba3b6e2 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:20:50.618567 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c252011a-db40-4e09-ab24-72fcdba3b6e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '476b7d65d083413e91e7a20c915a0c71', 'request_id': 'req-c252011a-db40-4e09-ab24-72fcdba3b6e2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:20:50.628090 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c252011a-db40-4e09-ab24-72fcdba3b6e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '476b7d65d083413e91e7a20c915a0c71', 'request_id': 'req-c252011a-db40-4e09-ab24-72fcdba3b6e2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:20:50.634103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c252011a-db40-4e09-ab24-72fcdba3b6e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '476b7d65d083413e91e7a20c915a0c71', 'request_id': 'req-c252011a-db40-4e09-ab24-72fcdba3b6e2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:20:50.663208 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c252011a-db40-4e09-ab24-72fcdba3b6e2 admin admin] The token cache is being invalidate because project 476b7d65d083413e91e7a20c915a0c71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:20:50.663496 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c252011a-db40-4e09-ab24-72fcdba3b6e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:20:50.664048 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c252011a-db40-4e09-ab24-72fcdba3b6e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:20:50.665341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 603/1187] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:20:50 2022] DELETE /identity/v3/projects/476b7d65d083413e91e7a20c915a0c71 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:21:00.051852 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=62 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:21:00.661273 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:22:22.593138 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e47ca-79a0-4577-b287-532b2f9d160e None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:22:22.593741 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e47ca-79a0-4577-b287-532b2f9d160e None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:22:22.593741 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e47ca-79a0-4577-b287-532b2f9d160e None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:22:22.595024 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 585/1188] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 25 13:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:22:22.600982 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4ef65-e703-437e-8eac-a95f60c1760a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:22:22.601430 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4ef65-e703-437e-8eac-a95f60c1760a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:22:22.601536 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4ef65-e703-437e-8eac-a95f60c1760a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:22:22.683070 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-53a4ef65-e703-437e-8eac-a95f60c1760a None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:22:22.684321 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-53a4ef65-e703-437e-8eac-a95f60c1760a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:22:22.787475 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 604/1189] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 25 13:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:22:22.943677 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e47ca-79a0-4577-b287-532b2f9d160e None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:22:22.945834 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-e39e47ca-79a0-4577-b287-532b2f9d160e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:22:23.063410 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e47ca-79a0-4577-b287-532b2f9d160e None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:22:23.069506 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00615095-d869-46d3-9325-29ea32783ff2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:22:23.070110 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00615095-d869-46d3-9325-29ea32783ff2 service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:22:23.070387 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00615095-d869-46d3-9325-29ea32783ff2 service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:22:23.070657 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00615095-d869-46d3-9325-29ea32783ff2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:22:23.078684 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00615095-d869-46d3-9325-29ea32783ff2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:22:23.080651 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00615095-d869-46d3-9325-29ea32783ff2 service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:22:23.089582 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 586/1190] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:22:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:22:24.159193 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243272f-84a3-45f6-8069-7737278fd8d6 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:22:24.159746 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243272f-84a3-45f6-8069-7737278fd8d6 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:22:24.159746 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243272f-84a3-45f6-8069-7737278fd8d6 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:22:24.161015 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 605/1191] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 25 13:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:22:24.165741 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd00196-b7e9-48c5-ac51-65b4858c0f5d None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:22:24.166181 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd00196-b7e9-48c5-ac51-65b4858c0f5d None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:22:24.166342 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd00196-b7e9-48c5-ac51-65b4858c0f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:22:24.186558 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-4fd00196-b7e9-48c5-ac51-65b4858c0f5d None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:22:24.187741 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-4fd00196-b7e9-48c5-ac51-65b4858c0f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:22:24.195807 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 587/1192] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 25 13:22:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:22:24.346748 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccea82-f84f-44b5-bae1-88cc6d40397a None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:22:24.347032 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccea82-f84f-44b5-bae1-88cc6d40397a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:22:24.347305 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccea82-f84f-44b5-bae1-88cc6d40397a None None] PATH_INFO: `/v3` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:22:24.348720 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 606/1193] 10.222.0.44 () {54 vars in 925 bytes} [Tue Oct 25 13:22:24 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:22:24.352299 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd00196-b7e9-48c5-ac51-65b4858c0f5d None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:22:24.354470 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc2d0f-40b1-4b9f-a32c-81bfc333b776 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:22:24.354756 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc2d0f-40b1-4b9f-a32c-81bfc333b776 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:22:24.355037 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc2d0f-40b1-4b9f-a32c-81bfc333b776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:22:24.365971 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd00196-b7e9-48c5-ac51-65b4858c0f5d None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:22:24.371818 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464beb1-17c2-42b9-a5ea-adbc450364c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:22:24.372465 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464beb1-17c2-42b9-a5ea-adbc450364c8 service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:22:24.372740 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464beb1-17c2-42b9-a5ea-adbc450364c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:22:24.373010 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464beb1-17c2-42b9-a5ea-adbc450364c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:22:24.382034 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f464beb1-17c2-42b9-a5ea-adbc450364c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:22:24.384083 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f464beb1-17c2-42b9-a5ea-adbc450364c8 service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:22:24.394149 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 588/1194] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:22:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:22:24.416668 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a9dc2d0f-40b1-4b9f-a32c-81bfc333b776 None None] MFA Rules not processed for user `f10c161ef74c4a0d809346a5c4b53aa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:22:24.417871 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a9dc2d0f-40b1-4b9f-a32c-81bfc333b776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:22:24.453756 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:22:24.500094 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 607/1195] 10.222.0.44 () {58 vars in 1015 bytes} [Tue Oct 25 13:22:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:22:33.324842 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c628b-09ee-4055-a758-de27b3fef26c None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:22:33.325330 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c628b-09ee-4055-a758-de27b3fef26c None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:22:33.325438 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c628b-09ee-4055-a758-de27b3fef26c None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:22:33.326772 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 589/1196] 10.222.0.25 () {54 vars in 961 bytes} [Tue Oct 25 13:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:22:33.332730 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ddceaa-bdfb-40a7-8638-129f18c7044d None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:22:33.333203 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ddceaa-bdfb-40a7-8638-129f18c7044d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:22:33.333307 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ddceaa-bdfb-40a7-8638-129f18c7044d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:22:33.353372 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d7ddceaa-bdfb-40a7-8638-129f18c7044d None None] MFA Rules not processed for user `f10c161ef74c4a0d809346a5c4b53aa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:22:33.354581 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d7ddceaa-bdfb-40a7-8638-129f18c7044d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:22:33.363503 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 608/1197] 10.222.0.25 () {58 vars in 1058 bytes} [Tue Oct 25 13:22:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:22:33.370943 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c628b-09ee-4055-a758-de27b3fef26c None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:22:33.384121 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c628b-09ee-4055-a758-de27b3fef26c None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:22:33.388984 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179bf687-96fb-4ccd-946f-4d2502e96125 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f10c161ef74c4a0d809346a5c4b53aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:22:33.389572 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179bf687-96fb-4ccd-946f-4d2502e96125 service placement] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:22:33.389848 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179bf687-96fb-4ccd-946f-4d2502e96125 service placement] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:22:33.390119 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179bf687-96fb-4ccd-946f-4d2502e96125 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:22:33.398755 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179bf687-96fb-4ccd-946f-4d2502e96125 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:22:33.400429 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179bf687-96fb-4ccd-946f-4d2502e96125 service placement] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:22:33.410540 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 590/1198] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:22:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:22:35.859770 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10d1ea-c45a-456d-b420-83505255c173 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:22:35.860369 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10d1ea-c45a-456d-b420-83505255c173 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:22:35.860369 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10d1ea-c45a-456d-b420-83505255c173 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:22:35.861788 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 609/1199] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 25 13:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:22:35.866523 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e937e99-9b0c-47d2-ad49-ea39883121f9 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:22:35.866935 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e937e99-9b0c-47d2-ad49-ea39883121f9 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:22:35.867148 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e937e99-9b0c-47d2-ad49-ea39883121f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:22:35.887115 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-6e937e99-9b0c-47d2-ad49-ea39883121f9 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:22:35.888328 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-6e937e99-9b0c-47d2-ad49-ea39883121f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:22:35.897021 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 591/1200] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 25 13:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:22:36.049909 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f10d1ea-c45a-456d-b420-83505255c173 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:22:36.064789 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f10d1ea-c45a-456d-b420-83505255c173 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:22:36.070266 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702ca54-a890-41c1-abd6-6f4b470f21dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:22:36.070871 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702ca54-a890-41c1-abd6-6f4b470f21dd service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:22:36.071152 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702ca54-a890-41c1-abd6-6f4b470f21dd service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:22:36.071427 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702ca54-a890-41c1-abd6-6f4b470f21dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:22:36.079304 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702ca54-a890-41c1-abd6-6f4b470f21dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:22:36.081488 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702ca54-a890-41c1-abd6-6f4b470f21dd service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:22:36.090711 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 610/1201] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:22:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:22:37.160861 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77de28-36d2-4b31-94ec-942f7ee15fed None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:22:37.161455 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77de28-36d2-4b31-94ec-942f7ee15fed None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:22:37.161455 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77de28-36d2-4b31-94ec-942f7ee15fed None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:22:37.162784 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 592/1202] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 25 13:22:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:22:37.167464 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcf3c0-74a9-44f6-b132-8375358d14ec None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:22:37.168164 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcf3c0-74a9-44f6-b132-8375358d14ec None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:22:37.168280 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcf3c0-74a9-44f6-b132-8375358d14ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:22:37.187817 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-87bcf3c0-74a9-44f6-b132-8375358d14ec None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:22:37.189028 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-87bcf3c0-74a9-44f6-b132-8375358d14ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:22:37.197102 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 611/1203] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 25 13:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:22:37.351933 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77de28-36d2-4b31-94ec-942f7ee15fed None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:22:37.366515 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77de28-36d2-4b31-94ec-942f7ee15fed None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:22:37.372031 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebd603f-e889-4bb6-8172-a7c5629ec00a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:22:37.372647 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd603f-e889-4bb6-8172-a7c5629ec00a service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:22:37.372924 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd603f-e889-4bb6-8172-a7c5629ec00a service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:22:37.373195 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd603f-e889-4bb6-8172-a7c5629ec00a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:22:37.381545 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebd603f-e889-4bb6-8172-a7c5629ec00a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:22:37.383099 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebd603f-e889-4bb6-8172-a7c5629ec00a service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:22:37.392301 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 593/1204] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:22:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:22:41.305100 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d968d-e708-4989-820a-40d6a98d022a None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:22:41.305649 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d968d-e708-4989-820a-40d6a98d022a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:22:41.305649 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d968d-e708-4989-820a-40d6a98d022a None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:22:41.306936 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 612/1205] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 25 13:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:22:41.312220 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387eb8d-2400-480c-a421-9d427a0a279e None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:22:41.312616 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387eb8d-2400-480c-a421-9d427a0a279e None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:22:41.312767 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387eb8d-2400-480c-a421-9d427a0a279e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:22:41.333279 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-a387eb8d-2400-480c-a421-9d427a0a279e None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:22:41.334469 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a387eb8d-2400-480c-a421-9d427a0a279e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:22:41.342539 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 594/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 25 13:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:22:41.635415 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d968d-e708-4989-820a-40d6a98d022a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:22:41.637165 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-564d968d-e708-4989-820a-40d6a98d022a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:22:41.715985 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d968d-e708-4989-820a-40d6a98d022a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:22:41.719556 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87828f5e-b42a-411b-9f32-6d8b3757260a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:22:41.720353 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87828f5e-b42a-411b-9f32-6d8b3757260a service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:22:41.721687 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87828f5e-b42a-411b-9f32-6d8b3757260a service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:22:41.721687 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87828f5e-b42a-411b-9f32-6d8b3757260a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:22:41.730809 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87828f5e-b42a-411b-9f32-6d8b3757260a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:22:41.732462 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87828f5e-b42a-411b-9f32-6d8b3757260a service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:22:41.741976 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 613/1207] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:22:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:22:43.892331 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36286fec-c06a-4f0d-83f0-d002d0a2d147 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:22:43.892821 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36286fec-c06a-4f0d-83f0-d002d0a2d147 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:22:43.892917 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36286fec-c06a-4f0d-83f0-d002d0a2d147 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:22:43.894322 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 595/1208] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 25 13:22:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:22:43.899549 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd8240-5dbe-45dc-9799-9807ca608601 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:22:43.899981 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd8240-5dbe-45dc-9799-9807ca608601 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:22:43.900240 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd8240-5dbe-45dc-9799-9807ca608601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:22:43.920537 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-73fd8240-5dbe-45dc-9799-9807ca608601 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:22:43.921714 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-73fd8240-5dbe-45dc-9799-9807ca608601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:22:43.931700 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 614/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 25 13:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:22:44.235118 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36286fec-c06a-4f0d-83f0-d002d0a2d147 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:22:44.246745 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36286fec-c06a-4f0d-83f0-d002d0a2d147 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:22:44.250346 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe584f-3f53-4f42-8026-6a8037b56cbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:22:44.250932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe584f-3f53-4f42-8026-6a8037b56cbe service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:22:44.251436 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe584f-3f53-4f42-8026-6a8037b56cbe service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:22:44.251436 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe584f-3f53-4f42-8026-6a8037b56cbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:22:44.260403 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfe584f-3f53-4f42-8026-6a8037b56cbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:22:44.261847 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfe584f-3f53-4f42-8026-6a8037b56cbe service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:22:44.271282 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 596/1210] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:22:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:22:47.996607 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83760e0d-2a94-4810-adac-0b45c8b32e25 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:22:47.997132 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83760e0d-2a94-4810-adac-0b45c8b32e25 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:22:47.997132 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83760e0d-2a94-4810-adac-0b45c8b32e25 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:22:47.998398 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 615/1211] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 25 13:22:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:22:48.007684 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb675bd-dd84-4756-8682-7013a3f558c5 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:22:48.008130 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb675bd-dd84-4756-8682-7013a3f558c5 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:22:48.008301 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb675bd-dd84-4756-8682-7013a3f558c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:22:48.029773 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-1fb675bd-dd84-4756-8682-7013a3f558c5 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:22:48.030983 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-1fb675bd-dd84-4756-8682-7013a3f558c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:22:48.039449 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 597/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 25 13:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:22:48.344136 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83760e0d-2a94-4810-adac-0b45c8b32e25 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:22:48.346968 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-83760e0d-2a94-4810-adac-0b45c8b32e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:22:48.426036 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83760e0d-2a94-4810-adac-0b45c8b32e25 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:22:48.429613 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10723bc8-22ce-4ac3-a8ff-eeef7177ef15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:22:48.430210 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10723bc8-22ce-4ac3-a8ff-eeef7177ef15 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:22:48.430489 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10723bc8-22ce-4ac3-a8ff-eeef7177ef15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:22:48.430762 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10723bc8-22ce-4ac3-a8ff-eeef7177ef15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:22:48.437495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:22:48.439984 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10723bc8-22ce-4ac3-a8ff-eeef7177ef15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:22:48.441876 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10723bc8-22ce-4ac3-a8ff-eeef7177ef15 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:22:48.451316 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 616/1213] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:22:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:22:50.603668 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d245f-9e08-4966-91a3-aa1d363ee8cd None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:22:50.604268 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d245f-9e08-4966-91a3-aa1d363ee8cd None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:22:50.604268 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d245f-9e08-4966-91a3-aa1d363ee8cd None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:22:50.605593 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 598/1214] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 25 13:22:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:22:50.610803 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5b540-b5c4-4c0f-9f5b-37825d72d257 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:22:50.611284 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5b540-b5c4-4c0f-9f5b-37825d72d257 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:22:50.611388 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5b540-b5c4-4c0f-9f5b-37825d72d257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:22:50.630752 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-95b5b540-b5c4-4c0f-9f5b-37825d72d257 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:22:50.631963 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-95b5b540-b5c4-4c0f-9f5b-37825d72d257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:22:50.639664 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 617/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 25 13:22:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:22:50.940404 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d245f-9e08-4966-91a3-aa1d363ee8cd None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:22:50.942077 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c81d245f-9e08-4966-91a3-aa1d363ee8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:22:50.949708 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=90 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:22:50.956412 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d245f-9e08-4966-91a3-aa1d363ee8cd None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:22:50.959879 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc9f29-4998-4c9c-9b82-7ca4a29d2b93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:22:50.960487 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc9f29-4998-4c9c-9b82-7ca4a29d2b93 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:22:50.960763 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc9f29-4998-4c9c-9b82-7ca4a29d2b93 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:22:50.961031 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc9f29-4998-4c9c-9b82-7ca4a29d2b93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:22:50.970114 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc9f29-4998-4c9c-9b82-7ca4a29d2b93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:22:50.971636 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc9f29-4998-4c9c-9b82-7ca4a29d2b93 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:22:50.980730 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 599/1216] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:22:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:23:00.625821 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:23:00.976728 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=5 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:24.831184 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85548267-8a18-4b01-a0d4-2af9d66728d2 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:24.832456 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85548267-8a18-4b01-a0d4-2af9d66728d2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:24.832968 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85548267-8a18-4b01-a0d4-2af9d66728d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:24.865121 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-85548267-8a18-4b01-a0d4-2af9d66728d2 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:24.866806 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-85548267-8a18-4b01-a0d4-2af9d66728d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:24.880418 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 618/1217] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:24.892919 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95478956-4ddb-4a61-b549-249dd2ce2f23 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:24.894118 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95478956-4ddb-4a61-b549-249dd2ce2f23 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:24.894659 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95478956-4ddb-4a61-b549-249dd2ce2f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:24.912463 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbc12d-041b-423e-9af3-2fe83b6b660f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:24.913107 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbc12d-041b-423e-9af3-2fe83b6b660f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:24.913605 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbc12d-041b-423e-9af3-2fe83b6b660f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:24.930643 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-95478956-4ddb-4a61-b549-249dd2ce2f23 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:24.931862 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-95478956-4ddb-4a61-b549-249dd2ce2f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:24.942623 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-08fbc12d-041b-423e-9af3-2fe83b6b660f None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:24.944160 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-08fbc12d-041b-423e-9af3-2fe83b6b660f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:24.949626 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 600/1218] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:24.957589 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 619/1219] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:24:24.961564 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95478956-4ddb-4a61-b549-249dd2ce2f23 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:24.971345 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95478956-4ddb-4a61-b549-249dd2ce2f23 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:24.979412 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d28337-516e-4082-8dd5-2e6bd7e03963 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:24.980035 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d28337-516e-4082-8dd5-2e6bd7e03963 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:24.980527 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d28337-516e-4082-8dd5-2e6bd7e03963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:24.984601 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9cf75-8096-4b5f-926d-83a17b4bac1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:24.985228 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9cf75-8096-4b5f-926d-83a17b4bac1e admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:24.985507 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9cf75-8096-4b5f-926d-83a17b4bac1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:24.986317 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9cf75-8096-4b5f-926d-83a17b4bac1e admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:24.986946 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9cf75-8096-4b5f-926d-83a17b4bac1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:24:24.987248 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9cf75-8096-4b5f-926d-83a17b4bac1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:24.988288 dv-cinder-862432-2-smb devstack@keystone.service[81363]: WARNING py.warnings [None req-96c9cf75-8096-4b5f-926d-83a17b4bac1e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 25 13:24:24.988288 dv-cinder-862432-2-smb devstack@keystone.service[81363]: warnings.warn(msg) Oct 25 13:24:24.988288 dv-cinder-862432-2-smb devstack@keystone.service[81363]: Oct 25 13:24:24.989187 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9cf75-8096-4b5f-926d-83a17b4bac1e admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:25.007189 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 601/1220] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:24:25.012999 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-78d28337-516e-4082-8dd5-2e6bd7e03963 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:25.014436 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-78d28337-516e-4082-8dd5-2e6bd7e03963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:25.027096 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9cf75-8096-4b5f-926d-83a17b4bac1e admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:25.031182 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 620/1221] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:24:25.041384 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d28337-516e-4082-8dd5-2e6bd7e03963 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:25.044033 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9cf75-8096-4b5f-926d-83a17b4bac1e admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:25.058275 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d28337-516e-4082-8dd5-2e6bd7e03963 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:25.060715 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d93d88-1cc1-4aa1-b422-6e60de53ebb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:25.061353 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d93d88-1cc1-4aa1-b422-6e60de53ebb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:25.061849 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d93d88-1cc1-4aa1-b422-6e60de53ebb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:25.062131 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d93d88-1cc1-4aa1-b422-6e60de53ebb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:25.062783 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d93d88-1cc1-4aa1-b422-6e60de53ebb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:25.064986 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d93d88-1cc1-4aa1-b422-6e60de53ebb8 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:25.068194 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1697d-2a71-4836-878a-63f62da064d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:25.068825 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1697d-2a71-4836-878a-63f62da064d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:25.069105 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1697d-2a71-4836-878a-63f62da064d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:25.069379 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1697d-2a71-4836-878a-63f62da064d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:25.070261 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a1697d-2a71-4836-878a-63f62da064d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:24:25.070568 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a1697d-2a71-4836-878a-63f62da064d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:25.076239 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a1697d-2a71-4836-878a-63f62da064d2 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:25.098484 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 621/1222] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:24:25.108356 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1697d-2a71-4836-878a-63f62da064d2 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:25.133109 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 602/1223] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:24:25 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:24:25.133335 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1697d-2a71-4836-878a-63f62da064d2 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:25.137730 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d93d88-1cc1-4aa1-b422-6e60de53ebb8 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:25.254047 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d93d88-1cc1-4aa1-b422-6e60de53ebb8 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:25.254592 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886eb119-4f00-4676-9e99-7ebba65f721d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:25.255216 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886eb119-4f00-4676-9e99-7ebba65f721d admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:25.255504 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886eb119-4f00-4676-9e99-7ebba65f721d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:25.255789 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886eb119-4f00-4676-9e99-7ebba65f721d admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:25.256464 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886eb119-4f00-4676-9e99-7ebba65f721d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:25.257892 dv-cinder-862432-2-smb devstack@keystone.service[81362]: WARNING py.warnings [None req-886eb119-4f00-4676-9e99-7ebba65f721d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 13:24:25.257892 dv-cinder-862432-2-smb devstack@keystone.service[81362]: warnings.warn(msg) Oct 25 13:24:25.257892 dv-cinder-862432-2-smb devstack@keystone.service[81362]: Oct 25 13:24:25.258863 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759adb8f-433d-4899-b3e6-2757f3368c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:25.259107 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886eb119-4f00-4676-9e99-7ebba65f721d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:25.259636 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759adb8f-433d-4899-b3e6-2757f3368c2b admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:25.260067 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759adb8f-433d-4899-b3e6-2757f3368c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:25.260239 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759adb8f-433d-4899-b3e6-2757f3368c2b admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:25.260843 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759adb8f-433d-4899-b3e6-2757f3368c2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:25.261971 dv-cinder-862432-2-smb devstack@keystone.service[81363]: WARNING py.warnings [None req-759adb8f-433d-4899-b3e6-2757f3368c2b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 13:24:25.261971 dv-cinder-862432-2-smb devstack@keystone.service[81363]: warnings.warn(msg) Oct 25 13:24:25.261971 dv-cinder-862432-2-smb devstack@keystone.service[81363]: Oct 25 13:24:25.263108 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759adb8f-433d-4899-b3e6-2757f3368c2b admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:25.288670 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 603/1224] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:24:25 2022] POST /identity/v3/users => generated 294 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:24:25.292813 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bc4fc-f50f-426c-af25-23f213c24f20 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:25.292813 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bc4fc-f50f-426c-af25-23f213c24f20 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:25.292813 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bc4fc-f50f-426c-af25-23f213c24f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:25.293112 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 622/1225] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:24:25 2022] POST /identity/v3/projects => generated 405 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:24:25.293812 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ab073-084d-4d00-ac81-5f94a332117c None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:25.294102 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ab073-084d-4d00-ac81-5f94a332117c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:25.294523 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ab073-084d-4d00-ac81-5f94a332117c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:25.313038 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-542bc4fc-f50f-426c-af25-23f213c24f20 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:25.314344 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-542bc4fc-f50f-426c-af25-23f213c24f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:25.316390 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-653ab073-084d-4d00-ac81-5f94a332117c None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:25.317561 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-653ab073-084d-4d00-ac81-5f94a332117c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:25.373664 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 604/1226] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:25.375276 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8d225-cd46-40e8-8b8e-2b32d470097d None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:25.375521 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8d225-cd46-40e8-8b8e-2b32d470097d None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:25.375804 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8d225-cd46-40e8-8b8e-2b32d470097d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:25.379125 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 623/1227] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:25.380323 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb322f-85e3-463f-a1bd-e5ca9dd7ef4e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:25.380661 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb322f-85e3-463f-a1bd-e5ca9dd7ef4e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:25.381282 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb322f-85e3-463f-a1bd-e5ca9dd7ef4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:25.403723 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e7cb322f-85e3-463f-a1bd-e5ca9dd7ef4e None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:25.404962 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e7cb322f-85e3-463f-a1bd-e5ca9dd7ef4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:25.407477 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-abb8d225-cd46-40e8-8b8e-2b32d470097d None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:25.409796 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-abb8d225-cd46-40e8-8b8e-2b32d470097d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:25.414057 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 624/1228] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:25.415250 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578270e-215a-480e-b986-707040667d3c None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:25.415536 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578270e-215a-480e-b986-707040667d3c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:25.415813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578270e-215a-480e-b986-707040667d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:25.425680 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 605/1229] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:25.425680 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a96bd-8246-4fc2-9654-7cff88335f1f None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:25.425680 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a96bd-8246-4fc2-9654-7cff88335f1f None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:25.425680 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a96bd-8246-4fc2-9654-7cff88335f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:25.436932 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-2578270e-215a-480e-b986-707040667d3c None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:25.438134 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2578270e-215a-480e-b986-707040667d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:25.447436 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 625/1230] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:25.447706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-7c1a96bd-8246-4fc2-9654-7cff88335f1f None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:25.448762 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578270e-215a-480e-b986-707040667d3c None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:25.449063 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-7c1a96bd-8246-4fc2-9654-7cff88335f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:25.458248 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 606/1231] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:25.466893 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a96bd-8246-4fc2-9654-7cff88335f1f None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:25.467005 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578270e-215a-480e-b986-707040667d3c None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:25.467005 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e2363-5307-472d-8b05-c3349c48645b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:25.467005 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e2363-5307-472d-8b05-c3349c48645b admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:25.467005 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e2363-5307-472d-8b05-c3349c48645b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:25.467393 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e2363-5307-472d-8b05-c3349c48645b admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:25.467393 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e2363-5307-472d-8b05-c3349c48645b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:25.468282 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e2363-5307-472d-8b05-c3349c48645b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:25.468693 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a96bd-8246-4fc2-9654-7cff88335f1f None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:25.474173 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf2b6df-8575-4edb-986d-58dbf2cf5300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:25.474776 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2b6df-8575-4edb-986d-58dbf2cf5300 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:25.475052 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2b6df-8575-4edb-986d-58dbf2cf5300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:25.475322 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2b6df-8575-4edb-986d-58dbf2cf5300 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:25.475981 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf2b6df-8575-4edb-986d-58dbf2cf5300 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:25.477881 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf2b6df-8575-4edb-986d-58dbf2cf5300 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:25.482410 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 626/1232] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:24:25.482410 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e14f81-4a9b-4e6e-ad5b-ea6e221875e5 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:25.482410 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e14f81-4a9b-4e6e-ad5b-ea6e221875e5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:25.482410 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e14f81-4a9b-4e6e-ad5b-ea6e221875e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:25.501080 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 607/1233] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:24:25 2022] POST /identity/v3/users => generated 303 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:24:25.502359 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d6e14f81-4a9b-4e6e-ad5b-ea6e221875e5 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:25.502852 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb577bc0-f93f-4352-84fc-1f47c49ecc21 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:25.503140 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb577bc0-f93f-4352-84fc-1f47c49ecc21 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:25.503416 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb577bc0-f93f-4352-84fc-1f47c49ecc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:25.503588 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d6e14f81-4a9b-4e6e-ad5b-ea6e221875e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:25.511985 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 627/1234] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:25.512976 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476df39d-c64a-4b22-8e77-238d595863d5 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:25.513109 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476df39d-c64a-4b22-8e77-238d595863d5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:25.513330 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476df39d-c64a-4b22-8e77-238d595863d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:25.523347 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-cb577bc0-f93f-4352-84fc-1f47c49ecc21 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:25.524569 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-cb577bc0-f93f-4352-84fc-1f47c49ecc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:25.533216 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 608/1235] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:25.533358 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-476df39d-c64a-4b22-8e77-238d595863d5 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:25.534444 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b517f13-3e54-4f7d-9a27-bc0ae2eed635 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:25.534731 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b517f13-3e54-4f7d-9a27-bc0ae2eed635 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:25.534842 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-476df39d-c64a-4b22-8e77-238d595863d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:25.535039 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b517f13-3e54-4f7d-9a27-bc0ae2eed635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:25.542696 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 628/1236] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:25.542964 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:25.543924 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f20d8-13a5-459a-a3b2-db32cc1d0aa5 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:25.544178 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f20d8-13a5-459a-a3b2-db32cc1d0aa5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:25.544445 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f20d8-13a5-459a-a3b2-db32cc1d0aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:25.560152 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-3b517f13-3e54-4f7d-9a27-bc0ae2eed635 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:25.561656 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-3b517f13-3e54-4f7d-9a27-bc0ae2eed635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:25.565413 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-ae1f20d8-13a5-459a-a3b2-db32cc1d0aa5 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:25.566563 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ae1f20d8-13a5-459a-a3b2-db32cc1d0aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:25.570452 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 609/1237] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:25.574069 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2e05a-5ac4-4ae0-9837-b116eabe1125 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:25.574069 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2e05a-5ac4-4ae0-9837-b116eabe1125 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:25.574069 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2e05a-5ac4-4ae0-9837-b116eabe1125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:25.574694 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 629/1238] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:25.575457 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f20d8-13a5-459a-a3b2-db32cc1d0aa5 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:25.587183 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f20d8-13a5-459a-a3b2-db32cc1d0aa5 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:25.594482 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505715c-60a7-4b3c-8264-243265a26db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:25.595187 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505715c-60a7-4b3c-8264-243265a26db5 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:25.595449 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505715c-60a7-4b3c-8264-243265a26db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:25.595719 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505715c-60a7-4b3c-8264-243265a26db5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:25.596381 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-79e2e05a-5ac4-4ae0-9837-b116eabe1125 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:25.596520 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505715c-60a7-4b3c-8264-243265a26db5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:25.597683 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-79e2e05a-5ac4-4ae0-9837-b116eabe1125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:25.597960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505715c-60a7-4b3c-8264-243265a26db5 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:25.600962 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:25.607360 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 610/1239] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:25.608675 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2e05a-5ac4-4ae0-9837-b116eabe1125 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:25.616657 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 630/1240] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:24:25.617811 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505715c-60a7-4b3c-8264-243265a26db5 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:25.619821 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2e05a-5ac4-4ae0-9837-b116eabe1125 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:25.623957 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59a351-df01-4649-8f4e-3dea9cf6b777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:25.624561 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59a351-df01-4649-8f4e-3dea9cf6b777 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:25.625337 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59a351-df01-4649-8f4e-3dea9cf6b777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:25.625667 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59a351-df01-4649-8f4e-3dea9cf6b777 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:25.626443 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59a351-df01-4649-8f4e-3dea9cf6b777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:25.628287 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59a351-df01-4649-8f4e-3dea9cf6b777 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:25.629226 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505715c-60a7-4b3c-8264-243265a26db5 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:25.636353 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ceeca-ac21-4564-9363-d3878d7a0882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:25.636983 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ceeca-ac21-4564-9363-d3878d7a0882 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:25.637262 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ceeca-ac21-4564-9363-d3878d7a0882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:25.637532 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ceeca-ac21-4564-9363-d3878d7a0882 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:25.638168 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ceeca-ac21-4564-9363-d3878d7a0882 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:24:25.638467 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ceeca-ac21-4564-9363-d3878d7a0882 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:25.639000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 611/1241] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:24:25.639000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59a351-df01-4649-8f4e-3dea9cf6b777 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:25.643118 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ceeca-ac21-4564-9363-d3878d7a0882 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:25.651206 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59a351-df01-4649-8f4e-3dea9cf6b777 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:25.659180 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 631/1242] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:24:25.659180 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ceeca-ac21-4564-9363-d3878d7a0882 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:25.659443 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86f2e7-1555-4275-a354-efb45b4272e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:25.659443 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86f2e7-1555-4275-a354-efb45b4272e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:25.659443 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86f2e7-1555-4275-a354-efb45b4272e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:25.659443 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86f2e7-1555-4275-a354-efb45b4272e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:25.659770 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86f2e7-1555-4275-a354-efb45b4272e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:24:25.659770 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86f2e7-1555-4275-a354-efb45b4272e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:25.659770 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86f2e7-1555-4275-a354-efb45b4272e6 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:25.665310 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ceeca-ac21-4564-9363-d3878d7a0882 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:25.671063 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb7734-7beb-4616-a74b-82e5f91ac800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:25.671663 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb7734-7beb-4616-a74b-82e5f91ac800 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:25.671965 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb7734-7beb-4616-a74b-82e5f91ac800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:25.679266 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb7734-7beb-4616-a74b-82e5f91ac800 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:25.679466 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 612/1243] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:24:25.679595 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb7734-7beb-4616-a74b-82e5f91ac800 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:24:25.679595 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb7734-7beb-4616-a74b-82e5f91ac800 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:25.679769 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86f2e7-1555-4275-a354-efb45b4272e6 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:25.679846 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb7734-7beb-4616-a74b-82e5f91ac800 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:25.690425 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86f2e7-1555-4275-a354-efb45b4272e6 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:25.692698 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 632/1244] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:24:25.694241 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb7734-7beb-4616-a74b-82e5f91ac800 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:25.696279 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c4b64-3a94-4563-88f1-93c3cafc5704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:25.696979 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c4b64-3a94-4563-88f1-93c3cafc5704 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:25.697328 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c4b64-3a94-4563-88f1-93c3cafc5704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:25.697681 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c4b64-3a94-4563-88f1-93c3cafc5704 admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:25.698390 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c4b64-3a94-4563-88f1-93c3cafc5704 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:24:25.698755 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c4b64-3a94-4563-88f1-93c3cafc5704 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:25.700942 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c4b64-3a94-4563-88f1-93c3cafc5704 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:25.705648 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb7734-7beb-4616-a74b-82e5f91ac800 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:25.710455 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708d7d3-ec4b-4ec2-be14-65c56f1cf723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:25.711109 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708d7d3-ec4b-4ec2-be14-65c56f1cf723 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:25.711392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708d7d3-ec4b-4ec2-be14-65c56f1cf723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:25.712014 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708d7d3-ec4b-4ec2-be14-65c56f1cf723 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:25.712350 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f708d7d3-ec4b-4ec2-be14-65c56f1cf723 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:24:25.712649 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f708d7d3-ec4b-4ec2-be14-65c56f1cf723 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:25.714220 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f708d7d3-ec4b-4ec2-be14-65c56f1cf723 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:25.718698 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 613/1245] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:24:25.718698 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c4b64-3a94-4563-88f1-93c3cafc5704 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:25.729995 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c4b64-3a94-4563-88f1-93c3cafc5704 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:25.735031 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46035528-289d-4b6d-b909-ff71ad9fb995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:25.735637 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46035528-289d-4b6d-b909-ff71ad9fb995 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:25.736238 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46035528-289d-4b6d-b909-ff71ad9fb995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:25.744028 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 633/1246] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:24:25.744159 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46035528-289d-4b6d-b909-ff71ad9fb995 admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:25.744159 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46035528-289d-4b6d-b909-ff71ad9fb995 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:24:25.744336 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708d7d3-ec4b-4ec2-be14-65c56f1cf723 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:25.744433 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46035528-289d-4b6d-b909-ff71ad9fb995 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:25.744433 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46035528-289d-4b6d-b909-ff71ad9fb995 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:25.748771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708d7d3-ec4b-4ec2-be14-65c56f1cf723 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:25.752595 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 614/1247] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:24:25.753527 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46035528-289d-4b6d-b909-ff71ad9fb995 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:25.760595 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce78aa8-9213-4243-890e-9f7c4ae13d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:25.761373 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce78aa8-9213-4243-890e-9f7c4ae13d8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:25.761552 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce78aa8-9213-4243-890e-9f7c4ae13d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:25.761828 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce78aa8-9213-4243-890e-9f7c4ae13d8a admin admin] PATH_INFO: `/v3/projects/048c11136b544569a6193370a22460a2/users/b59b96a78db44099838e00f6614052bf/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:25.764362 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46035528-289d-4b6d-b909-ff71ad9fb995 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:25.770858 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e47d4-391a-4a21-a798-81ecc9eb683f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:25.771701 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e47d4-391a-4a21-a798-81ecc9eb683f admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:25.772023 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e47d4-391a-4a21-a798-81ecc9eb683f admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:25.772351 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e47d4-391a-4a21-a798-81ecc9eb683f admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:25.773003 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e47d4-391a-4a21-a798-81ecc9eb683f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:25.774668 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e47d4-391a-4a21-a798-81ecc9eb683f admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:25.778782 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce78aa8-9213-4243-890e-9f7c4ae13d8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=048c11136b544569a6193370a22460a2, user_id=b59b96a78db44099838e00f6614052bf, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:25.781422 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce78aa8-9213-4243-890e-9f7c4ae13d8a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:25.785355 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 615/1248] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:24:25.786126 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e47d4-391a-4a21-a798-81ecc9eb683f admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:25.797860 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e47d4-391a-4a21-a798-81ecc9eb683f admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:25.801531 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 634/1249] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:24:25 2022] PUT /identity/v3/projects/048c11136b544569a6193370a22460a2/users/b59b96a78db44099838e00f6614052bf/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:24:25.802333 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce78aa8-9213-4243-890e-9f7c4ae13d8a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:25.860348 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b2de7-08ff-4ad9-8c50-bb9da1f48707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:25.861827 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b2de7-08ff-4ad9-8c50-bb9da1f48707 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:25.862226 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b2de7-08ff-4ad9-8c50-bb9da1f48707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:25.862497 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b2de7-08ff-4ad9-8c50-bb9da1f48707 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:25.863153 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b2de7-08ff-4ad9-8c50-bb9da1f48707 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:25.865070 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b2de7-08ff-4ad9-8c50-bb9da1f48707 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:25.866030 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce78aa8-9213-4243-890e-9f7c4ae13d8a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:25.870663 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d11e6-e821-4b8b-98d5-e09bc0984aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:25.871273 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d11e6-e821-4b8b-98d5-e09bc0984aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:25.871558 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d11e6-e821-4b8b-98d5-e09bc0984aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:25.871836 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d11e6-e821-4b8b-98d5-e09bc0984aa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:25.872493 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d11e6-e821-4b8b-98d5-e09bc0984aa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:25.874381 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d11e6-e821-4b8b-98d5-e09bc0984aa9 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:25.893867 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 616/1250] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:24:25 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:24:25.894681 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b2de7-08ff-4ad9-8c50-bb9da1f48707 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:25.904586 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 635/1251] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:24:25 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:24:25.908788 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d11e6-e821-4b8b-98d5-e09bc0984aa9 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:25.960773 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b2de7-08ff-4ad9-8c50-bb9da1f48707 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:25.971434 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d11e6-e821-4b8b-98d5-e09bc0984aa9 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:25.976350 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6ac67-137a-4e80-9a41-b2a0721c7c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:25.976966 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6ac67-137a-4e80-9a41-b2a0721c7c2c admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:25.977249 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6ac67-137a-4e80-9a41-b2a0721c7c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:25.977566 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6ac67-137a-4e80-9a41-b2a0721c7c2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:25.977694 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:25.978200 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6ac67-137a-4e80-9a41-b2a0721c7c2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:25.980289 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6ac67-137a-4e80-9a41-b2a0721c7c2c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:26.010907 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 636/1252] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:24:25 2022] POST /identity/v3/projects => generated 393 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:24:26.012368 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6ac67-137a-4e80-9a41-b2a0721c7c2c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:26.018579 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:26.021415 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc8226-c43b-4825-b104-daae2456cf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:26.022032 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc8226-c43b-4825-b104-daae2456cf9b admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:26.022314 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc8226-c43b-4825-b104-daae2456cf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:26.022601 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc8226-c43b-4825-b104-daae2456cf9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:26.023212 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc8226-c43b-4825-b104-daae2456cf9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:26.025142 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc8226-c43b-4825-b104-daae2456cf9b admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:26.052871 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 617/1253] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:24:25 2022] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:24:26.053912 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc8226-c43b-4825-b104-daae2456cf9b admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:26.080128 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6ac67-137a-4e80-9a41-b2a0721c7c2c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:26.116969 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc8226-c43b-4825-b104-daae2456cf9b admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:26.121791 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e8998-be41-4e16-b16b-1c2215be59c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:26.122383 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e8998-be41-4e16-b16b-1c2215be59c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:26.122661 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e8998-be41-4e16-b16b-1c2215be59c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:26.122958 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e8998-be41-4e16-b16b-1c2215be59c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:26.123603 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e8998-be41-4e16-b16b-1c2215be59c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:26.125543 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e8998-be41-4e16-b16b-1c2215be59c4 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:26.136274 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b80fce-4ed4-4260-9ad5-7f60bb1bf802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:26.137062 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b80fce-4ed4-4260-9ad5-7f60bb1bf802 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:26.137459 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b80fce-4ed4-4260-9ad5-7f60bb1bf802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:26.137840 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b80fce-4ed4-4260-9ad5-7f60bb1bf802 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:26.138540 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b80fce-4ed4-4260-9ad5-7f60bb1bf802 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:26.140562 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b80fce-4ed4-4260-9ad5-7f60bb1bf802 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:26.153557 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 618/1254] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:24:26 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:24:26.157563 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e8998-be41-4e16-b16b-1c2215be59c4 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:26.170996 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 637/1255] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:24:26 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:24:26.172271 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427cb89-9772-49d0-922e-905f127f7a6c None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:26.172627 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427cb89-9772-49d0-922e-905f127f7a6c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:26.172968 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427cb89-9772-49d0-922e-905f127f7a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:26.194022 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-2427cb89-9772-49d0-922e-905f127f7a6c None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:26.195236 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2427cb89-9772-49d0-922e-905f127f7a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:26.222143 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e8998-be41-4e16-b16b-1c2215be59c4 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:26.255361 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:26.258579 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 638/1256] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:26.258579 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427cb89-9772-49d0-922e-905f127f7a6c None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:26.265859 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427cb89-9772-49d0-922e-905f127f7a6c None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:26.270987 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3835f83-1c55-4f1b-8d16-784fe71d5f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:26.271535 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3835f83-1c55-4f1b-8d16-784fe71d5f53 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:26.271816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3835f83-1c55-4f1b-8d16-784fe71d5f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:26.272145 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3835f83-1c55-4f1b-8d16-784fe71d5f53 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:26.272775 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3835f83-1c55-4f1b-8d16-784fe71d5f53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:26.274679 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3835f83-1c55-4f1b-8d16-784fe71d5f53 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:26.281878 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a543e3a-3095-4ec1-8ebb-f7e781e13902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:26.282532 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a543e3a-3095-4ec1-8ebb-f7e781e13902 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:26.283353 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a543e3a-3095-4ec1-8ebb-f7e781e13902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:26.283620 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a543e3a-3095-4ec1-8ebb-f7e781e13902 admin admin] PATH_INFO: `/v3/projects/f88f8a0acc9e40b09a621e4312589f19/users/d3943406b2cc4eee9c5dbb5f03b59d36/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:26.296942 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 639/1257] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:24:26 2022] POST /identity/v3/users => generated 290 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:24:26.298013 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3835f83-1c55-4f1b-8d16-784fe71d5f53 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:26.299377 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a543e3a-3095-4ec1-8ebb-f7e781e13902 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f88f8a0acc9e40b09a621e4312589f19, user_id=d3943406b2cc4eee9c5dbb5f03b59d36, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:26.302205 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a543e3a-3095-4ec1-8ebb-f7e781e13902 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:26.310167 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3835f83-1c55-4f1b-8d16-784fe71d5f53 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:26.316295 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 619/1258] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:24:26 2022] PUT /identity/v3/projects/f88f8a0acc9e40b09a621e4312589f19/users/d3943406b2cc4eee9c5dbb5f03b59d36/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:24:26.317150 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a543e3a-3095-4ec1-8ebb-f7e781e13902 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:26.331645 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:26.372972 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc58e59-d97e-4576-9955-4172022c5966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:26.373605 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc58e59-d97e-4576-9955-4172022c5966 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:26.373886 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc58e59-d97e-4576-9955-4172022c5966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:26.374161 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc58e59-d97e-4576-9955-4172022c5966 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:26.374792 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc58e59-d97e-4576-9955-4172022c5966 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:26.377489 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc58e59-d97e-4576-9955-4172022c5966 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:26.381660 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a543e3a-3095-4ec1-8ebb-f7e781e13902 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:26.386330 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43044989-e232-4469-8fc9-4ca10fe1fdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:26.386944 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43044989-e232-4469-8fc9-4ca10fe1fdd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:26.387242 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43044989-e232-4469-8fc9-4ca10fe1fdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:26.387484 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43044989-e232-4469-8fc9-4ca10fe1fdd4 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:26.388163 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43044989-e232-4469-8fc9-4ca10fe1fdd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:26.390370 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43044989-e232-4469-8fc9-4ca10fe1fdd4 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:26.398795 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 640/1259] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:24:26 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:24:26.398795 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc58e59-d97e-4576-9955-4172022c5966 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:26.410609 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc58e59-d97e-4576-9955-4172022c5966 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:26.415508 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 620/1260] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:24:26 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:24:26.415508 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43044989-e232-4469-8fc9-4ca10fe1fdd4 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:26.415735 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d74b2-1758-4456-a6df-a57344adcef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:26.416261 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d74b2-1758-4456-a6df-a57344adcef9 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:26.416546 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d74b2-1758-4456-a6df-a57344adcef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:26.416824 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d74b2-1758-4456-a6df-a57344adcef9 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:26.417732 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d74b2-1758-4456-a6df-a57344adcef9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:26.419682 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d74b2-1758-4456-a6df-a57344adcef9 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:26.424002 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43044989-e232-4469-8fc9-4ca10fe1fdd4 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:26.429141 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9f177-ab2a-4851-ac04-e5e5ec511b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:26.429727 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9f177-ab2a-4851-ac04-e5e5ec511b39 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:26.430000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9f177-ab2a-4851-ac04-e5e5ec511b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:26.430266 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9f177-ab2a-4851-ac04-e5e5ec511b39 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:26.430881 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9f177-ab2a-4851-ac04-e5e5ec511b39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:26.433207 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9f177-ab2a-4851-ac04-e5e5ec511b39 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:26.444377 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 641/1261] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:24:26 2022] POST /identity/v3/users => generated 292 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:24:26.444377 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d74b2-1758-4456-a6df-a57344adcef9 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:26.456455 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d74b2-1758-4456-a6df-a57344adcef9 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:26.460939 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 621/1262] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:24:26 2022] POST /identity/v3/users => generated 288 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:24:26.461252 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d12221-55c3-4762-85c6-db79477cea25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:26.461652 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9f177-ab2a-4851-ac04-e5e5ec511b39 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:26.461856 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d12221-55c3-4762-85c6-db79477cea25 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:26.462135 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d12221-55c3-4762-85c6-db79477cea25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:26.462403 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d12221-55c3-4762-85c6-db79477cea25 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:26.463027 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d12221-55c3-4762-85c6-db79477cea25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:26.465224 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d12221-55c3-4762-85c6-db79477cea25 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:26.489153 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 642/1263] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:24:26 2022] POST /identity/v3/users => generated 293 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:24:26.490431 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d12221-55c3-4762-85c6-db79477cea25 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:26.500088 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d12221-55c3-4762-85c6-db79477cea25 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:26.504815 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc3cde-2f29-45c4-b431-8e456ebd4933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:26.505413 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc3cde-2f29-45c4-b431-8e456ebd4933 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:26.505696 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc3cde-2f29-45c4-b431-8e456ebd4933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:26.505971 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc3cde-2f29-45c4-b431-8e456ebd4933 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:26.506610 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc3cde-2f29-45c4-b431-8e456ebd4933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:26.508228 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc3cde-2f29-45c4-b431-8e456ebd4933 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:26.518791 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 643/1264] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:24:26.520086 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb9785-4f50-4e01-8e5e-73abbb278ca6 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:26.520391 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb9785-4f50-4e01-8e5e-73abbb278ca6 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:26.520657 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb9785-4f50-4e01-8e5e-73abbb278ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:26.520927 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9f177-ab2a-4851-ac04-e5e5ec511b39 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:26.524936 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8136b4d-2bf2-4cec-bd88-ee65a98c2d63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:26.525563 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8136b4d-2bf2-4cec-bd88-ee65a98c2d63 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:26.525849 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8136b4d-2bf2-4cec-bd88-ee65a98c2d63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:26.526121 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8136b4d-2bf2-4cec-bd88-ee65a98c2d63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:26.535794 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8136b4d-2bf2-4cec-bd88-ee65a98c2d63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:26.537270 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8136b4d-2bf2-4cec-bd88-ee65a98c2d63 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:26.539813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-b1fb9785-4f50-4e01-8e5e-73abbb278ca6 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:26.541316 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b1fb9785-4f50-4e01-8e5e-73abbb278ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:26.546873 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 622/1265] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:24:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:24:26.547651 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8136b4d-2bf2-4cec-bd88-ee65a98c2d63 service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:26.549957 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 644/1266] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:26.554061 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb9785-4f50-4e01-8e5e-73abbb278ca6 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:26.557934 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8136b4d-2bf2-4cec-bd88-ee65a98c2d63 service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:26.562847 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356eec0-6649-4e38-8b02-349e520a7455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:26.563643 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356eec0-6649-4e38-8b02-349e520a7455 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:26.563934 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356eec0-6649-4e38-8b02-349e520a7455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:26.564718 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356eec0-6649-4e38-8b02-349e520a7455 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:26.564843 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb9785-4f50-4e01-8e5e-73abbb278ca6 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:26.565640 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e356eec0-6649-4e38-8b02-349e520a7455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:26.567020 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e356eec0-6649-4e38-8b02-349e520a7455 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:26.570745 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f5366-4ae7-44b9-af30-a397e6be6384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:26.571796 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f5366-4ae7-44b9-af30-a397e6be6384 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:26.572144 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f5366-4ae7-44b9-af30-a397e6be6384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:26.572575 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f5366-4ae7-44b9-af30-a397e6be6384 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:26.573223 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f5366-4ae7-44b9-af30-a397e6be6384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:26.575081 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f5366-4ae7-44b9-af30-a397e6be6384 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:26.582357 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 623/1267] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:24:26.582357 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356eec0-6649-4e38-8b02-349e520a7455 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:26.588922 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 645/1268] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:24:26.589834 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356eec0-6649-4e38-8b02-349e520a7455 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:26.592690 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f5366-4ae7-44b9-af30-a397e6be6384 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:26.594873 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b986b-66dd-4453-ab8d-24d24edc917a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:26.596244 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b986b-66dd-4453-ab8d-24d24edc917a admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:26.596516 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b986b-66dd-4453-ab8d-24d24edc917a admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:26.596804 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b986b-66dd-4453-ab8d-24d24edc917a admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:26.597503 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b986b-66dd-4453-ab8d-24d24edc917a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:26.599050 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b986b-66dd-4453-ab8d-24d24edc917a admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:26.603505 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f5366-4ae7-44b9-af30-a397e6be6384 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:26.608491 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c56cb9-525b-4bd4-b601-bda9cf2c7c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:26.609095 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c56cb9-525b-4bd4-b601-bda9cf2c7c49 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:26.609375 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c56cb9-525b-4bd4-b601-bda9cf2c7c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:26.609721 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c56cb9-525b-4bd4-b601-bda9cf2c7c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:26.610372 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 624/1269] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:24:26.610660 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c56cb9-525b-4bd4-b601-bda9cf2c7c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:26.611473 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b986b-66dd-4453-ab8d-24d24edc917a admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:26.612728 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c56cb9-525b-4bd4-b601-bda9cf2c7c49 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:26.621597 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b986b-66dd-4453-ab8d-24d24edc917a admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:26.627124 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 646/1270] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:24:26.627124 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c56cb9-525b-4bd4-b601-bda9cf2c7c49 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:26.629467 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ed753-6430-4b78-b6ac-c0eaf49c8fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:26.630101 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ed753-6430-4b78-b6ac-c0eaf49c8fef admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:26.630369 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ed753-6430-4b78-b6ac-c0eaf49c8fef admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:26.631021 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ed753-6430-4b78-b6ac-c0eaf49c8fef admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:26.631673 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ed753-6430-4b78-b6ac-c0eaf49c8fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:26.633941 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ed753-6430-4b78-b6ac-c0eaf49c8fef admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:26.635233 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c56cb9-525b-4bd4-b601-bda9cf2c7c49 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:26.640208 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa76704-6e35-405f-9e62-6c1dd8922f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:26.640805 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa76704-6e35-405f-9e62-6c1dd8922f56 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:26.641085 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa76704-6e35-405f-9e62-6c1dd8922f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:26.641359 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa76704-6e35-405f-9e62-6c1dd8922f56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:26.642503 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa76704-6e35-405f-9e62-6c1dd8922f56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:26.644121 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa76704-6e35-405f-9e62-6c1dd8922f56 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:26.649785 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 625/1271] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:24:26.649785 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ed753-6430-4b78-b6ac-c0eaf49c8fef admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:26.652239 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-024ed753-6430-4b78-b6ac-c0eaf49c8fef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:26.658845 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 647/1272] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:24:26.658845 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa76704-6e35-405f-9e62-6c1dd8922f56 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:26.663915 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:26.670415 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa76704-6e35-405f-9e62-6c1dd8922f56 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:26.672853 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ed753-6430-4b78-b6ac-c0eaf49c8fef admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:26.676751 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d95b8-4256-45f0-9d9a-20e120db09aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:26.677371 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d95b8-4256-45f0-9d9a-20e120db09aa admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:26.677652 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d95b8-4256-45f0-9d9a-20e120db09aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:26.677766 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d25cb-8bb0-4279-9371-1518e8a698ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:26.677986 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d95b8-4256-45f0-9d9a-20e120db09aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:26.678311 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d25cb-8bb0-4279-9371-1518e8a698ec service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:26.678565 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d95b8-4256-45f0-9d9a-20e120db09aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:26.678738 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d25cb-8bb0-4279-9371-1518e8a698ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:26.679557 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d25cb-8bb0-4279-9371-1518e8a698ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:26.680284 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d95b8-4256-45f0-9d9a-20e120db09aa admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:26.690171 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d25cb-8bb0-4279-9371-1518e8a698ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:26.692110 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d25cb-8bb0-4279-9371-1518e8a698ec service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:26.692231 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 648/1273] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:24:26.700866 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d95b8-4256-45f0-9d9a-20e120db09aa admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:26.704076 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 626/1274] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:24:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:24:26.706819 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d25cb-8bb0-4279-9371-1518e8a698ec service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:26.714275 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d95b8-4256-45f0-9d9a-20e120db09aa admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:26.719764 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a5f06-3c9d-4f89-b405-a4f0bd6e79d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:26.720555 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a5f06-3c9d-4f89-b405-a4f0bd6e79d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:26.720903 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a5f06-3c9d-4f89-b405-a4f0bd6e79d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:26.721268 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a5f06-3c9d-4f89-b405-a4f0bd6e79d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:26.722159 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a5f06-3c9d-4f89-b405-a4f0bd6e79d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:26.722810 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d25cb-8bb0-4279-9371-1518e8a698ec service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:26.724023 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a5f06-3c9d-4f89-b405-a4f0bd6e79d2 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:26.729471 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1ec7f-5398-46a4-9567-ad7de7711643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:26.730318 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1ec7f-5398-46a4-9567-ad7de7711643 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:26.731257 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1ec7f-5398-46a4-9567-ad7de7711643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:26.731787 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1ec7f-5398-46a4-9567-ad7de7711643 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:26.732679 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1ec7f-5398-46a4-9567-ad7de7711643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:26.734869 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1ec7f-5398-46a4-9567-ad7de7711643 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:26.739699 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 649/1275] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:24:26.739699 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a5f06-3c9d-4f89-b405-a4f0bd6e79d2 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:26.752733 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a5f06-3c9d-4f89-b405-a4f0bd6e79d2 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:26.755953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 627/1276] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:24:26.757214 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1ec7f-5398-46a4-9567-ad7de7711643 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:26.761230 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a54da-71ca-4a27-ac58-a85fa4bd5ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:26.762025 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a54da-71ca-4a27-ac58-a85fa4bd5ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:26.762454 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a54da-71ca-4a27-ac58-a85fa4bd5ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:26.763543 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a54da-71ca-4a27-ac58-a85fa4bd5ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:26.764584 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a54da-71ca-4a27-ac58-a85fa4bd5ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:26.768275 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a54da-71ca-4a27-ac58-a85fa4bd5ab2 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:26.783390 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 650/1277] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:24:26.784652 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a54da-71ca-4a27-ac58-a85fa4bd5ab2 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:26.791789 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1ec7f-5398-46a4-9567-ad7de7711643 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:26.797966 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a54da-71ca-4a27-ac58-a85fa4bd5ab2 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:26.798667 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531f905-e219-47f0-ba07-1e7c7494c194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:26.799364 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531f905-e219-47f0-ba07-1e7c7494c194 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:26.799638 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531f905-e219-47f0-ba07-1e7c7494c194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:26.800096 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531f905-e219-47f0-ba07-1e7c7494c194 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:26.800823 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531f905-e219-47f0-ba07-1e7c7494c194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:26.802650 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531f905-e219-47f0-ba07-1e7c7494c194 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:26.803546 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50561976-7a77-4c48-b485-e49d56653b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:26.804400 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50561976-7a77-4c48-b485-e49d56653b18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:26.804681 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50561976-7a77-4c48-b485-e49d56653b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:26.805072 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50561976-7a77-4c48-b485-e49d56653b18 admin admin] PATH_INFO: `/v3/projects/6e9dc59beb05479a939094a08481bd23/users/5d6160cc258844f9a7f618b635916f23/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:26.818161 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 628/1278] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:24:26.822291 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531f905-e219-47f0-ba07-1e7c7494c194 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:26.824681 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50561976-7a77-4c48-b485-e49d56653b18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e9dc59beb05479a939094a08481bd23, user_id=5d6160cc258844f9a7f618b635916f23, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:26.828129 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50561976-7a77-4c48-b485-e49d56653b18 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:26.837473 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531f905-e219-47f0-ba07-1e7c7494c194 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:26.844263 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821cdd13-4e07-4fa0-9f28-8d072dce4143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:26.845010 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821cdd13-4e07-4fa0-9f28-8d072dce4143 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:26.845523 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821cdd13-4e07-4fa0-9f28-8d072dce4143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:26.846413 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821cdd13-4e07-4fa0-9f28-8d072dce4143 admin admin] PATH_INFO: `/v3/projects/b0b993151f084e5f83c6aa17335dffd8/users/5d62e9791b2542ad8b95e5f6b4c25e4b/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:26.847500 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 651/1279] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:24:26 2022] PUT /identity/v3/projects/6e9dc59beb05479a939094a08481bd23/users/5d6160cc258844f9a7f618b635916f23/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:24:26.848461 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50561976-7a77-4c48-b485-e49d56653b18 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:26.869171 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821cdd13-4e07-4fa0-9f28-8d072dce4143 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0b993151f084e5f83c6aa17335dffd8, user_id=5d62e9791b2542ad8b95e5f6b4c25e4b, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:26.873184 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821cdd13-4e07-4fa0-9f28-8d072dce4143 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:26.904145 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 629/1280] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:24:26 2022] PUT /identity/v3/projects/b0b993151f084e5f83c6aa17335dffd8/users/5d62e9791b2542ad8b95e5f6b4c25e4b/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:24:26.904145 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821cdd13-4e07-4fa0-9f28-8d072dce4143 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:26.909597 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:26.938112 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50561976-7a77-4c48-b485-e49d56653b18 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:27.027577 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821cdd13-4e07-4fa0-9f28-8d072dce4143 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:27.044445 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a0f0c-d9a3-4cf8-8688-b70b6063a6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:27.045377 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a0f0c-d9a3-4cf8-8688-b70b6063a6b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:27.045658 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a0f0c-d9a3-4cf8-8688-b70b6063a6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:27.045933 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a0f0c-d9a3-4cf8-8688-b70b6063a6b0 admin admin] PATH_INFO: `/v3/projects/134aa379644b45898097564584a883a6/users/b45585ee97774a5fa704eac9e992adcb/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:27.066715 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd84501-1a21-4970-85d1-0dd1ec6a5e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:27.067476 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd84501-1a21-4970-85d1-0dd1ec6a5e96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:27.067758 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd84501-1a21-4970-85d1-0dd1ec6a5e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:27.068101 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd84501-1a21-4970-85d1-0dd1ec6a5e96 admin admin] PATH_INFO: `/v3/projects/6708288a01964a62b8e86bf5988837d2/users/04d684ea21984ff699fea2c637044c3d/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:27.075598 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a0f0c-d9a3-4cf8-8688-b70b6063a6b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=134aa379644b45898097564584a883a6, user_id=b45585ee97774a5fa704eac9e992adcb, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:27.078792 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a0f0c-d9a3-4cf8-8688-b70b6063a6b0 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:27.092956 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd84501-1a21-4970-85d1-0dd1ec6a5e96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6708288a01964a62b8e86bf5988837d2, user_id=04d684ea21984ff699fea2c637044c3d, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:27.098647 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd84501-1a21-4970-85d1-0dd1ec6a5e96 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:27.100149 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 630/1281] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:24:26 2022] PUT /identity/v3/projects/134aa379644b45898097564584a883a6/users/b45585ee97774a5fa704eac9e992adcb/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:24:27.101284 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a0f0c-d9a3-4cf8-8688-b70b6063a6b0 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:27.122957 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 652/1282] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:24:26 2022] PUT /identity/v3/projects/6708288a01964a62b8e86bf5988837d2/users/04d684ea21984ff699fea2c637044c3d/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:24:27.124644 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd84501-1a21-4970-85d1-0dd1ec6a5e96 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:27.192493 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a0f0c-d9a3-4cf8-8688-b70b6063a6b0 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:27.209866 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd84501-1a21-4970-85d1-0dd1ec6a5e96 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:27.214643 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558cb27-74a8-4470-a66d-f31e276a18c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:27.215402 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558cb27-74a8-4470-a66d-f31e276a18c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:27.215881 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558cb27-74a8-4470-a66d-f31e276a18c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:27.216220 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558cb27-74a8-4470-a66d-f31e276a18c4 admin admin] PATH_INFO: `/v3/projects/05d3462d306747d4823e6a663a066f41/users/187c9634d99647f58fa8776aeb9c663e/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:27.234745 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:27.247734 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558cb27-74a8-4470-a66d-f31e276a18c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05d3462d306747d4823e6a663a066f41, user_id=187c9634d99647f58fa8776aeb9c663e, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:27.256524 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558cb27-74a8-4470-a66d-f31e276a18c4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:27.285541 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 653/1283] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:24:27 2022] PUT /identity/v3/projects/05d3462d306747d4823e6a663a066f41/users/187c9634d99647f58fa8776aeb9c663e/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:24:27.287498 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd389407-290e-42e8-b87f-5f1f2e2c8090 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:27.287798 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd389407-290e-42e8-b87f-5f1f2e2c8090 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:27.288142 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd389407-290e-42e8-b87f-5f1f2e2c8090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:27.310923 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5af10-3635-4528-84e5-5d32f890ee27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:27.311623 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5af10-3635-4528-84e5-5d32f890ee27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:27.311926 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5af10-3635-4528-84e5-5d32f890ee27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:27.312198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5af10-3635-4528-84e5-5d32f890ee27 admin admin] PATH_INFO: `/v3/projects/dc5c8bd3b87a40aaad153b8454296ee7/users/2a2ed118a399479ab355bfd5734d04d8/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:27.328847 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-dd389407-290e-42e8-b87f-5f1f2e2c8090 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:27.331297 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-dd389407-290e-42e8-b87f-5f1f2e2c8090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:27.346573 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d5af10-3635-4528-84e5-5d32f890ee27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc5c8bd3b87a40aaad153b8454296ee7, user_id=2a2ed118a399479ab355bfd5734d04d8, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:27.349763 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d5af10-3635-4528-84e5-5d32f890ee27 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:27.371560 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:27.374324 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 631/1284] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:24:27 2022] PUT /identity/v3/projects/dc5c8bd3b87a40aaad153b8454296ee7/users/2a2ed118a399479ab355bfd5734d04d8/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:24:27.384234 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93a169-9af3-496c-99e7-512e2778ef17 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:27.384666 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93a169-9af3-496c-99e7-512e2778ef17 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:27.385393 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93a169-9af3-496c-99e7-512e2778ef17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:27.422526 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 654/1285] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:27.425618 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5702b7f-3f09-487d-93f5-e50971780f95 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:27.425932 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5702b7f-3f09-487d-93f5-e50971780f95 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:27.426789 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5702b7f-3f09-487d-93f5-e50971780f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:27.428726 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-4e93a169-9af3-496c-99e7-512e2778ef17 None None] MFA Rules not processed for user `5d62e9791b2542ad8b95e5f6b4c25e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:27.430437 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-4e93a169-9af3-496c-99e7-512e2778ef17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:27.451365 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-b5702b7f-3f09-487d-93f5-e50971780f95 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:27.452611 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b5702b7f-3f09-487d-93f5-e50971780f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:27.551940 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 632/1286] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:27.553937 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d046f3d-47c2-4210-9d20-a7a55285d2e1 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:27.554355 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d046f3d-47c2-4210-9d20-a7a55285d2e1 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:27.554731 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d046f3d-47c2-4210-9d20-a7a55285d2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:27.570031 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 655/1287] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:27.571947 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03811c-8624-4ed7-99b5-2920ae86512b None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:27.572246 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03811c-8624-4ed7-99b5-2920ae86512b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:27.572604 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03811c-8624-4ed7-99b5-2920ae86512b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:27.588192 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-2d046f3d-47c2-4210-9d20-a7a55285d2e1 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:27.591030 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2d046f3d-47c2-4210-9d20-a7a55285d2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:27.604655 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 633/1288] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:27.604655 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366ac19-8480-4331-8a80-953ea723d18c None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:27.604655 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366ac19-8480-4331-8a80-953ea723d18c None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:27.604655 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366ac19-8480-4331-8a80-953ea723d18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:27.611085 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-6a03811c-8624-4ed7-99b5-2920ae86512b None None] MFA Rules not processed for user `187c9634d99647f58fa8776aeb9c663e`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:27.612633 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6a03811c-8624-4ed7-99b5-2920ae86512b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:27.633333 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-1366ac19-8480-4331-8a80-953ea723d18c None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:27.635840 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-1366ac19-8480-4331-8a80-953ea723d18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:27.652685 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 634/1289] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:27.653603 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366ac19-8480-4331-8a80-953ea723d18c None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:27.742522 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366ac19-8480-4331-8a80-953ea723d18c None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:27.750174 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 656/1290] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:27.751089 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03811c-8624-4ed7-99b5-2920ae86512b None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:27.755355 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0f03b-1743-4054-83cd-70cbdb80caa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:27.755355 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0f03b-1743-4054-83cd-70cbdb80caa0 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:27.755355 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0f03b-1743-4054-83cd-70cbdb80caa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:27.755355 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0f03b-1743-4054-83cd-70cbdb80caa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:27.770165 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03811c-8624-4ed7-99b5-2920ae86512b None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:27.779991 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54988f42-64d1-4b6f-87de-2fd9043baa13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:27.780702 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54988f42-64d1-4b6f-87de-2fd9043baa13 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:27.781104 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc0f03b-1743-4054-83cd-70cbdb80caa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:27.781247 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54988f42-64d1-4b6f-87de-2fd9043baa13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:27.783397 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54988f42-64d1-4b6f-87de-2fd9043baa13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:27.785808 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc0f03b-1743-4054-83cd-70cbdb80caa0 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:27.811092 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54988f42-64d1-4b6f-87de-2fd9043baa13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:27.812674 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54988f42-64d1-4b6f-87de-2fd9043baa13 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:27.818202 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 635/1291] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:24:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:24:27.818872 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3dffc9-b98c-4c1c-a219-333a07e31a94 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:27.820236 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3dffc9-b98c-4c1c-a219-333a07e31a94 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:27.820356 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3dffc9-b98c-4c1c-a219-333a07e31a94 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:27.822152 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 636/1292] 10.222.0.25 () {54 vars in 961 bytes} [Tue Oct 25 13:24:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:24:27.823350 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3dffc9-b98c-4c1c-a219-333a07e31a94 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:27.854113 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3dffc9-b98c-4c1c-a219-333a07e31a94 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:27.855105 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 657/1293] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:24:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:24:27.855768 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54988f42-64d1-4b6f-87de-2fd9043baa13 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:27.864919 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54988f42-64d1-4b6f-87de-2fd9043baa13 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:27.865596 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa2f73-8d4d-4dcf-9419-5259e5ff5ec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:27.866217 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa2f73-8d4d-4dcf-9419-5259e5ff5ec2 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:27.866493 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa2f73-8d4d-4dcf-9419-5259e5ff5ec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:27.866761 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa2f73-8d4d-4dcf-9419-5259e5ff5ec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:27.869159 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877825c-11b8-4699-bfdc-c1ad7f10fb00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:27.869822 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877825c-11b8-4699-bfdc-c1ad7f10fb00 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:27.870305 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877825c-11b8-4699-bfdc-c1ad7f10fb00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:27.870687 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877825c-11b8-4699-bfdc-c1ad7f10fb00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:27.885362 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa2f73-8d4d-4dcf-9419-5259e5ff5ec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:27.887284 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa2f73-8d4d-4dcf-9419-5259e5ff5ec2 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:27.891239 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a877825c-11b8-4699-bfdc-c1ad7f10fb00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:27.893968 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a877825c-11b8-4699-bfdc-c1ad7f10fb00 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:27.900397 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 637/1294] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:24:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:24:27.901771 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dac5d3-5517-4f63-b0b9-772cd75aeaf3 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:27.902327 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dac5d3-5517-4f63-b0b9-772cd75aeaf3 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:27.902829 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dac5d3-5517-4f63-b0b9-772cd75aeaf3 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:27.904726 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 638/1295] 10.222.0.25 () {54 vars in 961 bytes} [Tue Oct 25 13:24:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:24:27.906724 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec0421-a88d-4ac8-96cb-29fa0e861adc None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:27.907711 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec0421-a88d-4ac8-96cb-29fa0e861adc None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:27.908818 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec0421-a88d-4ac8-96cb-29fa0e861adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:27.909754 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 658/1296] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:24:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:24:27.913064 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7234f43-f891-4487-acce-0f2c67699bc2 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:27.913531 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7234f43-f891-4487-acce-0f2c67699bc2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:27.914026 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7234f43-f891-4487-acce-0f2c67699bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:27.972148 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c7234f43-f891-4487-acce-0f2c67699bc2 None None] MFA Rules not processed for user `d3943406b2cc4eee9c5dbb5f03b59d36`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:27.973885 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c7234f43-f891-4487-acce-0f2c67699bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:27.974717 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-6dec0421-a88d-4ac8-96cb-29fa0e861adc None None] MFA Rules not processed for user `63e73c00cadb4deea934db6111ed76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:27.985365 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-6dec0421-a88d-4ac8-96cb-29fa0e861adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:27.990574 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:28.029520 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:28.082013 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 659/1297] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:27 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:28.095129 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181fc1f-a083-4454-abf9-c5277a598183 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:28.095129 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181fc1f-a083-4454-abf9-c5277a598183 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:28.095129 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181fc1f-a083-4454-abf9-c5277a598183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:28.120158 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-b181fc1f-a083-4454-abf9-c5277a598183 None None] MFA Rules not processed for user `63e73c00cadb4deea934db6111ed76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:28.122080 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b181fc1f-a083-4454-abf9-c5277a598183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:28.137861 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 660/1298] 10.222.0.25 () {58 vars in 1058 bytes} [Tue Oct 25 13:24:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:28.138847 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181fc1f-a083-4454-abf9-c5277a598183 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:28.146382 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 639/1299] 10.222.0.25 () {58 vars in 1058 bytes} [Tue Oct 25 13:24:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:28.147863 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec0421-a88d-4ac8-96cb-29fa0e861adc None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:28.161756 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181fc1f-a083-4454-abf9-c5277a598183 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:28.169305 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44194aa-d671-490e-92be-bf46d913930d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:28.170021 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44194aa-d671-490e-92be-bf46d913930d admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:28.170372 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44194aa-d671-490e-92be-bf46d913930d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:28.170716 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44194aa-d671-490e-92be-bf46d913930d admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:28.171428 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44194aa-d671-490e-92be-bf46d913930d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:28.172730 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec0421-a88d-4ac8-96cb-29fa0e861adc None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:28.174307 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44194aa-d671-490e-92be-bf46d913930d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:28.188136 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88741a-f68d-4181-a491-5b5ca9b210a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:28.188820 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88741a-f68d-4181-a491-5b5ca9b210a2 service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:28.189159 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88741a-f68d-4181-a491-5b5ca9b210a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:28.189603 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88741a-f68d-4181-a491-5b5ca9b210a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:28.217257 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88741a-f68d-4181-a491-5b5ca9b210a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:28.219185 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88741a-f68d-4181-a491-5b5ca9b210a2 service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:28.242488 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 640/1300] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:24:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:24:28.243155 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 661/1301] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:24:28 2022] POST /identity/v3/projects => generated 405 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:24:28.244611 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44194aa-d671-490e-92be-bf46d913930d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:28.244923 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88741a-f68d-4181-a491-5b5ca9b210a2 service nova] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:28.268079 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88741a-f68d-4181-a491-5b5ca9b210a2 service nova] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:28.336157 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44194aa-d671-490e-92be-bf46d913930d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:28.342967 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a0ec5-9ba1-4942-a8b5-80f1bb2818e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:28.343923 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a0ec5-9ba1-4942-a8b5-80f1bb2818e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:28.344311 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a0ec5-9ba1-4942-a8b5-80f1bb2818e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:28.346436 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a0ec5-9ba1-4942-a8b5-80f1bb2818e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:28.347344 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81a0ec5-9ba1-4942-a8b5-80f1bb2818e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:28.349721 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81a0ec5-9ba1-4942-a8b5-80f1bb2818e8 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:28.404858 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 662/1302] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:24:28 2022] POST /identity/v3/users => generated 309 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:24:28.407409 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a0ec5-9ba1-4942-a8b5-80f1bb2818e8 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:28.425186 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53baf6c2-eb20-4418-8e53-4abbd9d4bf51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:28.429249 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53baf6c2-eb20-4418-8e53-4abbd9d4bf51 service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:28.429611 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53baf6c2-eb20-4418-8e53-4abbd9d4bf51 service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:28.429964 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53baf6c2-eb20-4418-8e53-4abbd9d4bf51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:28.439569 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a0ec5-9ba1-4942-a8b5-80f1bb2818e8 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:28.452335 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae982089-54d3-4a74-86e2-7fcef2dde26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:28.452965 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae982089-54d3-4a74-86e2-7fcef2dde26e admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:28.456037 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae982089-54d3-4a74-86e2-7fcef2dde26e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:28.456335 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae982089-54d3-4a74-86e2-7fcef2dde26e admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:28.457001 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae982089-54d3-4a74-86e2-7fcef2dde26e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:28.458610 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae982089-54d3-4a74-86e2-7fcef2dde26e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:28.494821 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 663/1303] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:24:28.495939 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae982089-54d3-4a74-86e2-7fcef2dde26e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:28.508386 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae982089-54d3-4a74-86e2-7fcef2dde26e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:28.513622 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c625725-7c24-4048-a92f-645070399a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:28.514326 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c625725-7c24-4048-a92f-645070399a11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:28.516426 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c625725-7c24-4048-a92f-645070399a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:28.516844 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c625725-7c24-4048-a92f-645070399a11 admin admin] PATH_INFO: `/v3/projects/c8f04f76371346c7a7b702f4b376f486/users/2ce3cc8751a7432c9d85e7a643a12256/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:28.553588 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c625725-7c24-4048-a92f-645070399a11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8f04f76371346c7a7b702f4b376f486, user_id=2ce3cc8751a7432c9d85e7a643a12256, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:28.559050 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c625725-7c24-4048-a92f-645070399a11 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:28.566164 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53baf6c2-eb20-4418-8e53-4abbd9d4bf51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:28.567784 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53baf6c2-eb20-4418-8e53-4abbd9d4bf51 service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:28.596421 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 641/1304] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:24:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:24:28.599474 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 664/1305] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:24:28 2022] PUT /identity/v3/projects/c8f04f76371346c7a7b702f4b376f486/users/2ce3cc8751a7432c9d85e7a643a12256/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:24:28.606246 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c625725-7c24-4048-a92f-645070399a11 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:28.607406 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376506c-e738-4d52-99e9-c878a43fdbc1 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:28.607694 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376506c-e738-4d52-99e9-c878a43fdbc1 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:28.608506 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376506c-e738-4d52-99e9-c878a43fdbc1 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:28.614611 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 642/1306] 10.222.0.25 () {54 vars in 912 bytes} [Tue Oct 25 13:24:28 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:24:28.622449 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c59ae6-8c49-49aa-a14a-8f38149cbe0e None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:28.622728 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c59ae6-8c49-49aa-a14a-8f38149cbe0e None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:28.624522 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c59ae6-8c49-49aa-a14a-8f38149cbe0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:28.672466 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-31c59ae6-8c49-49aa-a14a-8f38149cbe0e None None] MFA Rules not processed for user `63e73c00cadb4deea934db6111ed76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:28.674642 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-31c59ae6-8c49-49aa-a14a-8f38149cbe0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:28.713038 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:28.747502 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c625725-7c24-4048-a92f-645070399a11 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:28.763925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6be7e-6ac6-41c7-8cab-ab366f98ffb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:28.764559 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6be7e-6ac6-41c7-8cab-ab366f98ffb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:28.764841 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6be7e-6ac6-41c7-8cab-ab366f98ffb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:28.765117 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6be7e-6ac6-41c7-8cab-ab366f98ffb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:28.765763 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6be7e-6ac6-41c7-8cab-ab366f98ffb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:28.768426 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6be7e-6ac6-41c7-8cab-ab366f98ffb8 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:28.774005 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:28.794972 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 665/1307] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:24:28.799709 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6be7e-6ac6-41c7-8cab-ab366f98ffb8 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:28.817798 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6be7e-6ac6-41c7-8cab-ab366f98ffb8 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:28.821944 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 643/1308] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 25 13:24:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:28.834871 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c712b-c3e4-4232-87b8-e8035ffb5f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:28.835530 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c712b-c3e4-4232-87b8-e8035ffb5f44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:28.835771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c712b-c3e4-4232-87b8-e8035ffb5f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:28.836080 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c712b-c3e4-4232-87b8-e8035ffb5f44 admin admin] PATH_INFO: `/v3/projects/c8f04f76371346c7a7b702f4b376f486/users/2ce3cc8751a7432c9d85e7a643a12256/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:28.838041 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126c712b-c3e4-4232-87b8-e8035ffb5f44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8f04f76371346c7a7b702f4b376f486, user_id=2ce3cc8751a7432c9d85e7a643a12256, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:28.840714 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126c712b-c3e4-4232-87b8-e8035ffb5f44 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:28.845190 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c59ae6-8c49-49aa-a14a-8f38149cbe0e None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:28.862521 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 666/1309] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:24:28 2022] PUT /identity/v3/projects/c8f04f76371346c7a7b702f4b376f486/users/2ce3cc8751a7432c9d85e7a643a12256/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:24:28.935228 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c59ae6-8c49-49aa-a14a-8f38149cbe0e None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:28.960242 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2a027-2047-4cac-875f-41a0d1a044c4 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:28.961137 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2a027-2047-4cac-875f-41a0d1a044c4 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:28.961592 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2a027-2047-4cac-875f-41a0d1a044c4 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:28.963132 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 667/1310] 10.222.0.25 () {54 vars in 912 bytes} [Tue Oct 25 13:24:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 13:24:28.971135 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493e641-a377-4183-9c0a-3371ec41a837 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:28.971637 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493e641-a377-4183-9c0a-3371ec41a837 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:28.972120 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493e641-a377-4183-9c0a-3371ec41a837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:28.997337 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-7493e641-a377-4183-9c0a-3371ec41a837 None None] MFA Rules not processed for user `63e73c00cadb4deea934db6111ed76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:28.998361 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7493e641-a377-4183-9c0a-3371ec41a837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:29.025488 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fbbec9-d0b0-450b-bb59-d2488ddebdd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:29.026686 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbbec9-d0b0-450b-bb59-d2488ddebdd4 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:29.027790 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbbec9-d0b0-450b-bb59-d2488ddebdd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:29.028333 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbbec9-d0b0-450b-bb59-d2488ddebdd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:29.136143 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 668/1311] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 25 13:24:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:24:29.146380 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493e641-a377-4183-9c0a-3371ec41a837 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:29.161042 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493e641-a377-4183-9c0a-3371ec41a837 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:29.174185 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e07b33-083d-4b0a-afde-45d7142f19ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:29.175383 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e07b33-083d-4b0a-afde-45d7142f19ff service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:29.175383 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e07b33-083d-4b0a-afde-45d7142f19ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:29.175383 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e07b33-083d-4b0a-afde-45d7142f19ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:29.187199 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fbbec9-d0b0-450b-bb59-d2488ddebdd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:29.190927 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fbbec9-d0b0-450b-bb59-d2488ddebdd4 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:29.204762 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e07b33-083d-4b0a-afde-45d7142f19ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:29.210044 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e07b33-083d-4b0a-afde-45d7142f19ff service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:29.214354 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 644/1312] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:24:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:24:29.235238 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 669/1313] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:24:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 13:24:30.548528 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf65e54-8957-4fdd-9d60-74f097112fcb None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:30.549624 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf65e54-8957-4fdd-9d60-74f097112fcb None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:30.549624 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf65e54-8957-4fdd-9d60-74f097112fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:30.608078 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:30.625047 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-abf65e54-8957-4fdd-9d60-74f097112fcb None None] MFA Rules not processed for user `2ce3cc8751a7432c9d85e7a643a12256`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:30.627043 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-abf65e54-8957-4fdd-9d60-74f097112fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:30.750280 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 645/1314] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:30 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:32.937935 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e07b33-083d-4b0a-afde-45d7142f19ff service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:33.078866 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e07b33-083d-4b0a-afde-45d7142f19ff service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:33.088708 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7253714-569d-444f-9597-30e76f08fd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:33.090106 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7253714-569d-444f-9597-30e76f08fd49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:33.091058 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7253714-569d-444f-9597-30e76f08fd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:33.091732 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7253714-569d-444f-9597-30e76f08fd49 admin admin] PATH_INFO: `/v3/users/5d62e9791b2542ad8b95e5f6b4c25e4b` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:33.093440 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7253714-569d-444f-9597-30e76f08fd49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d62e9791b2542ad8b95e5f6b4c25e4b)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:33.094982 dv-cinder-862432-2-smb devstack@keystone.service[81362]: WARNING py.warnings [None req-e7253714-569d-444f-9597-30e76f08fd49 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 13:24:33.094982 dv-cinder-862432-2-smb devstack@keystone.service[81362]: warnings.warn(msg) Oct 25 13:24:33.094982 dv-cinder-862432-2-smb devstack@keystone.service[81362]: Oct 25 13:24:33.097376 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7253714-569d-444f-9597-30e76f08fd49 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:33.296614 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e7253714-569d-444f-9597-30e76f08fd49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d62e9791b2542ad8b95e5f6b4c25e4b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:33.299411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e7253714-569d-444f-9597-30e76f08fd49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d62e9791b2542ad8b95e5f6b4c25e4b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:33.328117 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:33.330563 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e7253714-569d-444f-9597-30e76f08fd49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d62e9791b2542ad8b95e5f6b4c25e4b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:33.344148 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e7253714-569d-444f-9597-30e76f08fd49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d62e9791b2542ad8b95e5f6b4c25e4b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:33.362054 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e7253714-569d-444f-9597-30e76f08fd49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d62e9791b2542ad8b95e5f6b4c25e4b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:33.377847 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 670/1315] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:24:32 2022] DELETE /identity/v3/users/5d62e9791b2542ad8b95e5f6b4c25e4b => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:24:33.379120 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1eb83-9115-4dd7-9d55-6dff53c404c3 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:33.379675 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1eb83-9115-4dd7-9d55-6dff53c404c3 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:33.379675 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1eb83-9115-4dd7-9d55-6dff53c404c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:33.414060 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-f9c1eb83-9115-4dd7-9d55-6dff53c404c3 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:33.415393 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-f9c1eb83-9115-4dd7-9d55-6dff53c404c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:33.469062 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c81f0-b46c-41e3-870c-3ccc08bdf30b None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:33.469357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c81f0-b46c-41e3-870c-3ccc08bdf30b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:33.469634 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c81f0-b46c-41e3-870c-3ccc08bdf30b None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:33.472940 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 671/1316] 10.222.0.25 () {54 vars in 921 bytes} [Tue Oct 25 13:24:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 25 13:24:33.501028 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc1e11-1d32-441f-8a85-c8cc991a3549 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:33.501864 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc1e11-1d32-441f-8a85-c8cc991a3549 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:33.502148 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc1e11-1d32-441f-8a85-c8cc991a3549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:33.553421 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-73bc1e11-1d32-441f-8a85-c8cc991a3549 None None] MFA Rules not processed for user `f10c161ef74c4a0d809346a5c4b53aa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:33.555440 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-73bc1e11-1d32-441f-8a85-c8cc991a3549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:33.590525 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 646/1317] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:33.691243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1eb83-9115-4dd7-9d55-6dff53c404c3 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:33.692812 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-f9c1eb83-9115-4dd7-9d55-6dff53c404c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:33.742311 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 672/1318] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Oct 25 13:24:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:24:33.790962 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc1e11-1d32-441f-8a85-c8cc991a3549 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:33.794453 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-73bc1e11-1d32-441f-8a85-c8cc991a3549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:33.822600 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc1e11-1d32-441f-8a85-c8cc991a3549 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:33.836644 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449b77d-fcff-465e-b7d5-760ecd78233d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f10c161ef74c4a0d809346a5c4b53aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:33.837281 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449b77d-fcff-465e-b7d5-760ecd78233d service placement] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:33.837613 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449b77d-fcff-465e-b7d5-760ecd78233d service placement] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:33.837824 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449b77d-fcff-465e-b7d5-760ecd78233d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:33.840588 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1eb83-9115-4dd7-9d55-6dff53c404c3 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:33.860186 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40efc12-fd04-4f68-8fdc-8a1b97e7bc64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:33.875377 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40efc12-fd04-4f68-8fdc-8a1b97e7bc64 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:33.875617 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40efc12-fd04-4f68-8fdc-8a1b97e7bc64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:33.877005 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40efc12-fd04-4f68-8fdc-8a1b97e7bc64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:33.887222 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449b77d-fcff-465e-b7d5-760ecd78233d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:33.892915 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449b77d-fcff-465e-b7d5-760ecd78233d service placement] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:33.902310 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40efc12-fd04-4f68-8fdc-8a1b97e7bc64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:33.903829 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40efc12-fd04-4f68-8fdc-8a1b97e7bc64 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:33.920906 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 673/1319] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:24:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 13:24:33.929986 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 647/1320] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:24:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 13:24:35.477006 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449b77d-fcff-465e-b7d5-760ecd78233d service placement] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:35.478480 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7449b77d-fcff-465e-b7d5-760ecd78233d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:35.514207 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449b77d-fcff-465e-b7d5-760ecd78233d service placement] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:35.557909 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3579f9-0dff-46b0-b4fb-5b34d8b286a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:35.558881 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3579f9-0dff-46b0-b4fb-5b34d8b286a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:35.558881 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3579f9-0dff-46b0-b4fb-5b34d8b286a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:35.559115 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3579f9-0dff-46b0-b4fb-5b34d8b286a4 admin admin] PATH_INFO: `/v3/users/d3943406b2cc4eee9c5dbb5f03b59d36` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:35.561822 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3579f9-0dff-46b0-b4fb-5b34d8b286a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3943406b2cc4eee9c5dbb5f03b59d36)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:35.564706 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3579f9-0dff-46b0-b4fb-5b34d8b286a4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:35.677036 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4f3579f9-0dff-46b0-b4fb-5b34d8b286a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3943406b2cc4eee9c5dbb5f03b59d36'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:35.677987 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4f3579f9-0dff-46b0-b4fb-5b34d8b286a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3943406b2cc4eee9c5dbb5f03b59d36'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:35.695788 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4f3579f9-0dff-46b0-b4fb-5b34d8b286a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3943406b2cc4eee9c5dbb5f03b59d36'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:35.718295 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4f3579f9-0dff-46b0-b4fb-5b34d8b286a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3943406b2cc4eee9c5dbb5f03b59d36'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:35.771291 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4f3579f9-0dff-46b0-b4fb-5b34d8b286a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3943406b2cc4eee9c5dbb5f03b59d36'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:35.793984 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 674/1321] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:24:35 2022] DELETE /identity/v3/users/d3943406b2cc4eee9c5dbb5f03b59d36 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:24:36.237010 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40efc12-fd04-4f68-8fdc-8a1b97e7bc64 service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:36.238354 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-d40efc12-fd04-4f68-8fdc-8a1b97e7bc64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:36.271135 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40efc12-fd04-4f68-8fdc-8a1b97e7bc64 service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:36.441412 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:36.505885 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab20a9-e17c-4e4f-b3da-74611963a934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:36.507444 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab20a9-e17c-4e4f-b3da-74611963a934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:36.507917 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab20a9-e17c-4e4f-b3da-74611963a934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:36.508369 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab20a9-e17c-4e4f-b3da-74611963a934 admin admin] PATH_INFO: `/v3/projects/b0b993151f084e5f83c6aa17335dffd8` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:36.511796 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ab20a9-e17c-4e4f-b3da-74611963a934 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0b993151f084e5f83c6aa17335dffd8)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:36.513144 dv-cinder-862432-2-smb devstack@keystone.service[81363]: WARNING py.warnings [None req-76ab20a9-e17c-4e4f-b3da-74611963a934 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 25 13:24:36.513144 dv-cinder-862432-2-smb devstack@keystone.service[81363]: warnings.warn(msg) Oct 25 13:24:36.513144 dv-cinder-862432-2-smb devstack@keystone.service[81363]: Oct 25 13:24:36.516852 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ab20a9-e17c-4e4f-b3da-74611963a934 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:36.712848 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-76ab20a9-e17c-4e4f-b3da-74611963a934 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0b993151f084e5f83c6aa17335dffd8', 'request_id': 'req-76ab20a9-e17c-4e4f-b3da-74611963a934'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:36.774433 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-76ab20a9-e17c-4e4f-b3da-74611963a934 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0b993151f084e5f83c6aa17335dffd8', 'request_id': 'req-76ab20a9-e17c-4e4f-b3da-74611963a934'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:36.800393 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-76ab20a9-e17c-4e4f-b3da-74611963a934 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0b993151f084e5f83c6aa17335dffd8', 'request_id': 'req-76ab20a9-e17c-4e4f-b3da-74611963a934'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:36.818356 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-76ab20a9-e17c-4e4f-b3da-74611963a934 admin admin] The token cache is being invalidate because project b0b993151f084e5f83c6aa17335dffd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:24:36.818871 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-76ab20a9-e17c-4e4f-b3da-74611963a934 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:36.820819 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-76ab20a9-e17c-4e4f-b3da-74611963a934 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:36.825598 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 648/1322] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:24:36 2022] DELETE /identity/v3/projects/b0b993151f084e5f83c6aa17335dffd8 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:24:36.836520 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423ea1f-2f3c-4c6a-981e-f93a84b0f9f9 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:36.837943 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423ea1f-2f3c-4c6a-981e-f93a84b0f9f9 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:36.838375 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423ea1f-2f3c-4c6a-981e-f93a84b0f9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:36.842251 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab20a9-e17c-4e4f-b3da-74611963a934 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:36.850618 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-76ab20a9-e17c-4e4f-b3da-74611963a934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:36.876962 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e423ea1f-2f3c-4c6a-981e-f93a84b0f9f9 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:36.880917 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e423ea1f-2f3c-4c6a-981e-f93a84b0f9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:37.006003 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:37.072551 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab20a9-e17c-4e4f-b3da-74611963a934 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:37.087310 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d83dc5-2ef2-468e-a684-0ec4042363d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:37.090055 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d83dc5-2ef2-468e-a684-0ec4042363d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:37.090363 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d83dc5-2ef2-468e-a684-0ec4042363d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:37.090649 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d83dc5-2ef2-468e-a684-0ec4042363d0 admin admin] PATH_INFO: `/v3/users/187c9634d99647f58fa8776aeb9c663e` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:37.097205 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d83dc5-2ef2-468e-a684-0ec4042363d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=187c9634d99647f58fa8776aeb9c663e)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:37.099216 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d83dc5-2ef2-468e-a684-0ec4042363d0 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:37.102047 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 675/1323] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:37.102730 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423ea1f-2f3c-4c6a-981e-f93a84b0f9f9 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:37.104204 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e423ea1f-2f3c-4c6a-981e-f93a84b0f9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:37.134608 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423ea1f-2f3c-4c6a-981e-f93a84b0f9f9 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:37.152603 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2aca26-4a39-4ef8-95b7-f2bb2960c19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:37.153326 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2aca26-4a39-4ef8-95b7-f2bb2960c19b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:37.154736 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2aca26-4a39-4ef8-95b7-f2bb2960c19b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:37.154736 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2aca26-4a39-4ef8-95b7-f2bb2960c19b admin admin] PATH_INFO: `/v3/projects/f88f8a0acc9e40b09a621e4312589f19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:37.156915 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2aca26-4a39-4ef8-95b7-f2bb2960c19b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f88f8a0acc9e40b09a621e4312589f19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:37.162510 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2aca26-4a39-4ef8-95b7-f2bb2960c19b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:37.232065 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-17d83dc5-2ef2-468e-a684-0ec4042363d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '187c9634d99647f58fa8776aeb9c663e'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:37.276304 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-17d83dc5-2ef2-468e-a684-0ec4042363d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '187c9634d99647f58fa8776aeb9c663e'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:37.279888 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-17d83dc5-2ef2-468e-a684-0ec4042363d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '187c9634d99647f58fa8776aeb9c663e'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:37.305229 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-17d83dc5-2ef2-468e-a684-0ec4042363d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '187c9634d99647f58fa8776aeb9c663e'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:37.306460 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-17d83dc5-2ef2-468e-a684-0ec4042363d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '187c9634d99647f58fa8776aeb9c663e'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:37.312197 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:37.352791 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 649/1324] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:24:36 2022] DELETE /identity/v3/users/187c9634d99647f58fa8776aeb9c663e => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:24:37.354892 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77014d41-eb36-4b6a-8758-dfbd02f88e59 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:37.357328 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77014d41-eb36-4b6a-8758-dfbd02f88e59 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:37.359523 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77014d41-eb36-4b6a-8758-dfbd02f88e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:37.387336 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8a2aca26-4a39-4ef8-95b7-f2bb2960c19b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f88f8a0acc9e40b09a621e4312589f19', 'request_id': 'req-8a2aca26-4a39-4ef8-95b7-f2bb2960c19b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:37.413048 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-77014d41-eb36-4b6a-8758-dfbd02f88e59 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:37.415778 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8a2aca26-4a39-4ef8-95b7-f2bb2960c19b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f88f8a0acc9e40b09a621e4312589f19', 'request_id': 'req-8a2aca26-4a39-4ef8-95b7-f2bb2960c19b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:37.416423 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-77014d41-eb36-4b6a-8758-dfbd02f88e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:37.428425 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8a2aca26-4a39-4ef8-95b7-f2bb2960c19b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f88f8a0acc9e40b09a621e4312589f19', 'request_id': 'req-8a2aca26-4a39-4ef8-95b7-f2bb2960c19b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:37.470341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8a2aca26-4a39-4ef8-95b7-f2bb2960c19b admin admin] The token cache is being invalidate because project f88f8a0acc9e40b09a621e4312589f19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:24:37.471767 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8a2aca26-4a39-4ef8-95b7-f2bb2960c19b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:37.474447 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8a2aca26-4a39-4ef8-95b7-f2bb2960c19b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:37.481206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 676/1325] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:24:37 2022] DELETE /identity/v3/projects/f88f8a0acc9e40b09a621e4312589f19 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:24:37.482427 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0603f-3835-49a2-aa51-67a0adad67d3 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:37.482819 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0603f-3835-49a2-aa51-67a0adad67d3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:37.483219 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0603f-3835-49a2-aa51-67a0adad67d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:37.600182 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 650/1326] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:37.601503 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77014d41-eb36-4b6a-8758-dfbd02f88e59 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:37.611031 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-5fa0603f-3835-49a2-aa51-67a0adad67d3 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:37.612992 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-77014d41-eb36-4b6a-8758-dfbd02f88e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:37.616251 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5fa0603f-3835-49a2-aa51-67a0adad67d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:37.641128 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 677/1327] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:37.642277 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77014d41-eb36-4b6a-8758-dfbd02f88e59 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:37.649500 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0603f-3835-49a2-aa51-67a0adad67d3 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:37.656789 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f194e4-3cc2-4fc4-9e23-ec421a65655f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:37.657955 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f194e4-3cc2-4fc4-9e23-ec421a65655f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:37.658850 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f194e4-3cc2-4fc4-9e23-ec421a65655f admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:37.659295 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f194e4-3cc2-4fc4-9e23-ec421a65655f admin admin] PATH_INFO: `/v3/users/2ce3cc8751a7432c9d85e7a643a12256` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:37.663450 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f194e4-3cc2-4fc4-9e23-ec421a65655f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ce3cc8751a7432c9d85e7a643a12256)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:37.669882 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f194e4-3cc2-4fc4-9e23-ec421a65655f admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:37.701613 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0603f-3835-49a2-aa51-67a0adad67d3 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:37.721569 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f4821-1cc1-48f4-bc02-d3c2ab2163ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:37.723576 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f4821-1cc1-48f4-bc02-d3c2ab2163ec admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:37.723576 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f4821-1cc1-48f4-bc02-d3c2ab2163ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:37.723576 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f4821-1cc1-48f4-bc02-d3c2ab2163ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:37.724495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f4821-1cc1-48f4-bc02-d3c2ab2163ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:24:37.727298 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f4821-1cc1-48f4-bc02-d3c2ab2163ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:37.729044 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f4821-1cc1-48f4-bc02-d3c2ab2163ec admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:37.757818 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 678/1328] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:24:37.760465 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f4821-1cc1-48f4-bc02-d3c2ab2163ec admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:37.766491 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-662f4821-1cc1-48f4-bc02-d3c2ab2163ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:37.797369 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-63f194e4-3cc2-4fc4-9e23-ec421a65655f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ce3cc8751a7432c9d85e7a643a12256'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:37.829957 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-63f194e4-3cc2-4fc4-9e23-ec421a65655f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ce3cc8751a7432c9d85e7a643a12256'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:37.834430 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-63f194e4-3cc2-4fc4-9e23-ec421a65655f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ce3cc8751a7432c9d85e7a643a12256'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:37.865670 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-63f194e4-3cc2-4fc4-9e23-ec421a65655f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ce3cc8751a7432c9d85e7a643a12256'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:37.866729 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-63f194e4-3cc2-4fc4-9e23-ec421a65655f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ce3cc8751a7432c9d85e7a643a12256'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:37.894632 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 651/1329] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:24:37 2022] DELETE /identity/v3/users/2ce3cc8751a7432c9d85e7a643a12256 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:24:37.895553 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f194e4-3cc2-4fc4-9e23-ec421a65655f admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:37.900378 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-63f194e4-3cc2-4fc4-9e23-ec421a65655f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:37.919000 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f4821-1cc1-48f4-bc02-d3c2ab2163ec admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:38.015845 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4daf66-cc08-49c3-8e22-5d332f06e884 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:38.019727 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4daf66-cc08-49c3-8e22-5d332f06e884 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:38.020209 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4daf66-cc08-49c3-8e22-5d332f06e884 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:38.022519 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4daf66-cc08-49c3-8e22-5d332f06e884 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:38.026874 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ee4daf66-cc08-49c3-8e22-5d332f06e884 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:38.059592 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:38.071157 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f194e4-3cc2-4fc4-9e23-ec421a65655f admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:38.089608 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163394f7-21a6-4679-ac29-dbaf49347854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:38.090375 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163394f7-21a6-4679-ac29-dbaf49347854 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:38.090586 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163394f7-21a6-4679-ac29-dbaf49347854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:38.090840 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163394f7-21a6-4679-ac29-dbaf49347854 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:38.091553 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163394f7-21a6-4679-ac29-dbaf49347854 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:38.093446 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163394f7-21a6-4679-ac29-dbaf49347854 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:38.109924 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:38.176430 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 652/1330] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:24:37 2022] POST /identity/v3/projects => generated 371 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:24:38.177418 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163394f7-21a6-4679-ac29-dbaf49347854 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:38.227773 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4daf66-cc08-49c3-8e22-5d332f06e884 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:38.233226 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4daf66-cc08-49c3-8e22-5d332f06e884 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:38.253510 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 679/1331] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:24:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:24:38.314352 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163394f7-21a6-4679-ac29-dbaf49347854 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:38.326464 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0de6f9-8264-445d-a5b8-5c6f131d271f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:38.327101 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0de6f9-8264-445d-a5b8-5c6f131d271f admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:38.327384 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0de6f9-8264-445d-a5b8-5c6f131d271f admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:38.327665 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0de6f9-8264-445d-a5b8-5c6f131d271f admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:38.328482 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0de6f9-8264-445d-a5b8-5c6f131d271f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:38.330518 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0de6f9-8264-445d-a5b8-5c6f131d271f admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:38.384462 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 653/1332] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:24:38 2022] POST /identity/v3/users => generated 286 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:24:38.389387 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4daf66-cc08-49c3-8e22-5d332f06e884 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:38.405097 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4daf66-cc08-49c3-8e22-5d332f06e884 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:38.415756 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bf760-9008-417f-8b19-5a488ac2fd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:38.416425 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bf760-9008-417f-8b19-5a488ac2fd07 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:38.416705 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bf760-9008-417f-8b19-5a488ac2fd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:38.416978 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bf760-9008-417f-8b19-5a488ac2fd07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:38.419205 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3bf760-9008-417f-8b19-5a488ac2fd07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:38.420922 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3bf760-9008-417f-8b19-5a488ac2fd07 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:38.458054 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 680/1333] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:24:38.459374 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0de6f9-8264-445d-a5b8-5c6f131d271f admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:38.473942 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0de6f9-8264-445d-a5b8-5c6f131d271f admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:38.498129 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46197a2f-9179-4cdb-a171-b86a4b2bc216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:38.498844 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46197a2f-9179-4cdb-a171-b86a4b2bc216 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:38.499127 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46197a2f-9179-4cdb-a171-b86a4b2bc216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:38.499405 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46197a2f-9179-4cdb-a171-b86a4b2bc216 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:38.513892 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46197a2f-9179-4cdb-a171-b86a4b2bc216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:38.516170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46197a2f-9179-4cdb-a171-b86a4b2bc216 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:38.533195 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 654/1334] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:24:38.537825 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bf760-9008-417f-8b19-5a488ac2fd07 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:38.548720 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bf760-9008-417f-8b19-5a488ac2fd07 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:38.554223 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47444b0-8a9d-4af6-86e0-5e6f63ce6f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:38.555293 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47444b0-8a9d-4af6-86e0-5e6f63ce6f24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:38.555611 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47444b0-8a9d-4af6-86e0-5e6f63ce6f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:38.555856 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47444b0-8a9d-4af6-86e0-5e6f63ce6f24 admin admin] PATH_INFO: `/v3/projects/d740be8db8e9429f9dff20de82e62971/users/a0d6447565f640b8a67d33bf9ae114f3/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:38.599324 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47444b0-8a9d-4af6-86e0-5e6f63ce6f24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d740be8db8e9429f9dff20de82e62971, user_id=a0d6447565f640b8a67d33bf9ae114f3, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:38.606677 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47444b0-8a9d-4af6-86e0-5e6f63ce6f24 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:38.637875 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 681/1335] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:24:38 2022] PUT /identity/v3/projects/d740be8db8e9429f9dff20de82e62971/users/a0d6447565f640b8a67d33bf9ae114f3/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:24:38.650647 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0c1fe-6dce-4f96-89ba-95193bb18bc3 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:38.650935 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0c1fe-6dce-4f96-89ba-95193bb18bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:38.651218 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0c1fe-6dce-4f96-89ba-95193bb18bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:38.698266 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-6ef0c1fe-6dce-4f96-89ba-95193bb18bc3 None None] MFA Rules not processed for user `a0d6447565f640b8a67d33bf9ae114f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:38.700281 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-6ef0c1fe-6dce-4f96-89ba-95193bb18bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:38.889551 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 655/1336] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:38.898656 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47444b0-8a9d-4af6-86e0-5e6f63ce6f24 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:38.901007 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f47444b0-8a9d-4af6-86e0-5e6f63ce6f24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:39.119723 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47444b0-8a9d-4af6-86e0-5e6f63ce6f24 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:39.132630 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe19916-cf01-406d-8e2a-2903cb68b8cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:39.132904 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe19916-cf01-406d-8e2a-2903cb68b8cd service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:39.133375 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe19916-cf01-406d-8e2a-2903cb68b8cd service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:39.133707 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe19916-cf01-406d-8e2a-2903cb68b8cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:39.154158 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe19916-cf01-406d-8e2a-2903cb68b8cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:39.155939 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe19916-cf01-406d-8e2a-2903cb68b8cd service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:39.174163 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 682/1337] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:24:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:24:39.346401 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0c1fe-6dce-4f96-89ba-95193bb18bc3 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:39.348088 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-6ef0c1fe-6dce-4f96-89ba-95193bb18bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:39.504824 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0c1fe-6dce-4f96-89ba-95193bb18bc3 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:39.507769 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:39.512943 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a3893-9822-4562-8e57-e47ecafdcd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:39.513915 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a3893-9822-4562-8e57-e47ecafdcd05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:39.514491 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a3893-9822-4562-8e57-e47ecafdcd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:39.515039 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a3893-9822-4562-8e57-e47ecafdcd05 admin admin] PATH_INFO: `/v3/projects/05d3462d306747d4823e6a663a066f41` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:39.524982 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8a3893-9822-4562-8e57-e47ecafdcd05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05d3462d306747d4823e6a663a066f41)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:39.527862 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8a3893-9822-4562-8e57-e47ecafdcd05 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:39.550481 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe19916-cf01-406d-8e2a-2903cb68b8cd service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:39.566347 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe19916-cf01-406d-8e2a-2903cb68b8cd service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:39.580247 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64985edf-6bb7-4d76-9619-3dece3ebf953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:39.581027 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64985edf-6bb7-4d76-9619-3dece3ebf953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:39.581381 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64985edf-6bb7-4d76-9619-3dece3ebf953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:39.581724 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64985edf-6bb7-4d76-9619-3dece3ebf953 admin admin] PATH_INFO: `/v3/users/a0d6447565f640b8a67d33bf9ae114f3` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:39.583790 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64985edf-6bb7-4d76-9619-3dece3ebf953 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0d6447565f640b8a67d33bf9ae114f3)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:39.587289 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64985edf-6bb7-4d76-9619-3dece3ebf953 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:39.661997 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2a8a3893-9822-4562-8e57-e47ecafdcd05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05d3462d306747d4823e6a663a066f41', 'request_id': 'req-2a8a3893-9822-4562-8e57-e47ecafdcd05'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:39.675273 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2a8a3893-9822-4562-8e57-e47ecafdcd05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05d3462d306747d4823e6a663a066f41', 'request_id': 'req-2a8a3893-9822-4562-8e57-e47ecafdcd05'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:39.685957 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2a8a3893-9822-4562-8e57-e47ecafdcd05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05d3462d306747d4823e6a663a066f41', 'request_id': 'req-2a8a3893-9822-4562-8e57-e47ecafdcd05'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:39.711988 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2a8a3893-9822-4562-8e57-e47ecafdcd05 admin admin] The token cache is being invalidate because project 05d3462d306747d4823e6a663a066f41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:24:39.712276 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2a8a3893-9822-4562-8e57-e47ecafdcd05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:39.713328 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2a8a3893-9822-4562-8e57-e47ecafdcd05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:39.722224 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-64985edf-6bb7-4d76-9619-3dece3ebf953 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0d6447565f640b8a67d33bf9ae114f3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:39.722224 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-64985edf-6bb7-4d76-9619-3dece3ebf953 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0d6447565f640b8a67d33bf9ae114f3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:39.729241 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:39.736947 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 656/1338] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:24:39 2022] DELETE /identity/v3/projects/05d3462d306747d4823e6a663a066f41 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:24:39.739989 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a3893-9822-4562-8e57-e47ecafdcd05 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:39.741921 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2a8a3893-9822-4562-8e57-e47ecafdcd05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:39.749792 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-64985edf-6bb7-4d76-9619-3dece3ebf953 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0d6447565f640b8a67d33bf9ae114f3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:39.766904 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-64985edf-6bb7-4d76-9619-3dece3ebf953 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0d6447565f640b8a67d33bf9ae114f3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:39.781423 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-64985edf-6bb7-4d76-9619-3dece3ebf953 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0d6447565f640b8a67d33bf9ae114f3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:39.794860 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 683/1339] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:24:39 2022] DELETE /identity/v3/users/a0d6447565f640b8a67d33bf9ae114f3 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:24:39.797165 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d852b3-c9b4-497a-b939-196cfc192ce7 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:39.797587 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d852b3-c9b4-497a-b939-196cfc192ce7 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:39.797961 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d852b3-c9b4-497a-b939-196cfc192ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:39.847367 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-67d852b3-c9b4-497a-b939-196cfc192ce7 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:39.848799 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-67d852b3-c9b4-497a-b939-196cfc192ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:39.886768 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a3893-9822-4562-8e57-e47ecafdcd05 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:40.040240 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 684/1340] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:40.040240 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0271a80-06dd-400d-8a42-b345e6453ee5 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:40.041176 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0271a80-06dd-400d-8a42-b345e6453ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:40.044723 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0271a80-06dd-400d-8a42-b345e6453ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:40.048328 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d0911-3d25-437d-a358-f9fccda79e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:40.050254 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d0911-3d25-437d-a358-f9fccda79e0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:40.050636 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d0911-3d25-437d-a358-f9fccda79e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:40.051037 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d0911-3d25-437d-a358-f9fccda79e0d admin admin] PATH_INFO: `/v3/projects/c8f04f76371346c7a7b702f4b376f486` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:40.053624 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d0911-3d25-437d-a358-f9fccda79e0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8f04f76371346c7a7b702f4b376f486)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:40.057310 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d0911-3d25-437d-a358-f9fccda79e0d admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:40.124022 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f0271a80-06dd-400d-8a42-b345e6453ee5 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:40.132137 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:40.133363 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f0271a80-06dd-400d-8a42-b345e6453ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:40.149086 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f68d0911-3d25-437d-a358-f9fccda79e0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8f04f76371346c7a7b702f4b376f486', 'request_id': 'req-f68d0911-3d25-437d-a358-f9fccda79e0d'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:40.158798 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f68d0911-3d25-437d-a358-f9fccda79e0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8f04f76371346c7a7b702f4b376f486', 'request_id': 'req-f68d0911-3d25-437d-a358-f9fccda79e0d'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:40.172717 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f68d0911-3d25-437d-a358-f9fccda79e0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8f04f76371346c7a7b702f4b376f486', 'request_id': 'req-f68d0911-3d25-437d-a358-f9fccda79e0d'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:40.218332 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f68d0911-3d25-437d-a358-f9fccda79e0d admin admin] The token cache is being invalidate because project c8f04f76371346c7a7b702f4b376f486 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:24:40.219079 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f68d0911-3d25-437d-a358-f9fccda79e0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:40.223926 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f68d0911-3d25-437d-a358-f9fccda79e0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:40.229230 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 657/1341] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:24:39 2022] DELETE /identity/v3/projects/c8f04f76371346c7a7b702f4b376f486 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:24:40.237260 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b93dd6-2732-4c00-bc7a-a43ba879182e None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:40.239114 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b93dd6-2732-4c00-bc7a-a43ba879182e None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:40.240999 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b93dd6-2732-4c00-bc7a-a43ba879182e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:40.282733 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 685/1342] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:40.284437 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3d729-9c1d-44c2-a31c-835bfd4d4b23 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:40.284726 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3d729-9c1d-44c2-a31c-835bfd4d4b23 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:40.285003 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3d729-9c1d-44c2-a31c-835bfd4d4b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:40.298942 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-d7b93dd6-2732-4c00-bc7a-a43ba879182e None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:40.302705 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-d7b93dd6-2732-4c00-bc7a-a43ba879182e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:40.325091 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 658/1343] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:40.332211 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b93dd6-2732-4c00-bc7a-a43ba879182e None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:40.332676 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-8fd3d729-9c1d-44c2-a31c-835bfd4d4b23 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:40.334336 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8fd3d729-9c1d-44c2-a31c-835bfd4d4b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:40.336257 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-d7b93dd6-2732-4c00-bc7a-a43ba879182e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:40.362728 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 686/1344] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:40.363751 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3d729-9c1d-44c2-a31c-835bfd4d4b23 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:40.384822 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3d729-9c1d-44c2-a31c-835bfd4d4b23 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:40.396599 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11477d53-1c4d-4951-81a7-8ff82a2e8f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:40.397235 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11477d53-1c4d-4951-81a7-8ff82a2e8f8b admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:40.397521 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11477d53-1c4d-4951-81a7-8ff82a2e8f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:40.397799 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11477d53-1c4d-4951-81a7-8ff82a2e8f8b admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:40.398565 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11477d53-1c4d-4951-81a7-8ff82a2e8f8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:24:40.399035 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11477d53-1c4d-4951-81a7-8ff82a2e8f8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:40.400717 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11477d53-1c4d-4951-81a7-8ff82a2e8f8b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:40.434209 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 687/1345] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:24:40.438384 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c75918-7dc9-4066-aca4-2291db75ca24 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:40.439340 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c75918-7dc9-4066-aca4-2291db75ca24 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:40.440642 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c75918-7dc9-4066-aca4-2291db75ca24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:40.471171 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b93dd6-2732-4c00-bc7a-a43ba879182e None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:40.480351 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-33c75918-7dc9-4066-aca4-2291db75ca24 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:40.481608 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-33c75918-7dc9-4066-aca4-2291db75ca24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:40.484374 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4562e-85ed-41ae-bec9-f9fc782702a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:40.487022 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4562e-85ed-41ae-bec9-f9fc782702a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:40.487022 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4562e-85ed-41ae-bec9-f9fc782702a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:40.487022 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4562e-85ed-41ae-bec9-f9fc782702a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:40.505958 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 688/1346] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:40.510546 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa4562e-85ed-41ae-bec9-f9fc782702a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:40.512063 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa4562e-85ed-41ae-bec9-f9fc782702a7 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:40.513471 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c75918-7dc9-4066-aca4-2291db75ca24 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:40.535543 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c75918-7dc9-4066-aca4-2291db75ca24 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:40.544389 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 659/1347] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:24:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:24:40.547085 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4562e-85ed-41ae-bec9-f9fc782702a7 service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:40.553670 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea10fea-9aca-4458-a09e-654cfb6414c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:40.554227 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea10fea-9aca-4458-a09e-654cfb6414c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:40.554507 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea10fea-9aca-4458-a09e-654cfb6414c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:40.554938 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea10fea-9aca-4458-a09e-654cfb6414c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:40.555960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea10fea-9aca-4458-a09e-654cfb6414c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:40.560958 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea10fea-9aca-4458-a09e-654cfb6414c2 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:40.570514 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4562e-85ed-41ae-bec9-f9fc782702a7 service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:40.584204 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f492660-3fb5-4f70-9f5e-cc3e139c9205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:40.585562 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f492660-3fb5-4f70-9f5e-cc3e139c9205 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:40.585562 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f492660-3fb5-4f70-9f5e-cc3e139c9205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:40.585759 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f492660-3fb5-4f70-9f5e-cc3e139c9205 admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:40.588916 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f492660-3fb5-4f70-9f5e-cc3e139c9205 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:24:40.589341 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f492660-3fb5-4f70-9f5e-cc3e139c9205 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:40.591017 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f492660-3fb5-4f70-9f5e-cc3e139c9205 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:40.627928 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 660/1348] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:24:40.632224 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 689/1349] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:24:40 2022] POST /identity/v3/projects => generated 367 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:24:40.632436 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f492660-3fb5-4f70-9f5e-cc3e139c9205 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:40.637316 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea10fea-9aca-4458-a09e-654cfb6414c2 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:40.658565 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f492660-3fb5-4f70-9f5e-cc3e139c9205 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:40.692055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:40.846260 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea10fea-9aca-4458-a09e-654cfb6414c2 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:40.849130 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be40a4-f2c7-4e29-9610-912d49c9b765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:40.850265 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be40a4-f2c7-4e29-9610-912d49c9b765 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:40.852437 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be40a4-f2c7-4e29-9610-912d49c9b765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:40.852866 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be40a4-f2c7-4e29-9610-912d49c9b765 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:40.854243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be40a4-f2c7-4e29-9610-912d49c9b765 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:40.855972 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7841e-f80c-4f8f-800a-88804c0084d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:40.856604 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7841e-f80c-4f8f-800a-88804c0084d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:40.856882 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7841e-f80c-4f8f-800a-88804c0084d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:40.857256 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7841e-f80c-4f8f-800a-88804c0084d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:40.857776 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a7841e-f80c-4f8f-800a-88804c0084d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:40.859696 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a7841e-f80c-4f8f-800a-88804c0084d5 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:40.862312 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be40a4-f2c7-4e29-9610-912d49c9b765 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:40.938445 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 690/1350] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:24:40 2022] POST /identity/v3/users => generated 284 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:24:40.942748 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440dcad-e977-4963-8245-6d4f626ba3e4 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:40.943039 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440dcad-e977-4963-8245-6d4f626ba3e4 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:40.943329 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440dcad-e977-4963-8245-6d4f626ba3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:40.958514 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 661/1351] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:24:40 2022] POST /identity/v3/projects => generated 365 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:24:40.959542 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be40a4-f2c7-4e29-9610-912d49c9b765 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:41.028604 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-3440dcad-e977-4963-8245-6d4f626ba3e4 None None] MFA Rules not processed for user `b59b96a78db44099838e00f6614052bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:41.031226 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3440dcad-e977-4963-8245-6d4f626ba3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:41.057808 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:41.132827 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be40a4-f2c7-4e29-9610-912d49c9b765 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:41.150249 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a11c94-2bc6-43a1-a940-a8379e1c9fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:41.151148 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a11c94-2bc6-43a1-a940-a8379e1c9fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:41.151574 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a11c94-2bc6-43a1-a940-a8379e1c9fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:41.151850 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a11c94-2bc6-43a1-a940-a8379e1c9fc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:41.165468 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a11c94-2bc6-43a1-a940-a8379e1c9fc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:41.171524 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a11c94-2bc6-43a1-a940-a8379e1c9fc5 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:41.209256 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 662/1352] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:24:41.210838 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a11c94-2bc6-43a1-a940-a8379e1c9fc5 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:41.244819 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 691/1353] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:41.245825 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440dcad-e977-4963-8245-6d4f626ba3e4 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:41.248673 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a11c94-2bc6-43a1-a940-a8379e1c9fc5 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:41.259778 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440dcad-e977-4963-8245-6d4f626ba3e4 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:41.263161 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccef864-d451-46b8-a01b-ea7581460628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:41.264112 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccef864-d451-46b8-a01b-ea7581460628 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:41.264821 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccef864-d451-46b8-a01b-ea7581460628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:41.264951 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31277a79-7c8e-4782-9608-687e2f1923c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:41.265491 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31277a79-7c8e-4782-9608-687e2f1923c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:41.265776 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31277a79-7c8e-4782-9608-687e2f1923c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:41.266055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31277a79-7c8e-4782-9608-687e2f1923c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:41.266773 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31277a79-7c8e-4782-9608-687e2f1923c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:41.267321 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccef864-d451-46b8-a01b-ea7581460628 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:41.268228 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccef864-d451-46b8-a01b-ea7581460628 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:41.268481 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31277a79-7c8e-4782-9608-687e2f1923c0 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:41.270618 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccef864-d451-46b8-a01b-ea7581460628 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:41.280750 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 692/1354] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:24:41.281924 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31277a79-7c8e-4782-9608-687e2f1923c0 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:41.286813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-31277a79-7c8e-4782-9608-687e2f1923c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:41.324347 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 663/1355] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:24:41 2022] POST /identity/v3/users => generated 283 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:24:41.325609 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccef864-d451-46b8-a01b-ea7581460628 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:41.337834 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccef864-d451-46b8-a01b-ea7581460628 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:41.343430 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc25c22-4098-4959-93a5-e7ed2941c9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:41.344555 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc25c22-4098-4959-93a5-e7ed2941c9b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:41.345800 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc25c22-4098-4959-93a5-e7ed2941c9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:41.346485 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc25c22-4098-4959-93a5-e7ed2941c9b1 admin admin] PATH_INFO: `/v3/projects/4637352743a94d09bae9edda48820e6d/users/44783460e67541cc85745bf9de2b7e6f/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:41.370663 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc25c22-4098-4959-93a5-e7ed2941c9b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4637352743a94d09bae9edda48820e6d, user_id=44783460e67541cc85745bf9de2b7e6f, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:41.379015 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc25c22-4098-4959-93a5-e7ed2941c9b1 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:41.410617 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 664/1356] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:24:41 2022] PUT /identity/v3/projects/4637352743a94d09bae9edda48820e6d/users/44783460e67541cc85745bf9de2b7e6f/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:24:41.411795 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc25c22-4098-4959-93a5-e7ed2941c9b1 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:41.456596 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31277a79-7c8e-4782-9608-687e2f1923c0 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:41.512118 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:41.547541 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc25c22-4098-4959-93a5-e7ed2941c9b1 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:41.554398 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc598891-7406-4a26-85f2-f88f214e3397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:41.555361 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc598891-7406-4a26-85f2-f88f214e3397 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:41.555674 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc598891-7406-4a26-85f2-f88f214e3397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:41.555999 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc598891-7406-4a26-85f2-f88f214e3397 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:41.556659 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc598891-7406-4a26-85f2-f88f214e3397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:41.558295 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc598891-7406-4a26-85f2-f88f214e3397 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:41.575591 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 665/1357] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:24:41.577382 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b56f9-b388-419a-b1d9-9f1b5d7158aa None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:41.577679 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b56f9-b388-419a-b1d9-9f1b5d7158aa None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:41.577955 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b56f9-b388-419a-b1d9-9f1b5d7158aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:41.609020 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797f47f-3c10-462c-a641-3a4ef2276eb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:41.610014 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797f47f-3c10-462c-a641-3a4ef2276eb2 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:41.611103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797f47f-3c10-462c-a641-3a4ef2276eb2 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:41.611538 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797f47f-3c10-462c-a641-3a4ef2276eb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:41.619055 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-a71b56f9-b388-419a-b1d9-9f1b5d7158aa None None] MFA Rules not processed for user `44783460e67541cc85745bf9de2b7e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:41.620628 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a71b56f9-b388-419a-b1d9-9f1b5d7158aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:41.732766 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 666/1358] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:41.733941 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b56f9-b388-419a-b1d9-9f1b5d7158aa None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:41.753571 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4797f47f-3c10-462c-a641-3a4ef2276eb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:41.755341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4797f47f-3c10-462c-a641-3a4ef2276eb2 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:41.760221 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b56f9-b388-419a-b1d9-9f1b5d7158aa None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:41.766216 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a81e8-d61a-4c1b-aa82-68aaf5b6ee57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:41.767380 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a81e8-d61a-4c1b-aa82-68aaf5b6ee57 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:41.767837 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a81e8-d61a-4c1b-aa82-68aaf5b6ee57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:41.768832 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a81e8-d61a-4c1b-aa82-68aaf5b6ee57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:41.770203 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a81e8-d61a-4c1b-aa82-68aaf5b6ee57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:41.772803 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a81e8-d61a-4c1b-aa82-68aaf5b6ee57 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:41.781164 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 693/1359] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:24:41 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:24:41.793968 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 667/1360] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:24:41.794185 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797f47f-3c10-462c-a641-3a4ef2276eb2 service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:41.795465 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a81e8-d61a-4c1b-aa82-68aaf5b6ee57 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:41.799871 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4797f47f-3c10-462c-a641-3a4ef2276eb2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:41.803329 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:41.812213 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a81e8-d61a-4c1b-aa82-68aaf5b6ee57 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:41.820373 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c4486-df6e-41c8-8f19-9ed7b9d40f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:41.822185 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c4486-df6e-41c8-8f19-9ed7b9d40f2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:41.824607 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c4486-df6e-41c8-8f19-9ed7b9d40f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:41.825236 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c4486-df6e-41c8-8f19-9ed7b9d40f2d admin admin] PATH_INFO: `/v3/projects/89b675737fc64516b571e7ca6415ab8e/users/788c10a9f5e84217a7eeea1cd9ec5498/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:41.846544 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c4486-df6e-41c8-8f19-9ed7b9d40f2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=89b675737fc64516b571e7ca6415ab8e, user_id=788c10a9f5e84217a7eeea1cd9ec5498, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:41.850866 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c4486-df6e-41c8-8f19-9ed7b9d40f2d admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:41.896940 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 668/1361] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:24:41 2022] PUT /identity/v3/projects/89b675737fc64516b571e7ca6415ab8e/users/788c10a9f5e84217a7eeea1cd9ec5498/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:24:41.899930 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338b936-38d2-4c9b-8a96-051998339b6e None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:41.900507 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338b936-38d2-4c9b-8a96-051998339b6e None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:41.901774 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338b936-38d2-4c9b-8a96-051998339b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:41.982781 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-4338b936-38d2-4c9b-8a96-051998339b6e None None] MFA Rules not processed for user `788c10a9f5e84217a7eeea1cd9ec5498`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:41.983003 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797f47f-3c10-462c-a641-3a4ef2276eb2 service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:41.984206 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-4338b936-38d2-4c9b-8a96-051998339b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:42.116654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64edb3f1-2bb2-4ac5-b557-b34629864f75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:42.117301 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64edb3f1-2bb2-4ac5-b557-b34629864f75 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:42.117773 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64edb3f1-2bb2-4ac5-b557-b34629864f75 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:42.118052 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64edb3f1-2bb2-4ac5-b557-b34629864f75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:42.120031 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 669/1362] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:42.121579 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338b936-38d2-4c9b-8a96-051998339b6e None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:42.198508 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:42.256096 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338b936-38d2-4c9b-8a96-051998339b6e None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:42.262236 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64edb3f1-2bb2-4ac5-b557-b34629864f75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:42.264228 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64edb3f1-2bb2-4ac5-b557-b34629864f75 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:42.271838 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde67ca-eb25-4860-970f-b9afb804acdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:42.273593 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde67ca-eb25-4860-970f-b9afb804acdb admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:42.274008 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde67ca-eb25-4860-970f-b9afb804acdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:42.276254 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde67ca-eb25-4860-970f-b9afb804acdb admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:42.277827 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde67ca-eb25-4860-970f-b9afb804acdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:42.280748 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 694/1363] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:24:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:24:42.281757 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64edb3f1-2bb2-4ac5-b557-b34629864f75 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:42.283994 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-64edb3f1-2bb2-4ac5-b557-b34629864f75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:42.297597 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde67ca-eb25-4860-970f-b9afb804acdb admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:42.306645 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64edb3f1-2bb2-4ac5-b557-b34629864f75 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:42.315147 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4975eb-4697-49aa-b571-c9df4d98349b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:42.316009 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4975eb-4697-49aa-b571-c9df4d98349b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:42.316394 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4975eb-4697-49aa-b571-c9df4d98349b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:42.316771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4975eb-4697-49aa-b571-c9df4d98349b admin admin] PATH_INFO: `/v3/projects/d740be8db8e9429f9dff20de82e62971` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:42.318051 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4975eb-4697-49aa-b571-c9df4d98349b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d740be8db8e9429f9dff20de82e62971)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:42.320111 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4975eb-4697-49aa-b571-c9df4d98349b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:42.410324 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 670/1364] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:24:42 2022] POST /identity/v3/projects => generated 365 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:24:42.415346 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde67ca-eb25-4860-970f-b9afb804acdb admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:42.416602 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-db4975eb-4697-49aa-b571-c9df4d98349b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd740be8db8e9429f9dff20de82e62971', 'request_id': 'req-db4975eb-4697-49aa-b571-c9df4d98349b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:42.442559 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-db4975eb-4697-49aa-b571-c9df4d98349b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd740be8db8e9429f9dff20de82e62971', 'request_id': 'req-db4975eb-4697-49aa-b571-c9df4d98349b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:42.467424 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-db4975eb-4697-49aa-b571-c9df4d98349b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd740be8db8e9429f9dff20de82e62971', 'request_id': 'req-db4975eb-4697-49aa-b571-c9df4d98349b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:42.490996 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:42.504066 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-db4975eb-4697-49aa-b571-c9df4d98349b admin admin] The token cache is being invalidate because project d740be8db8e9429f9dff20de82e62971 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:24:42.505966 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-db4975eb-4697-49aa-b571-c9df4d98349b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:42.509691 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde67ca-eb25-4860-970f-b9afb804acdb admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:42.510337 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-db4975eb-4697-49aa-b571-c9df4d98349b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:42.522235 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 695/1365] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:24:42 2022] DELETE /identity/v3/projects/d740be8db8e9429f9dff20de82e62971 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:24:42.522926 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7df4df-87cc-4056-9d91-1211b05b6fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:42.523808 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7df4df-87cc-4056-9d91-1211b05b6fbe admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:42.524417 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7df4df-87cc-4056-9d91-1211b05b6fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:42.524837 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7df4df-87cc-4056-9d91-1211b05b6fbe admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:42.526378 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7df4df-87cc-4056-9d91-1211b05b6fbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:42.528011 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf6689-7c84-4621-9828-15288b93589e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:42.528768 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf6689-7c84-4621-9828-15288b93589e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:42.529352 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7df4df-87cc-4056-9d91-1211b05b6fbe admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:42.529841 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf6689-7c84-4621-9828-15288b93589e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:42.570772 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 671/1366] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:24:42 2022] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:24:42.572482 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7df4df-87cc-4056-9d91-1211b05b6fbe admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:42.575424 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-cb7df4df-87cc-4056-9d91-1211b05b6fbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:42.581764 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-3daf6689-7c84-4621-9828-15288b93589e None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:42.585481 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3daf6689-7c84-4621-9828-15288b93589e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:42.596169 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7df4df-87cc-4056-9d91-1211b05b6fbe admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:42.603013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e64c7c-183d-468b-a72c-50086f3701c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:42.603790 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e64c7c-183d-468b-a72c-50086f3701c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:42.604929 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e64c7c-183d-468b-a72c-50086f3701c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:42.605605 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e64c7c-183d-468b-a72c-50086f3701c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:42.606723 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e64c7c-183d-468b-a72c-50086f3701c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:42.608771 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e64c7c-183d-468b-a72c-50086f3701c5 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:42.609830 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 696/1367] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:42.619125 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba617c-ba27-4a1b-8622-7e0c80789d23 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:42.619416 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba617c-ba27-4a1b-8622-7e0c80789d23 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:42.619689 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba617c-ba27-4a1b-8622-7e0c80789d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:42.635622 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 672/1368] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:24:42.636897 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e64c7c-183d-468b-a72c-50086f3701c5 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:42.653322 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e64c7c-183d-468b-a72c-50086f3701c5 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:42.667621 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eca507-7c56-42c8-bec6-a681cf451cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:42.668336 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eca507-7c56-42c8-bec6-a681cf451cda admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:42.668618 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eca507-7c56-42c8-bec6-a681cf451cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:42.668893 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eca507-7c56-42c8-bec6-a681cf451cda admin admin] PATH_INFO: `/v3/projects/33b4cba29c064c9f9049e18e55cadbb4/users/9e3c4207499c42f4b3d34f6c7d747dcb/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:42.672250 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-63ba617c-ba27-4a1b-8622-7e0c80789d23 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:42.677289 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-63ba617c-ba27-4a1b-8622-7e0c80789d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:42.694831 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eca507-7c56-42c8-bec6-a681cf451cda admin admin] RBAC: Authorizing `identity:create_grant(project_id=33b4cba29c064c9f9049e18e55cadbb4, user_id=9e3c4207499c42f4b3d34f6c7d747dcb, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:42.697863 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 697/1369] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:42.700669 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eca507-7c56-42c8-bec6-a681cf451cda admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:42.704303 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba617c-ba27-4a1b-8622-7e0c80789d23 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:42.728798 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba617c-ba27-4a1b-8622-7e0c80789d23 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:42.746213 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 673/1370] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:24:42 2022] PUT /identity/v3/projects/33b4cba29c064c9f9049e18e55cadbb4/users/9e3c4207499c42f4b3d34f6c7d747dcb/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:24:42.749217 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eca507-7c56-42c8-bec6-a681cf451cda admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:42.864841 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eca507-7c56-42c8-bec6-a681cf451cda admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:42.871830 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23277ce6-2de1-408c-b44c-8dc8becc7970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:42.873029 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23277ce6-2de1-408c-b44c-8dc8becc7970 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:42.874299 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23277ce6-2de1-408c-b44c-8dc8becc7970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:42.874584 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23277ce6-2de1-408c-b44c-8dc8becc7970 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:42.877569 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23277ce6-2de1-408c-b44c-8dc8becc7970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:42.877899 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23277ce6-2de1-408c-b44c-8dc8becc7970 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:42.903636 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 674/1371] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:24:42.904803 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23277ce6-2de1-408c-b44c-8dc8becc7970 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:42.906038 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd22e08-a961-4c07-af0f-09135e1d7cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:42.907390 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd22e08-a961-4c07-af0f-09135e1d7cea admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:42.908531 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd22e08-a961-4c07-af0f-09135e1d7cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:42.909644 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd22e08-a961-4c07-af0f-09135e1d7cea admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:42.910474 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd22e08-a961-4c07-af0f-09135e1d7cea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:24:42.910931 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd22e08-a961-4c07-af0f-09135e1d7cea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:42.917988 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd22e08-a961-4c07-af0f-09135e1d7cea admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:42.929079 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23277ce6-2de1-408c-b44c-8dc8becc7970 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:42.936194 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e63fc-9294-4dd7-86d5-f79e0a9520f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:42.939941 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e63fc-9294-4dd7-86d5-f79e0a9520f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:42.940243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e63fc-9294-4dd7-86d5-f79e0a9520f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:42.940754 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e63fc-9294-4dd7-86d5-f79e0a9520f3 admin admin] PATH_INFO: `/v3/projects/33b4cba29c064c9f9049e18e55cadbb4/users/9e3c4207499c42f4b3d34f6c7d747dcb/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:42.944865 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e63fc-9294-4dd7-86d5-f79e0a9520f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33b4cba29c064c9f9049e18e55cadbb4, user_id=9e3c4207499c42f4b3d34f6c7d747dcb, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:42.949161 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e63fc-9294-4dd7-86d5-f79e0a9520f3 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:42.967018 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 698/1372] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:24:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:24:42.968762 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd22e08-a961-4c07-af0f-09135e1d7cea admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:43.011172 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd22e08-a961-4c07-af0f-09135e1d7cea admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:43.023134 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 675/1373] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:24:42 2022] PUT /identity/v3/projects/33b4cba29c064c9f9049e18e55cadbb4/users/9e3c4207499c42f4b3d34f6c7d747dcb/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:24:43.025751 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce47fe-c365-4628-ab7a-c450ce9d146c None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:43.027369 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce47fe-c365-4628-ab7a-c450ce9d146c None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:43.027663 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce47fe-c365-4628-ab7a-c450ce9d146c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:43.095349 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-e7ce47fe-c365-4628-ab7a-c450ce9d146c None None] MFA Rules not processed for user `9e3c4207499c42f4b3d34f6c7d747dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:43.098933 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-e7ce47fe-c365-4628-ab7a-c450ce9d146c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:43.108900 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:43.215460 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ffc41-c5f6-4097-93c6-eb9e24dde811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:43.216142 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ffc41-c5f6-4097-93c6-eb9e24dde811 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:43.216418 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ffc41-c5f6-4097-93c6-eb9e24dde811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:43.216696 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ffc41-c5f6-4097-93c6-eb9e24dde811 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:43.217348 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ffc41-c5f6-4097-93c6-eb9e24dde811 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:43.219294 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ffc41-c5f6-4097-93c6-eb9e24dde811 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:43.276765 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 676/1374] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:43 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:43.290726 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce47fe-c365-4628-ab7a-c450ce9d146c None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:43.292463 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-e7ce47fe-c365-4628-ab7a-c450ce9d146c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:43.300752 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 699/1375] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:24:42 2022] POST /identity/v3/projects => generated 391 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:24:43.301717 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ffc41-c5f6-4097-93c6-eb9e24dde811 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:43.339757 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:43.425103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ffc41-c5f6-4097-93c6-eb9e24dde811 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:43.430330 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262de94b-4e33-41a0-885a-064b15e54064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:43.431371 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262de94b-4e33-41a0-885a-064b15e54064 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:43.432348 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262de94b-4e33-41a0-885a-064b15e54064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:43.433077 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262de94b-4e33-41a0-885a-064b15e54064 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:43.436385 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262de94b-4e33-41a0-885a-064b15e54064 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:43.437270 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce47fe-c365-4628-ab7a-c450ce9d146c None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:43.439511 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262de94b-4e33-41a0-885a-064b15e54064 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:43.478828 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 700/1376] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:24:43 2022] POST /identity/v3/users => generated 296 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:24:43.485495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262de94b-4e33-41a0-885a-064b15e54064 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:43.548772 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262de94b-4e33-41a0-885a-064b15e54064 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:43.558338 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a380bd5-de9f-487e-883a-d9ad3a49946f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:43.558988 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a380bd5-de9f-487e-883a-d9ad3a49946f service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:43.559291 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a380bd5-de9f-487e-883a-d9ad3a49946f service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:43.559588 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a380bd5-de9f-487e-883a-d9ad3a49946f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:43.565212 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b28201-17eb-4504-8077-b106f0e8b27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:43.566950 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b28201-17eb-4504-8077-b106f0e8b27f admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:43.567419 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b28201-17eb-4504-8077-b106f0e8b27f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:43.568389 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b28201-17eb-4504-8077-b106f0e8b27f admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:43.570197 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b28201-17eb-4504-8077-b106f0e8b27f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:43.574886 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b28201-17eb-4504-8077-b106f0e8b27f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:43.603164 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 701/1377] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:24:43.607092 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b28201-17eb-4504-8077-b106f0e8b27f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:43.627519 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b28201-17eb-4504-8077-b106f0e8b27f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:43.636567 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2589ed8-3e65-4957-9f1e-0a6f325c8c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:43.639811 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2589ed8-3e65-4957-9f1e-0a6f325c8c65 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:43.640136 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2589ed8-3e65-4957-9f1e-0a6f325c8c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:43.640408 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2589ed8-3e65-4957-9f1e-0a6f325c8c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:43.641079 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2589ed8-3e65-4957-9f1e-0a6f325c8c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:43.643503 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2589ed8-3e65-4957-9f1e-0a6f325c8c65 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:43.668988 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a380bd5-de9f-487e-883a-d9ad3a49946f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:43.670503 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a380bd5-de9f-487e-883a-d9ad3a49946f service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:43.673247 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 702/1378] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:24:43.677113 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2589ed8-3e65-4957-9f1e-0a6f325c8c65 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:43.695363 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 677/1379] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:24:43 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:24:43.698942 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2589ed8-3e65-4957-9f1e-0a6f325c8c65 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:43.718334 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4829830-c992-4316-a4d4-61200df66dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:43.719119 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4829830-c992-4316-a4d4-61200df66dbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:43.719241 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4829830-c992-4316-a4d4-61200df66dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:43.719517 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4829830-c992-4316-a4d4-61200df66dbb admin admin] PATH_INFO: `/v3/projects/3d028e72fbd243a5a2fcab49000d2e32/users/23981805ab7947eb85c227478b995e7f/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:43.753329 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4829830-c992-4316-a4d4-61200df66dbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d028e72fbd243a5a2fcab49000d2e32, user_id=23981805ab7947eb85c227478b995e7f, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:43.756276 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4829830-c992-4316-a4d4-61200df66dbb admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:43.785466 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 703/1380] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:24:43 2022] PUT /identity/v3/projects/3d028e72fbd243a5a2fcab49000d2e32/users/23981805ab7947eb85c227478b995e7f/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:24:43.799027 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06973d78-9df4-46f1-a1b4-e02707ff447a None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:43.799581 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06973d78-9df4-46f1-a1b4-e02707ff447a None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:43.799982 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06973d78-9df4-46f1-a1b4-e02707ff447a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:43.858664 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-06973d78-9df4-46f1-a1b4-e02707ff447a None None] MFA Rules not processed for user `23981805ab7947eb85c227478b995e7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:43.862340 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-06973d78-9df4-46f1-a1b4-e02707ff447a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:43.895998 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4829830-c992-4316-a4d4-61200df66dbb admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:44.004845 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4829830-c992-4316-a4d4-61200df66dbb admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:44.006532 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 678/1381] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:43 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:44.011428 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06973d78-9df4-46f1-a1b4-e02707ff447a None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:44.015202 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488dac18-70ed-4af4-b643-dd0cdf8f46c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:44.019412 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488dac18-70ed-4af4-b643-dd0cdf8f46c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:44.020315 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488dac18-70ed-4af4-b643-dd0cdf8f46c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:44.021199 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488dac18-70ed-4af4-b643-dd0cdf8f46c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:44.023671 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-488dac18-70ed-4af4-b643-dd0cdf8f46c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:44.032599 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:44.056385 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:44.113583 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06973d78-9df4-46f1-a1b4-e02707ff447a None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:44.118617 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488dac18-70ed-4af4-b643-dd0cdf8f46c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:44.119858 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275f930e-752d-4da2-bd55-ace8384129e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:44.120652 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f930e-752d-4da2-bd55-ace8384129e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:44.120862 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488dac18-70ed-4af4-b643-dd0cdf8f46c7 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:44.121594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f930e-752d-4da2-bd55-ace8384129e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:44.121981 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f930e-752d-4da2-bd55-ace8384129e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:44.122769 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275f930e-752d-4da2-bd55-ace8384129e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:44.125399 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275f930e-752d-4da2-bd55-ace8384129e8 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:44.149340 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 704/1382] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:24:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 13:24:44.201180 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 679/1383] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:24:44 2022] POST /identity/v3/projects => generated 393 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:24:44.203764 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488dac18-70ed-4af4-b643-dd0cdf8f46c7 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:44.252392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488dac18-70ed-4af4-b643-dd0cdf8f46c7 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:44.487705 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76601b82-a704-4865-9654-c3b432666b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:44.489670 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76601b82-a704-4865-9654-c3b432666b09 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:44.497008 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76601b82-a704-4865-9654-c3b432666b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:44.497473 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76601b82-a704-4865-9654-c3b432666b09 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:44.501167 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76601b82-a704-4865-9654-c3b432666b09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:44.503632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76601b82-a704-4865-9654-c3b432666b09 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:44.553781 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 705/1384] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:24:44 2022] POST /identity/v3/users => generated 303 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:24:44.556582 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275f930e-752d-4da2-bd55-ace8384129e8 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:44.574538 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275f930e-752d-4da2-bd55-ace8384129e8 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:44.583741 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d81ade-f033-4304-b6f5-5c0741e20934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:44.584618 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d81ade-f033-4304-b6f5-5c0741e20934 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:44.585023 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d81ade-f033-4304-b6f5-5c0741e20934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:44.585407 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d81ade-f033-4304-b6f5-5c0741e20934 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:44.586218 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d81ade-f033-4304-b6f5-5c0741e20934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:44.588041 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d81ade-f033-4304-b6f5-5c0741e20934 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:44.626555 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 680/1385] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:24:44.630155 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76601b82-a704-4865-9654-c3b432666b09 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:44.649211 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76601b82-a704-4865-9654-c3b432666b09 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:44.658233 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494430a-1e3e-42b0-a30e-2e187b3663e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:44.659670 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494430a-1e3e-42b0-a30e-2e187b3663e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:44.660120 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494430a-1e3e-42b0-a30e-2e187b3663e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:44.660552 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494430a-1e3e-42b0-a30e-2e187b3663e6 admin admin] PATH_INFO: `/v3/projects/4bee5a84854b4ab1b5322e45ecff2490/users/7c90808fd534412786e1b28b20e5474f/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:44.715241 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494430a-1e3e-42b0-a30e-2e187b3663e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bee5a84854b4ab1b5322e45ecff2490, user_id=7c90808fd534412786e1b28b20e5474f, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:44.721758 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494430a-1e3e-42b0-a30e-2e187b3663e6 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:44.761126 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 706/1386] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:24:44 2022] PUT /identity/v3/projects/4bee5a84854b4ab1b5322e45ecff2490/users/7c90808fd534412786e1b28b20e5474f/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:24:44.763262 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d81ade-f033-4304-b6f5-5c0741e20934 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:44.792837 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d81ade-f033-4304-b6f5-5c0741e20934 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:44.944117 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f13a4-4487-4085-a8b9-cf3be77ee927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:44.944840 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f13a4-4487-4085-a8b9-cf3be77ee927 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:44.945117 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f13a4-4487-4085-a8b9-cf3be77ee927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:44.945387 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f13a4-4487-4085-a8b9-cf3be77ee927 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:44.946025 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f13a4-4487-4085-a8b9-cf3be77ee927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:44.947772 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f13a4-4487-4085-a8b9-cf3be77ee927 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:44.979608 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 681/1387] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:24:44.984412 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494430a-1e3e-42b0-a30e-2e187b3663e6 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:45.028418 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494430a-1e3e-42b0-a30e-2e187b3663e6 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:45.055138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a306f8-22c7-49d7-8429-62dd167ca1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:45.056452 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a306f8-22c7-49d7-8429-62dd167ca1e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:45.056744 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a306f8-22c7-49d7-8429-62dd167ca1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:45.066261 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a306f8-22c7-49d7-8429-62dd167ca1e2 admin admin] PATH_INFO: `/v3/projects/4bee5a84854b4ab1b5322e45ecff2490/users/7c90808fd534412786e1b28b20e5474f/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:45.073716 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a306f8-22c7-49d7-8429-62dd167ca1e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bee5a84854b4ab1b5322e45ecff2490, user_id=7c90808fd534412786e1b28b20e5474f, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:45.081932 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a306f8-22c7-49d7-8429-62dd167ca1e2 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:45.136518 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 707/1388] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:24:44 2022] PUT /identity/v3/projects/4bee5a84854b4ab1b5322e45ecff2490/users/7c90808fd534412786e1b28b20e5474f/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:24:45.160830 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534bca1-78c0-4aa5-9838-cdfe159a68d8 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:45.161167 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534bca1-78c0-4aa5-9838-cdfe159a68d8 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:45.161403 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534bca1-78c0-4aa5-9838-cdfe159a68d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:45.237635 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-6534bca1-78c0-4aa5-9838-cdfe159a68d8 None None] MFA Rules not processed for user `7c90808fd534412786e1b28b20e5474f`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:45.239132 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-6534bca1-78c0-4aa5-9838-cdfe159a68d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:45.464288 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 682/1389] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:45 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:45.476954 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a306f8-22c7-49d7-8429-62dd167ca1e2 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:45.479956 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-42a306f8-22c7-49d7-8429-62dd167ca1e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:45.635064 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a306f8-22c7-49d7-8429-62dd167ca1e2 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:45.645856 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d72f0-a628-47ca-b91a-1e8fc070afdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:45.646661 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d72f0-a628-47ca-b91a-1e8fc070afdf service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:45.646992 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d72f0-a628-47ca-b91a-1e8fc070afdf service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:45.647281 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d72f0-a628-47ca-b91a-1e8fc070afdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:45.695855 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d72f0-a628-47ca-b91a-1e8fc070afdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:45.697428 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d72f0-a628-47ca-b91a-1e8fc070afdf service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:45.731562 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 708/1390] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:24:45 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:24:45.864797 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f17ba-5bfc-4ca5-baef-b41dba66fa98 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:45.865236 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f17ba-5bfc-4ca5-baef-b41dba66fa98 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:45.865314 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f17ba-5bfc-4ca5-baef-b41dba66fa98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:45.913476 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d72f0-a628-47ca-b91a-1e8fc070afdf service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:45.929246 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d72f0-a628-47ca-b91a-1e8fc070afdf service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:45.929813 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:45.948633 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ad5ce-29cb-4154-9b99-4d6b9405eed8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:45.949459 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ad5ce-29cb-4154-9b99-4d6b9405eed8 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:45.950992 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ad5ce-29cb-4154-9b99-4d6b9405eed8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:45.951298 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ad5ce-29cb-4154-9b99-4d6b9405eed8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:45.997423 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-744f17ba-5bfc-4ca5-baef-b41dba66fa98 None None] MFA Rules not processed for user `b45585ee97774a5fa704eac9e992adcb`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:45.999072 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-744f17ba-5bfc-4ca5-baef-b41dba66fa98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:46.009680 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:46.134449 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ad5ce-29cb-4154-9b99-4d6b9405eed8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:46.136193 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ad5ce-29cb-4154-9b99-4d6b9405eed8 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:46.173744 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 709/1391] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:24:45 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 13:24:46.220318 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 683/1392] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:46.234773 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ad5ce-29cb-4154-9b99-4d6b9405eed8 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:46.238714 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4e6ad5ce-29cb-4154-9b99-4d6b9405eed8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:46.513422 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ad5ce-29cb-4154-9b99-4d6b9405eed8 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:46.520519 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf00eff-cf6d-4458-8fdf-ad8de1bd9556 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:46.521218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf00eff-cf6d-4458-8fdf-ad8de1bd9556 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:46.521502 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf00eff-cf6d-4458-8fdf-ad8de1bd9556 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:46.521778 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf00eff-cf6d-4458-8fdf-ad8de1bd9556 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:46.538010 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf00eff-cf6d-4458-8fdf-ad8de1bd9556 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:46.540126 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf00eff-cf6d-4458-8fdf-ad8de1bd9556 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:46.554801 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 710/1393] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:24:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:24:48.349740 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631f2f3-f224-4763-b2c3-a6dfdd66a15f None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:48.350618 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631f2f3-f224-4763-b2c3-a6dfdd66a15f None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:48.351039 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631f2f3-f224-4763-b2c3-a6dfdd66a15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:48.402086 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-0631f2f3-f224-4763-b2c3-a6dfdd66a15f None None] MFA Rules not processed for user `b59b96a78db44099838e00f6614052bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:48.403171 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-0631f2f3-f224-4763-b2c3-a6dfdd66a15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:48.570388 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 684/1394] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:49.472763 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf00eff-cf6d-4458-8fdf-ad8de1bd9556 service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:49.664570 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf00eff-cf6d-4458-8fdf-ad8de1bd9556 service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:49.693713 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a0b1f0-0178-4eaa-be9d-26205a5127e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:49.695630 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0b1f0-0178-4eaa-be9d-26205a5127e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:49.699071 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0b1f0-0178-4eaa-be9d-26205a5127e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:49.700392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0b1f0-0178-4eaa-be9d-26205a5127e7 admin admin] PATH_INFO: `/v3/users/788c10a9f5e84217a7eeea1cd9ec5498` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:49.706894 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a0b1f0-0178-4eaa-be9d-26205a5127e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=788c10a9f5e84217a7eeea1cd9ec5498)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:49.713163 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a0b1f0-0178-4eaa-be9d-26205a5127e7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:49.850720 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:49.880794 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-12a0b1f0-0178-4eaa-be9d-26205a5127e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '788c10a9f5e84217a7eeea1cd9ec5498'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:49.887414 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-12a0b1f0-0178-4eaa-be9d-26205a5127e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '788c10a9f5e84217a7eeea1cd9ec5498'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:49.949327 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-12a0b1f0-0178-4eaa-be9d-26205a5127e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '788c10a9f5e84217a7eeea1cd9ec5498'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:49.978177 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-12a0b1f0-0178-4eaa-be9d-26205a5127e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '788c10a9f5e84217a7eeea1cd9ec5498'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:50.011733 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-12a0b1f0-0178-4eaa-be9d-26205a5127e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '788c10a9f5e84217a7eeea1cd9ec5498'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:50.033413 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 711/1395] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:24:49 2022] DELETE /identity/v3/users/788c10a9f5e84217a7eeea1cd9ec5498 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:24:50.038118 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c0a3a-60be-4c91-b2cf-25144e24912a None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:50.038652 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c0a3a-60be-4c91-b2cf-25144e24912a None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:50.038652 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c0a3a-60be-4c91-b2cf-25144e24912a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:50.094482 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-736c0a3a-60be-4c91-b2cf-25144e24912a None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:50.097746 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-736c0a3a-60be-4c91-b2cf-25144e24912a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:50.276310 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 685/1396] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:50.417401 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a0b1f0-0178-4eaa-be9d-26205a5127e7 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:50.429232 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-12a0b1f0-0178-4eaa-be9d-26205a5127e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:50.430072 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97565962-80c1-451c-b76d-5d624f012483 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:50.430824 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97565962-80c1-451c-b76d-5d624f012483 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:50.431385 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97565962-80c1-451c-b76d-5d624f012483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:50.522273 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-97565962-80c1-451c-b76d-5d624f012483 None None] MFA Rules not processed for user `04d684ea21984ff699fea2c637044c3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:50.531327 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-97565962-80c1-451c-b76d-5d624f012483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:50.620901 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a0b1f0-0178-4eaa-be9d-26205a5127e7 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:50.624313 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:50.636056 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e404e81-bcb8-4a01-81eb-bec26ce952af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:50.636712 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e404e81-bcb8-4a01-81eb-bec26ce952af service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:50.636957 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e404e81-bcb8-4a01-81eb-bec26ce952af service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:50.640152 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e404e81-bcb8-4a01-81eb-bec26ce952af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:50.693009 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e404e81-bcb8-4a01-81eb-bec26ce952af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:50.699138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e404e81-bcb8-4a01-81eb-bec26ce952af service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:50.734627 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 712/1397] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:24:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:24:50.742378 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 686/1398] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:24:50.755615 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ce4c2-2931-443a-80e9-21966687a5a6 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:50.755929 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ce4c2-2931-443a-80e9-21966687a5a6 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:50.756223 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ce4c2-2931-443a-80e9-21966687a5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:50.835296 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-cf3ce4c2-2931-443a-80e9-21966687a5a6 None None] MFA Rules not processed for user `04d684ea21984ff699fea2c637044c3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:50.843863 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cf3ce4c2-2931-443a-80e9-21966687a5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:50.918407 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 713/1399] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:50.930084 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97565962-80c1-451c-b76d-5d624f012483 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:50.931532 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-97565962-80c1-451c-b76d-5d624f012483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:51.089747 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fada2-b99e-4440-bf18-5309dde1f246 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:51.090241 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fada2-b99e-4440-bf18-5309dde1f246 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:51.090618 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fada2-b99e-4440-bf18-5309dde1f246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:51.181516 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-7b5fada2-b99e-4440-bf18-5309dde1f246 None None] MFA Rules not processed for user `2a2ed118a399479ab355bfd5734d04d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:51.185100 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7b5fada2-b99e-4440-bf18-5309dde1f246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:51.206167 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97565962-80c1-451c-b76d-5d624f012483 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:51.221658 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6b90f-93c2-4d0a-9dde-caef1539f735 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:51.222304 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6b90f-93c2-4d0a-9dde-caef1539f735 service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:51.222585 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6b90f-93c2-4d0a-9dde-caef1539f735 service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:51.222862 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6b90f-93c2-4d0a-9dde-caef1539f735 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:51.242529 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe6b90f-93c2-4d0a-9dde-caef1539f735 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:51.245141 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe6b90f-93c2-4d0a-9dde-caef1539f735 service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:51.276677 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 687/1400] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:24:50 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:24:51.372371 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 714/1401] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:24:51.545982 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afdf80-8150-4618-b42c-08c6c84967fd None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:51.546273 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afdf80-8150-4618-b42c-08c6c84967fd None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:51.546552 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afdf80-8150-4618-b42c-08c6c84967fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:51.606388 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-92afdf80-8150-4618-b42c-08c6c84967fd None None] MFA Rules not processed for user `5d6160cc258844f9a7f618b635916f23`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:51.609487 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-92afdf80-8150-4618-b42c-08c6c84967fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:51.639744 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fada2-b99e-4440-bf18-5309dde1f246 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:51.641257 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7b5fada2-b99e-4440-bf18-5309dde1f246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:51.670571 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fada2-b99e-4440-bf18-5309dde1f246 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:51.699542 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4e23e-36ac-4a54-9c16-9df1720d1c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:51.709701 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4e23e-36ac-4a54-9c16-9df1720d1c57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:51.712529 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4e23e-36ac-4a54-9c16-9df1720d1c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:51.718890 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4e23e-36ac-4a54-9c16-9df1720d1c57 admin admin] PATH_INFO: `/v3/users/23981805ab7947eb85c227478b995e7f` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:51.723043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4e23e-36ac-4a54-9c16-9df1720d1c57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23981805ab7947eb85c227478b995e7f)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:51.725712 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4e23e-36ac-4a54-9c16-9df1720d1c57 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:51.824365 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:51.837548 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e7f4e23e-36ac-4a54-9c16-9df1720d1c57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23981805ab7947eb85c227478b995e7f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:51.838452 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e7f4e23e-36ac-4a54-9c16-9df1720d1c57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23981805ab7947eb85c227478b995e7f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:51.840511 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 688/1402] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:51.842065 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59daf7cd-cef3-459f-9dec-53ed2db08ba2 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:51.843172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59daf7cd-cef3-459f-9dec-53ed2db08ba2 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:51.843591 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59daf7cd-cef3-459f-9dec-53ed2db08ba2 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:51.845302 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 689/1403] 10.222.0.25 () {54 vars in 912 bytes} [Tue Oct 25 13:24:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:24:51.855198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b41b62-4250-4c95-83ca-edef64d3335c None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:51.855482 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b41b62-4250-4c95-83ca-edef64d3335c None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:51.855789 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b41b62-4250-4c95-83ca-edef64d3335c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:51.889383 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e7f4e23e-36ac-4a54-9c16-9df1720d1c57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23981805ab7947eb85c227478b995e7f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:51.910696 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e7f4e23e-36ac-4a54-9c16-9df1720d1c57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23981805ab7947eb85c227478b995e7f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:51.927745 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-d3b41b62-4250-4c95-83ca-edef64d3335c None None] MFA Rules not processed for user `5d6160cc258844f9a7f618b635916f23`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:51.927923 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e7f4e23e-36ac-4a54-9c16-9df1720d1c57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23981805ab7947eb85c227478b995e7f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:51.930360 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-d3b41b62-4250-4c95-83ca-edef64d3335c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:51.941255 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 715/1404] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:24:51 2022] DELETE /identity/v3/users/23981805ab7947eb85c227478b995e7f => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:24:51.945254 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1e0ca-84b4-4544-8045-2928f8092234 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:51.949028 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1e0ca-84b4-4544-8045-2928f8092234 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:51.949352 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1e0ca-84b4-4544-8045-2928f8092234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:51.960657 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 690/1405] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:51.964505 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513443e3-1c8b-4cbb-bd48-a00daad1b93c None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:51.968633 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513443e3-1c8b-4cbb-bd48-a00daad1b93c None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:51.968949 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513443e3-1c8b-4cbb-bd48-a00daad1b93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:52.008393 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-513443e3-1c8b-4cbb-bd48-a00daad1b93c None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:52.009799 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-513443e3-1c8b-4cbb-bd48-a00daad1b93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:52.020494 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-3ff1e0ca-84b4-4544-8045-2928f8092234 None None] MFA Rules not processed for user `cec40e8c81fe4eafb474d40bc7bf38fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:52.022227 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3ff1e0ca-84b4-4544-8045-2928f8092234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:52.121644 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 716/1406] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 25 13:24:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:52.126888 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5eaa78-6f85-4a60-aaeb-7055ceb7683f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:52.128197 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5eaa78-6f85-4a60-aaeb-7055ceb7683f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:52.128866 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5eaa78-6f85-4a60-aaeb-7055ceb7683f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:52.136215 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:52.176685 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-1a5eaa78-6f85-4a60-aaeb-7055ceb7683f None None] MFA Rules not processed for user `b45585ee97774a5fa704eac9e992adcb`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:52.178460 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1a5eaa78-6f85-4a60-aaeb-7055ceb7683f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:52.198396 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 691/1407] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:52.199288 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513443e3-1c8b-4cbb-bd48-a00daad1b93c None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:52.200617 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-513443e3-1c8b-4cbb-bd48-a00daad1b93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:52.230147 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513443e3-1c8b-4cbb-bd48-a00daad1b93c None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:52.235540 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906cf88-8acc-471d-b419-68e4900e01ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:52.235884 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906cf88-8acc-471d-b419-68e4900e01ef service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:52.236198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906cf88-8acc-471d-b419-68e4900e01ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:52.236474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906cf88-8acc-471d-b419-68e4900e01ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:52.251447 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906cf88-8acc-471d-b419-68e4900e01ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:52.253657 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906cf88-8acc-471d-b419-68e4900e01ef service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:52.266793 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 692/1408] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:24:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:24:52.268445 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906cf88-8acc-471d-b419-68e4900e01ef service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:52.269989 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b906cf88-8acc-471d-b419-68e4900e01ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:52.299192 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906cf88-8acc-471d-b419-68e4900e01ef service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:52.309417 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551918e8-f7b3-41b5-97ac-7a24cd275774 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:52.310292 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551918e8-f7b3-41b5-97ac-7a24cd275774 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:52.310576 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551918e8-f7b3-41b5-97ac-7a24cd275774 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:52.311736 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551918e8-f7b3-41b5-97ac-7a24cd275774 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:52.332095 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551918e8-f7b3-41b5-97ac-7a24cd275774 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:52.333985 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551918e8-f7b3-41b5-97ac-7a24cd275774 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:52.363514 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 693/1409] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:24:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:24:52.380045 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 717/1410] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:52.389458 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d78b3-b172-45f0-8958-c24e7005acb5 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:52.390348 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d78b3-b172-45f0-8958-c24e7005acb5 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:52.390348 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d78b3-b172-45f0-8958-c24e7005acb5 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:52.401011 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 694/1411] 10.222.0.25 () {54 vars in 912 bytes} [Tue Oct 25 13:24:52 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:24:52.409250 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d893d5-e194-4d2a-b8c2-e017958c03b9 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:52.409699 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d893d5-e194-4d2a-b8c2-e017958c03b9 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:52.410403 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d893d5-e194-4d2a-b8c2-e017958c03b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:52.467104 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-20d893d5-e194-4d2a-b8c2-e017958c03b9 None None] MFA Rules not processed for user `cec40e8c81fe4eafb474d40bc7bf38fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:52.472231 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-20d893d5-e194-4d2a-b8c2-e017958c03b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:52.497587 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 718/1412] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 25 13:24:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:52.546095 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d78b3-b172-45f0-8958-c24e7005acb5 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:52.563934 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d78b3-b172-45f0-8958-c24e7005acb5 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:52.573578 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4eb240-a36e-4547-84b2-6cfc41e28846 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:52.574310 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4eb240-a36e-4547-84b2-6cfc41e28846 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:52.574688 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4eb240-a36e-4547-84b2-6cfc41e28846 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:52.575066 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4eb240-a36e-4547-84b2-6cfc41e28846 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:52.599876 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4eb240-a36e-4547-84b2-6cfc41e28846 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:52.601376 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4eb240-a36e-4547-84b2-6cfc41e28846 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:52.624197 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 695/1413] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:24:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:24:52.766762 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d893d5-e194-4d2a-b8c2-e017958c03b9 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:52.768405 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-20d893d5-e194-4d2a-b8c2-e017958c03b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:52.798634 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d893d5-e194-4d2a-b8c2-e017958c03b9 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:52.810578 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15661fcf-0d73-42bc-adb8-63b8bb14a9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:52.811327 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15661fcf-0d73-42bc-adb8-63b8bb14a9d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:52.811678 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15661fcf-0d73-42bc-adb8-63b8bb14a9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:52.812600 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15661fcf-0d73-42bc-adb8-63b8bb14a9d4 admin admin] PATH_INFO: `/v3/projects/89b675737fc64516b571e7ca6415ab8e` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:52.821769 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15661fcf-0d73-42bc-adb8-63b8bb14a9d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89b675737fc64516b571e7ca6415ab8e)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:52.823886 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15661fcf-0d73-42bc-adb8-63b8bb14a9d4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:52.939520 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:52.945585 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-15661fcf-0d73-42bc-adb8-63b8bb14a9d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89b675737fc64516b571e7ca6415ab8e', 'request_id': 'req-15661fcf-0d73-42bc-adb8-63b8bb14a9d4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:52.963531 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-15661fcf-0d73-42bc-adb8-63b8bb14a9d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89b675737fc64516b571e7ca6415ab8e', 'request_id': 'req-15661fcf-0d73-42bc-adb8-63b8bb14a9d4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:52.970954 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-15661fcf-0d73-42bc-adb8-63b8bb14a9d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89b675737fc64516b571e7ca6415ab8e', 'request_id': 'req-15661fcf-0d73-42bc-adb8-63b8bb14a9d4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:53.001374 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-15661fcf-0d73-42bc-adb8-63b8bb14a9d4 admin admin] The token cache is being invalidate because project 89b675737fc64516b571e7ca6415ab8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:24:53.001784 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-15661fcf-0d73-42bc-adb8-63b8bb14a9d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:53.003816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-15661fcf-0d73-42bc-adb8-63b8bb14a9d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:53.006273 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 719/1414] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:24:52 2022] DELETE /identity/v3/projects/89b675737fc64516b571e7ca6415ab8e => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:24:53.011057 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4eb240-a36e-4547-84b2-6cfc41e28846 service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:53.039614 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4eb240-a36e-4547-84b2-6cfc41e28846 service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:53.161376 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c09cc-4dfc-4ace-a282-34e4d5229853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:53.162123 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c09cc-4dfc-4ace-a282-34e4d5229853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:53.162480 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c09cc-4dfc-4ace-a282-34e4d5229853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:53.162826 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c09cc-4dfc-4ace-a282-34e4d5229853 admin admin] PATH_INFO: `/v3/users/9e3c4207499c42f4b3d34f6c7d747dcb` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:53.167661 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c09cc-4dfc-4ace-a282-34e4d5229853 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e3c4207499c42f4b3d34f6c7d747dcb)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:53.169727 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c09cc-4dfc-4ace-a282-34e4d5229853 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:53.270277 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c70c09cc-4dfc-4ace-a282-34e4d5229853 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e3c4207499c42f4b3d34f6c7d747dcb'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:53.286665 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c70c09cc-4dfc-4ace-a282-34e4d5229853 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e3c4207499c42f4b3d34f6c7d747dcb'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:53.287627 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c70c09cc-4dfc-4ace-a282-34e4d5229853 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e3c4207499c42f4b3d34f6c7d747dcb'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:53.314200 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15661fcf-0d73-42bc-adb8-63b8bb14a9d4 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:53.315928 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-15661fcf-0d73-42bc-adb8-63b8bb14a9d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:53.323104 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c70c09cc-4dfc-4ace-a282-34e4d5229853 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e3c4207499c42f4b3d34f6c7d747dcb'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:53.324897 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c70c09cc-4dfc-4ace-a282-34e4d5229853 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e3c4207499c42f4b3d34f6c7d747dcb'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:53.368198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 696/1415] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:24:53 2022] DELETE /identity/v3/users/9e3c4207499c42f4b3d34f6c7d747dcb => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:24:53.464859 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c09cc-4dfc-4ace-a282-34e4d5229853 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:53.466390 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c70c09cc-4dfc-4ace-a282-34e4d5229853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:53.534918 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:53.541595 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15661fcf-0d73-42bc-adb8-63b8bb14a9d4 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:53.702714 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c09cc-4dfc-4ace-a282-34e4d5229853 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:53.708259 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5651943-45fe-4ac1-8e62-653dfecde40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:53.713611 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5651943-45fe-4ac1-8e62-653dfecde40c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:53.713947 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5651943-45fe-4ac1-8e62-653dfecde40c admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:53.714236 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5651943-45fe-4ac1-8e62-653dfecde40c admin admin] PATH_INFO: `/v3/projects/3d028e72fbd243a5a2fcab49000d2e32` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:53.719955 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5651943-45fe-4ac1-8e62-653dfecde40c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d028e72fbd243a5a2fcab49000d2e32)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:53.719955 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5651943-45fe-4ac1-8e62-653dfecde40c admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:53.790609 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874fb24-aded-42b6-9419-f37b8896f4c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:53.792233 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874fb24-aded-42b6-9419-f37b8896f4c8 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:53.792946 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874fb24-aded-42b6-9419-f37b8896f4c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:53.793469 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874fb24-aded-42b6-9419-f37b8896f4c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:53.796699 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4874fb24-aded-42b6-9419-f37b8896f4c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:53.853716 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-a5651943-45fe-4ac1-8e62-653dfecde40c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d028e72fbd243a5a2fcab49000d2e32', 'request_id': 'req-a5651943-45fe-4ac1-8e62-653dfecde40c'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:53.870810 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-a5651943-45fe-4ac1-8e62-653dfecde40c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d028e72fbd243a5a2fcab49000d2e32', 'request_id': 'req-a5651943-45fe-4ac1-8e62-653dfecde40c'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:53.888185 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-a5651943-45fe-4ac1-8e62-653dfecde40c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d028e72fbd243a5a2fcab49000d2e32', 'request_id': 'req-a5651943-45fe-4ac1-8e62-653dfecde40c'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:53.902638 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-a5651943-45fe-4ac1-8e62-653dfecde40c admin admin] The token cache is being invalidate because project 3d028e72fbd243a5a2fcab49000d2e32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:24:53.903297 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-a5651943-45fe-4ac1-8e62-653dfecde40c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:53.904568 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-a5651943-45fe-4ac1-8e62-653dfecde40c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:53.907335 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 697/1416] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:24:53 2022] DELETE /identity/v3/projects/3d028e72fbd243a5a2fcab49000d2e32 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:24:53.910675 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5651943-45fe-4ac1-8e62-653dfecde40c admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:53.913008 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a5651943-45fe-4ac1-8e62-653dfecde40c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:53.962575 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874fb24-aded-42b6-9419-f37b8896f4c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:53.967403 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874fb24-aded-42b6-9419-f37b8896f4c8 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:53.997629 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 720/1417] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:24:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 684 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:24:53.998996 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874fb24-aded-42b6-9419-f37b8896f4c8 service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:54.002263 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4874fb24-aded-42b6-9419-f37b8896f4c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:54.035285 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874fb24-aded-42b6-9419-f37b8896f4c8 service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:54.049240 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:54.092108 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5651943-45fe-4ac1-8e62-653dfecde40c admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:54.106313 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf095f-b86b-4e0c-a19e-6539fbcbe7a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f10c161ef74c4a0d809346a5c4b53aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:54.107948 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf095f-b86b-4e0c-a19e-6539fbcbe7a1 service placement] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:54.107948 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf095f-b86b-4e0c-a19e-6539fbcbe7a1 service placement] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:54.107948 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf095f-b86b-4e0c-a19e-6539fbcbe7a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:54.111652 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-33cf095f-b86b-4e0c-a19e-6539fbcbe7a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:54.169800 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf095f-b86b-4e0c-a19e-6539fbcbe7a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:54.175720 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf095f-b86b-4e0c-a19e-6539fbcbe7a1 service placement] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:54.203548 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 698/1418] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:24:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:24:54.209054 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb86bc-a6cf-4d66-aac8-cd1d6f2e1e3f None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:54.209734 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb86bc-a6cf-4d66-aac8-cd1d6f2e1e3f None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:54.210012 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb86bc-a6cf-4d66-aac8-cd1d6f2e1e3f None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:54.212875 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7f0da-8216-4a20-bdb8-d4270dd24c5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:54.213425 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7f0da-8216-4a20-bdb8-d4270dd24c5e service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:54.213702 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7f0da-8216-4a20-bdb8-d4270dd24c5e service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:54.213976 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7f0da-8216-4a20-bdb8-d4270dd24c5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:54.215063 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 699/1419] 10.222.0.25 () {54 vars in 961 bytes} [Tue Oct 25 13:24:54 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:24:54.216744 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-15c7f0da-8216-4a20-bdb8-d4270dd24c5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:54.218518 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb86bc-a6cf-4d66-aac8-cd1d6f2e1e3f None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:54.222480 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-56bb86bc-a6cf-4d66-aac8-cd1d6f2e1e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:54.333838 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:54.377725 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c7f0da-8216-4a20-bdb8-d4270dd24c5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:54.382486 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb86bc-a6cf-4d66-aac8-cd1d6f2e1e3f None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:54.383368 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c7f0da-8216-4a20-bdb8-d4270dd24c5e service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:54.395244 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a69eb-60d6-45d7-8520-6575ecb24091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:54.395833 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a69eb-60d6-45d7-8520-6575ecb24091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:54.396501 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a69eb-60d6-45d7-8520-6575ecb24091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:54.396501 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a69eb-60d6-45d7-8520-6575ecb24091 admin admin] PATH_INFO: `/v3/users/7c90808fd534412786e1b28b20e5474f` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:54.399849 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a69eb-60d6-45d7-8520-6575ecb24091 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c90808fd534412786e1b28b20e5474f)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:54.405531 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 721/1420] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:24:53 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:24:54.406702 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7f0da-8216-4a20-bdb8-d4270dd24c5e service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:54.416504 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a69eb-60d6-45d7-8520-6575ecb24091 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:54.441295 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-15c7f0da-8216-4a20-bdb8-d4270dd24c5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:54.473870 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7f0da-8216-4a20-bdb8-d4270dd24c5e service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:54.507930 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427db0f2-751d-472c-ad09-60b7b676e840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:54.510870 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427db0f2-751d-472c-ad09-60b7b676e840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:54.511173 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427db0f2-751d-472c-ad09-60b7b676e840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:54.514497 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427db0f2-751d-472c-ad09-60b7b676e840 admin admin] PATH_INFO: `/v3/projects/33b4cba29c064c9f9049e18e55cadbb4` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:54.518216 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427db0f2-751d-472c-ad09-60b7b676e840 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33b4cba29c064c9f9049e18e55cadbb4)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:54.525650 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427db0f2-751d-472c-ad09-60b7b676e840 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:54.541053 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-496a69eb-60d6-45d7-8520-6575ecb24091 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c90808fd534412786e1b28b20e5474f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:54.596483 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-496a69eb-60d6-45d7-8520-6575ecb24091 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c90808fd534412786e1b28b20e5474f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:54.597315 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-496a69eb-60d6-45d7-8520-6575ecb24091 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c90808fd534412786e1b28b20e5474f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:54.620345 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-496a69eb-60d6-45d7-8520-6575ecb24091 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c90808fd534412786e1b28b20e5474f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:54.621724 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-496a69eb-60d6-45d7-8520-6575ecb24091 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c90808fd534412786e1b28b20e5474f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:54.666921 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 700/1421] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:24:54 2022] DELETE /identity/v3/users/7c90808fd534412786e1b28b20e5474f => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:24:54.669053 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45519c3-c47f-4b3b-83eb-7015fa03b04f None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:54.669391 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45519c3-c47f-4b3b-83eb-7015fa03b04f None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:54.669673 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45519c3-c47f-4b3b-83eb-7015fa03b04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:54.691966 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-427db0f2-751d-472c-ad09-60b7b676e840 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33b4cba29c064c9f9049e18e55cadbb4', 'request_id': 'req-427db0f2-751d-472c-ad09-60b7b676e840'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:54.708952 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-427db0f2-751d-472c-ad09-60b7b676e840 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33b4cba29c064c9f9049e18e55cadbb4', 'request_id': 'req-427db0f2-751d-472c-ad09-60b7b676e840'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:54.742793 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-427db0f2-751d-472c-ad09-60b7b676e840 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33b4cba29c064c9f9049e18e55cadbb4', 'request_id': 'req-427db0f2-751d-472c-ad09-60b7b676e840'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:54.755978 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-c45519c3-c47f-4b3b-83eb-7015fa03b04f None None] MFA Rules not processed for user `f10c161ef74c4a0d809346a5c4b53aa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:54.761602 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c45519c3-c47f-4b3b-83eb-7015fa03b04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:54.790322 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-427db0f2-751d-472c-ad09-60b7b676e840 admin admin] The token cache is being invalidate because project 33b4cba29c064c9f9049e18e55cadbb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:24:54.791351 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-427db0f2-751d-472c-ad09-60b7b676e840 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:54.794946 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-427db0f2-751d-472c-ad09-60b7b676e840 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:54.802708 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 722/1422] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:24:54 2022] DELETE /identity/v3/projects/33b4cba29c064c9f9049e18e55cadbb4 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:24:54.802708 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427db0f2-751d-472c-ad09-60b7b676e840 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:54.804164 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-427db0f2-751d-472c-ad09-60b7b676e840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:54.920317 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:55.010703 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 701/1423] 10.222.0.25 () {58 vars in 1058 bytes} [Tue Oct 25 13:24:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:55.014731 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a380b61-992f-4dd4-b4ec-a8aa8341aef8 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:55.017813 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a380b61-992f-4dd4-b4ec-a8aa8341aef8 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:55.018158 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a380b61-992f-4dd4-b4ec-a8aa8341aef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:55.062166 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427db0f2-751d-472c-ad09-60b7b676e840 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:55.095793 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-1a380b61-992f-4dd4-b4ec-a8aa8341aef8 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:55.097907 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-1a380b61-992f-4dd4-b4ec-a8aa8341aef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:55.184882 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:55.202674 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 702/1424] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:55.204668 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a380b61-992f-4dd4-b4ec-a8aa8341aef8 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:55.217371 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc717b85-68e4-48c6-b5df-ccbc9694ee79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:55.218290 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc717b85-68e4-48c6-b5df-ccbc9694ee79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:55.218731 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc717b85-68e4-48c6-b5df-ccbc9694ee79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:55.219398 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc717b85-68e4-48c6-b5df-ccbc9694ee79 admin admin] PATH_INFO: `/v3/users/44783460e67541cc85745bf9de2b7e6f` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:55.220796 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc717b85-68e4-48c6-b5df-ccbc9694ee79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44783460e67541cc85745bf9de2b7e6f)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:55.222894 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc717b85-68e4-48c6-b5df-ccbc9694ee79 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:55.223788 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a380b61-992f-4dd4-b4ec-a8aa8341aef8 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:55.235692 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b34f6a-4ee5-405e-a8b9-651c4404522e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f10c161ef74c4a0d809346a5c4b53aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:55.237878 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b34f6a-4ee5-405e-a8b9-651c4404522e service placement] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:55.237878 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b34f6a-4ee5-405e-a8b9-651c4404522e service placement] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:55.238646 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b34f6a-4ee5-405e-a8b9-651c4404522e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:55.250250 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-82b34f6a-4ee5-405e-a8b9-651c4404522e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:55.279144 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b34f6a-4ee5-405e-a8b9-651c4404522e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:55.283281 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b34f6a-4ee5-405e-a8b9-651c4404522e service placement] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:55.289866 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-fc717b85-68e4-48c6-b5df-ccbc9694ee79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44783460e67541cc85745bf9de2b7e6f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:55.290989 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-fc717b85-68e4-48c6-b5df-ccbc9694ee79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44783460e67541cc85745bf9de2b7e6f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:55.307111 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 703/1425] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:24:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:24:55.308581 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-fc717b85-68e4-48c6-b5df-ccbc9694ee79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44783460e67541cc85745bf9de2b7e6f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:55.308722 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a489b43-81ae-4ddf-9b0d-091cf309371e None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:55.309720 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a489b43-81ae-4ddf-9b0d-091cf309371e None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:55.310764 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a489b43-81ae-4ddf-9b0d-091cf309371e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:55.324556 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-fc717b85-68e4-48c6-b5df-ccbc9694ee79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44783460e67541cc85745bf9de2b7e6f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:55.341449 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-7a489b43-81ae-4ddf-9b0d-091cf309371e None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:55.342858 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-fc717b85-68e4-48c6-b5df-ccbc9694ee79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44783460e67541cc85745bf9de2b7e6f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:55.343085 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-7a489b43-81ae-4ddf-9b0d-091cf309371e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:55.359473 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 723/1426] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:24:54 2022] DELETE /identity/v3/users/44783460e67541cc85745bf9de2b7e6f => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:24:55.361519 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 704/1427] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:55.365797 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ed08f-00f3-42b7-89c2-870f6ff98085 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:55.366599 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a489b43-81ae-4ddf-9b0d-091cf309371e None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:55.366895 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ed08f-00f3-42b7-89c2-870f6ff98085 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:55.367186 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ed08f-00f3-42b7-89c2-870f6ff98085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:55.391320 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a489b43-81ae-4ddf-9b0d-091cf309371e None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:55.407705 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e40ed08f-00f3-42b7-89c2-870f6ff98085 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:55.409047 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e40ed08f-00f3-42b7-89c2-870f6ff98085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:55.526049 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:55.569717 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d9818-bbff-459c-8cfc-11857674170d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:55.574958 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d9818-bbff-459c-8cfc-11857674170d admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:55.575303 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d9818-bbff-459c-8cfc-11857674170d admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:55.575657 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d9818-bbff-459c-8cfc-11857674170d admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:55.579992 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d9818-bbff-459c-8cfc-11857674170d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:24:55.580305 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d9818-bbff-459c-8cfc-11857674170d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:55.582765 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d9818-bbff-459c-8cfc-11857674170d admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:55.584824 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 724/1428] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:55.608511 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ed08f-00f3-42b7-89c2-870f6ff98085 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:55.611641 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e40ed08f-00f3-42b7-89c2-870f6ff98085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:55.645828 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 705/1429] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:24:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:24:55.651496 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d9818-bbff-459c-8cfc-11857674170d admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:55.685127 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d9818-bbff-459c-8cfc-11857674170d admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:55.698550 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98985746-ea20-48b6-aede-76f73e26b47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:55.699308 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98985746-ea20-48b6-aede-76f73e26b47f admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:55.699607 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98985746-ea20-48b6-aede-76f73e26b47f admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:55.699871 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98985746-ea20-48b6-aede-76f73e26b47f admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:55.702776 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98985746-ea20-48b6-aede-76f73e26b47f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:55.705980 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98985746-ea20-48b6-aede-76f73e26b47f admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:55.781046 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 706/1430] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:24:55 2022] POST /identity/v3/projects => generated 369 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:24:55.785582 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98985746-ea20-48b6-aede-76f73e26b47f admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:55.855743 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ed08f-00f3-42b7-89c2-870f6ff98085 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:56.022619 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98985746-ea20-48b6-aede-76f73e26b47f admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:56.034842 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4c428-edca-4ab0-973b-73091f8078c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:56.037491 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4c428-edca-4ab0-973b-73091f8078c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:56.037893 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4c428-edca-4ab0-973b-73091f8078c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:56.038183 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4c428-edca-4ab0-973b-73091f8078c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:56.038855 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4c428-edca-4ab0-973b-73091f8078c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:56.042584 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4c428-edca-4ab0-973b-73091f8078c2 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:56.068138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d4fd8-a3bd-49f9-a7d6-0e20215e82aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:56.068138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d4fd8-a3bd-49f9-a7d6-0e20215e82aa service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:56.068138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d4fd8-a3bd-49f9-a7d6-0e20215e82aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:56.068138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d4fd8-a3bd-49f9-a7d6-0e20215e82aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:56.096885 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d4fd8-a3bd-49f9-a7d6-0e20215e82aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:56.103359 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 707/1431] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:24:55 2022] POST /identity/v3/users => generated 285 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:24:56.104432 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d4fd8-a3bd-49f9-a7d6-0e20215e82aa service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:56.105109 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4c428-edca-4ab0-973b-73091f8078c2 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:56.111352 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-1dc4c428-edca-4ab0-973b-73091f8078c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:56.153728 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 725/1432] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:24:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 13:24:56.154837 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d4fd8-a3bd-49f9-a7d6-0e20215e82aa service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:56.170904 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4c428-edca-4ab0-973b-73091f8078c2 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:56.190453 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d4fd8-a3bd-49f9-a7d6-0e20215e82aa service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:56.200834 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0db9a-ea14-4b52-bfc3-20afc8aeaa09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:56.201637 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0db9a-ea14-4b52-bfc3-20afc8aeaa09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:56.208242 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0db9a-ea14-4b52-bfc3-20afc8aeaa09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:56.208670 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0db9a-ea14-4b52-bfc3-20afc8aeaa09 admin admin] PATH_INFO: `/v3/projects/4bee5a84854b4ab1b5322e45ecff2490` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:56.210888 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0db9a-ea14-4b52-bfc3-20afc8aeaa09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bee5a84854b4ab1b5322e45ecff2490)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:56.213274 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0db9a-ea14-4b52-bfc3-20afc8aeaa09 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:56.224208 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7c9d9-951c-4284-865e-e767c3cf61e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:56.225219 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7c9d9-951c-4284-865e-e767c3cf61e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:56.229499 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7c9d9-951c-4284-865e-e767c3cf61e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:56.230115 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7c9d9-951c-4284-865e-e767c3cf61e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:56.235137 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7c9d9-951c-4284-865e-e767c3cf61e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:56.241065 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7c9d9-951c-4284-865e-e767c3cf61e7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:56.275145 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 726/1433] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:24:56.283070 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7c9d9-951c-4284-865e-e767c3cf61e7 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:56.314829 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7c9d9-951c-4284-865e-e767c3cf61e7 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:56.337203 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790641da-da86-4f03-a0e3-87362d275548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:56.338174 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790641da-da86-4f03-a0e3-87362d275548 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:56.339126 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790641da-da86-4f03-a0e3-87362d275548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:56.341007 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790641da-da86-4f03-a0e3-87362d275548 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:56.342623 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790641da-da86-4f03-a0e3-87362d275548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:56.343131 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:56.346798 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790641da-da86-4f03-a0e3-87362d275548 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:56.379771 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c2a0db9a-ea14-4b52-bfc3-20afc8aeaa09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bee5a84854b4ab1b5322e45ecff2490', 'request_id': 'req-c2a0db9a-ea14-4b52-bfc3-20afc8aeaa09'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:56.384271 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 727/1434] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:24:56.388359 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790641da-da86-4f03-a0e3-87362d275548 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:56.392499 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c2a0db9a-ea14-4b52-bfc3-20afc8aeaa09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bee5a84854b4ab1b5322e45ecff2490', 'request_id': 'req-c2a0db9a-ea14-4b52-bfc3-20afc8aeaa09'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:56.410983 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790641da-da86-4f03-a0e3-87362d275548 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:56.423076 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c2a0db9a-ea14-4b52-bfc3-20afc8aeaa09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bee5a84854b4ab1b5322e45ecff2490', 'request_id': 'req-c2a0db9a-ea14-4b52-bfc3-20afc8aeaa09'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:56.441472 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c2a0db9a-ea14-4b52-bfc3-20afc8aeaa09 admin admin] The token cache is being invalidate because project 4bee5a84854b4ab1b5322e45ecff2490 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:24:56.441933 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c2a0db9a-ea14-4b52-bfc3-20afc8aeaa09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:56.442718 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c2a0db9a-ea14-4b52-bfc3-20afc8aeaa09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:56.446132 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 708/1435] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:24:56 2022] DELETE /identity/v3/projects/4bee5a84854b4ab1b5322e45ecff2490 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:24:56.450691 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0835a0-d74f-45af-b0eb-a30e475e228a None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:56.451116 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0835a0-d74f-45af-b0eb-a30e475e228a None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:56.452042 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0835a0-d74f-45af-b0eb-a30e475e228a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:56.478424 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-0a0835a0-d74f-45af-b0eb-a30e475e228a None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:56.480257 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-0a0835a0-d74f-45af-b0eb-a30e475e228a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:56.619073 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 709/1436] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:56.627147 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402b1e9-ad0c-4316-939e-6169d5b40d46 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:56.627606 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402b1e9-ad0c-4316-939e-6169d5b40d46 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:56.628167 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402b1e9-ad0c-4316-939e-6169d5b40d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:56.648479 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a7647-7d2c-4091-9086-956d9db16259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:56.651179 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a7647-7d2c-4091-9086-956d9db16259 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:56.651477 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a7647-7d2c-4091-9086-956d9db16259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:56.651761 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a7647-7d2c-4091-9086-956d9db16259 admin admin] PATH_INFO: `/v3/projects/2f8e54cc4f2e483c8d2a9212136cfedf/users/a4fcf98faa9645feae506fc4a2a59c00/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:56.684582 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-a402b1e9-ad0c-4316-939e-6169d5b40d46 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:56.690660 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a402b1e9-ad0c-4316-939e-6169d5b40d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:56.742335 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a7647-7d2c-4091-9086-956d9db16259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f8e54cc4f2e483c8d2a9212136cfedf, user_id=a4fcf98faa9645feae506fc4a2a59c00, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:56.744234 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 710/1437] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:56.756346 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248c5b9-6140-434c-afd9-6121b6678a28 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:56.756346 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248c5b9-6140-434c-afd9-6121b6678a28 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:56.756346 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248c5b9-6140-434c-afd9-6121b6678a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:56.763463 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a7647-7d2c-4091-9086-956d9db16259 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:56.845261 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 728/1438] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:24:56 2022] PUT /identity/v3/projects/2f8e54cc4f2e483c8d2a9212136cfedf/users/a4fcf98faa9645feae506fc4a2a59c00/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:24:56.846377 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a7647-7d2c-4091-9086-956d9db16259 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:56.881676 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-1248c5b9-6140-434c-afd9-6121b6678a28 None None] MFA Rules not processed for user `04d684ea21984ff699fea2c637044c3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:56.884369 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-1248c5b9-6140-434c-afd9-6121b6678a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:56.921801 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:57.061659 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 711/1439] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:57.070476 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c796d09-aade-4e3c-9ce7-9774d02a9ba3 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:57.070738 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c796d09-aade-4e3c-9ce7-9774d02a9ba3 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:57.070988 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c796d09-aade-4e3c-9ce7-9774d02a9ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:57.151884 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a7647-7d2c-4091-9086-956d9db16259 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:57.167347 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b76c6-bcb5-4f28-8683-f487cbf73323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:57.168375 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b76c6-bcb5-4f28-8683-f487cbf73323 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:57.168923 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b76c6-bcb5-4f28-8683-f487cbf73323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:57.169498 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b76c6-bcb5-4f28-8683-f487cbf73323 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:57.170636 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457b76c6-bcb5-4f28-8683-f487cbf73323 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:24:57.182033 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457b76c6-bcb5-4f28-8683-f487cbf73323 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:57.187986 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457b76c6-bcb5-4f28-8683-f487cbf73323 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:57.217093 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-2c796d09-aade-4e3c-9ce7-9774d02a9ba3 None None] MFA Rules not processed for user `a4fcf98faa9645feae506fc4a2a59c00`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:57.218335 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2c796d09-aade-4e3c-9ce7-9774d02a9ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:57.232677 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 729/1440] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:24:57.236200 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b76c6-bcb5-4f28-8683-f487cbf73323 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:57.267826 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b76c6-bcb5-4f28-8683-f487cbf73323 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:57.295045 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70bb0bb-53cb-4c8f-8602-10616e53556a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:57.295945 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bb0bb-53cb-4c8f-8602-10616e53556a admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:57.296398 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bb0bb-53cb-4c8f-8602-10616e53556a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:57.296826 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bb0bb-53cb-4c8f-8602-10616e53556a admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:57.298632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70bb0bb-53cb-4c8f-8602-10616e53556a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:57.304119 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70bb0bb-53cb-4c8f-8602-10616e53556a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:57.389791 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 730/1441] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:24:57 2022] POST /identity/v3/projects => generated 399 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:24:57.390063 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:57.393891 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70bb0bb-53cb-4c8f-8602-10616e53556a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:57.451267 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 712/1442] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:57.457702 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c796d09-aade-4e3c-9ce7-9774d02a9ba3 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:57.461172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2c796d09-aade-4e3c-9ce7-9774d02a9ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:57.514890 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c796d09-aade-4e3c-9ce7-9774d02a9ba3 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:57.575419 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70bb0bb-53cb-4c8f-8602-10616e53556a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:57.586153 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49f3be-885f-4771-8f21-adfe39e37148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:57.587864 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49f3be-885f-4771-8f21-adfe39e37148 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:57.588694 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49f3be-885f-4771-8f21-adfe39e37148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:57.589695 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49f3be-885f-4771-8f21-adfe39e37148 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:57.592622 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49f3be-885f-4771-8f21-adfe39e37148 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:57.596200 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49f3be-885f-4771-8f21-adfe39e37148 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:57.663080 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 731/1443] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:24:57 2022] POST /identity/v3/users => generated 300 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:24:57.665525 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49f3be-885f-4771-8f21-adfe39e37148 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:57.671974 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9a49f3be-885f-4771-8f21-adfe39e37148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:57.681703 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c49775-6743-43b9-b80c-fa8f31a52dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:57.682620 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c49775-6743-43b9-b80c-fa8f31a52dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:57.683054 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c49775-6743-43b9-b80c-fa8f31a52dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:57.683483 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c49775-6743-43b9-b80c-fa8f31a52dc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:57.685845 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c49775-6743-43b9-b80c-fa8f31a52dc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:57.689383 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c49775-6743-43b9-b80c-fa8f31a52dc7 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:57.693972 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49f3be-885f-4771-8f21-adfe39e37148 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:57.700652 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aab768-f940-499d-bc08-8c59cffb2b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:57.701813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aab768-f940-499d-bc08-8c59cffb2b23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:57.702263 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aab768-f940-499d-bc08-8c59cffb2b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:57.702693 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aab768-f940-499d-bc08-8c59cffb2b23 admin admin] PATH_INFO: `/v3/projects/4637352743a94d09bae9edda48820e6d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:57.705953 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aab768-f940-499d-bc08-8c59cffb2b23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4637352743a94d09bae9edda48820e6d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:57.710178 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aab768-f940-499d-bc08-8c59cffb2b23 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:57.758776 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 713/1444] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:24:57 2022] POST /identity/v3/projects => generated 367 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:24:57.759856 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c49775-6743-43b9-b80c-fa8f31a52dc7 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:57.803998 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-66aab768-f940-499d-bc08-8c59cffb2b23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4637352743a94d09bae9edda48820e6d', 'request_id': 'req-66aab768-f940-499d-bc08-8c59cffb2b23'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:57.819358 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-66aab768-f940-499d-bc08-8c59cffb2b23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4637352743a94d09bae9edda48820e6d', 'request_id': 'req-66aab768-f940-499d-bc08-8c59cffb2b23'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:57.834065 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-66aab768-f940-499d-bc08-8c59cffb2b23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4637352743a94d09bae9edda48820e6d', 'request_id': 'req-66aab768-f940-499d-bc08-8c59cffb2b23'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:57.849737 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:57.857500 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-66aab768-f940-499d-bc08-8c59cffb2b23 admin admin] The token cache is being invalidate because project 4637352743a94d09bae9edda48820e6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:24:57.860963 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-66aab768-f940-499d-bc08-8c59cffb2b23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:57.862846 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-66aab768-f940-499d-bc08-8c59cffb2b23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:24:57.865438 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 732/1445] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:24:57 2022] DELETE /identity/v3/projects/4637352743a94d09bae9edda48820e6d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:24:57.871369 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aab768-f940-499d-bc08-8c59cffb2b23 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:57.873580 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-66aab768-f940-499d-bc08-8c59cffb2b23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:57.903479 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c49775-6743-43b9-b80c-fa8f31a52dc7 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:57.979388 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aab768-f940-499d-bc08-8c59cffb2b23 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:57.992755 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386a60b-1c7a-473e-b13c-0014dc5f70fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:57.994538 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386a60b-1c7a-473e-b13c-0014dc5f70fd admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:57.994909 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386a60b-1c7a-473e-b13c-0014dc5f70fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:57.995296 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386a60b-1c7a-473e-b13c-0014dc5f70fd admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:58.010710 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386a60b-1c7a-473e-b13c-0014dc5f70fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:58.018180 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386a60b-1c7a-473e-b13c-0014dc5f70fd admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:58.058224 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5025d60-98d8-42c9-911f-949697f133b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:58.060119 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5025d60-98d8-42c9-911f-949697f133b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:58.061688 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5025d60-98d8-42c9-911f-949697f133b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:58.061976 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5025d60-98d8-42c9-911f-949697f133b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:58.065188 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5025d60-98d8-42c9-911f-949697f133b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:58.072173 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5025d60-98d8-42c9-911f-949697f133b2 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:58.078370 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 733/1446] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:24:57 2022] POST /identity/v3/users => generated 290 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:24:58.079855 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd12a47-7fe0-4388-990e-bc81ea6bb8be None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:58.082709 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd12a47-7fe0-4388-990e-bc81ea6bb8be None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:58.083186 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd12a47-7fe0-4388-990e-bc81ea6bb8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:58.099002 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 714/1447] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:24:58.106534 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5025d60-98d8-42c9-911f-949697f133b2 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:58.131828 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-cbd12a47-7fe0-4388-990e-bc81ea6bb8be None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:58.133140 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5025d60-98d8-42c9-911f-949697f133b2 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:58.134975 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cbd12a47-7fe0-4388-990e-bc81ea6bb8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:58.144049 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a5d10-2cc1-43ab-91d2-cd829d1c8f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:58.144860 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a5d10-2cc1-43ab-91d2-cd829d1c8f60 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:58.145440 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a5d10-2cc1-43ab-91d2-cd829d1c8f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:58.148078 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a5d10-2cc1-43ab-91d2-cd829d1c8f60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:58.148962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a5d10-2cc1-43ab-91d2-cd829d1c8f60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:58.150768 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a5d10-2cc1-43ab-91d2-cd829d1c8f60 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:58.163298 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 734/1448] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:58.164470 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd12a47-7fe0-4388-990e-bc81ea6bb8be None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:58.171883 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cbd12a47-7fe0-4388-990e-bc81ea6bb8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:58.177000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 715/1449] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:24:58.180878 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb5899-f170-45c5-9b12-0a594aa9a6a4 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:58.181388 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb5899-f170-45c5-9b12-0a594aa9a6a4 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:58.182865 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb5899-f170-45c5-9b12-0a594aa9a6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:58.211514 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd12a47-7fe0-4388-990e-bc81ea6bb8be None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:58.214963 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:58.222593 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-ddbb5899-f170-45c5-9b12-0a594aa9a6a4 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:58.223840 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639ce65-2e21-4fdb-b285-2aad50c5ff75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:58.224544 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ddbb5899-f170-45c5-9b12-0a594aa9a6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:58.224666 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639ce65-2e21-4fdb-b285-2aad50c5ff75 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:58.224973 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639ce65-2e21-4fdb-b285-2aad50c5ff75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:58.227225 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639ce65-2e21-4fdb-b285-2aad50c5ff75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:58.229676 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9639ce65-2e21-4fdb-b285-2aad50c5ff75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:58.231754 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9639ce65-2e21-4fdb-b285-2aad50c5ff75 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:58.240122 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 716/1450] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:58.241077 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb5899-f170-45c5-9b12-0a594aa9a6a4 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:58.254391 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb5899-f170-45c5-9b12-0a594aa9a6a4 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:58.268421 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1d171-6643-49c1-a894-8e73e38931c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:58.269222 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1d171-6643-49c1-a894-8e73e38931c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:58.269653 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1d171-6643-49c1-a894-8e73e38931c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:58.270988 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1d171-6643-49c1-a894-8e73e38931c5 admin admin] PATH_INFO: `/v3/projects/e6b2b9b3da4d44bd8d5242637346501d/users/d218bad62c1e48268ea1b231a7e9161b/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:58.276455 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 735/1451] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:24:58.276455 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639ce65-2e21-4fdb-b285-2aad50c5ff75 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:58.290677 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639ce65-2e21-4fdb-b285-2aad50c5ff75 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:58.298330 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a31284-5929-415b-ac8e-f243122dbd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:58.299485 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a31284-5929-415b-ac8e-f243122dbd66 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:58.300094 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a31284-5929-415b-ac8e-f243122dbd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:58.300596 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a31284-5929-415b-ac8e-f243122dbd66 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:58.301504 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a31284-5929-415b-ac8e-f243122dbd66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:24:58.302145 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a31284-5929-415b-ac8e-f243122dbd66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:58.304632 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1d171-6643-49c1-a894-8e73e38931c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6b2b9b3da4d44bd8d5242637346501d, user_id=d218bad62c1e48268ea1b231a7e9161b, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:58.304830 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a31284-5929-415b-ac8e-f243122dbd66 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:58.323509 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 736/1452] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:24:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:24:58.324789 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a31284-5929-415b-ac8e-f243122dbd66 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:58.327927 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1d171-6643-49c1-a894-8e73e38931c5 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:58.338603 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a31284-5929-415b-ac8e-f243122dbd66 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:58.345157 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e01720-4c6c-41e9-9152-7137a22af196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:58.346019 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e01720-4c6c-41e9-9152-7137a22af196 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:58.346331 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e01720-4c6c-41e9-9152-7137a22af196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:58.346657 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e01720-4c6c-41e9-9152-7137a22af196 admin admin] PATH_INFO: `/v3/projects/12b191ec07884b2184f82fcb2fff6d80/users/4c81fa10455d44b5b1fe36dcc3d63a60/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:58.361865 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 717/1453] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:24:58 2022] PUT /identity/v3/projects/e6b2b9b3da4d44bd8d5242637346501d/users/d218bad62c1e48268ea1b231a7e9161b/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:24:58.363045 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1d171-6643-49c1-a894-8e73e38931c5 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:58.369236 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e01720-4c6c-41e9-9152-7137a22af196 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12b191ec07884b2184f82fcb2fff6d80, user_id=4c81fa10455d44b5b1fe36dcc3d63a60, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:58.372686 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e01720-4c6c-41e9-9152-7137a22af196 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:58.440596 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 737/1454] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:24:58 2022] PUT /identity/v3/projects/12b191ec07884b2184f82fcb2fff6d80/users/4c81fa10455d44b5b1fe36dcc3d63a60/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:24:58.441778 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e01720-4c6c-41e9-9152-7137a22af196 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:58.521459 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1d171-6643-49c1-a894-8e73e38931c5 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:58.650291 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e01720-4c6c-41e9-9152-7137a22af196 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:58.655572 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532f30a-af1d-4ad4-aaad-ebd9bbc7a328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:58.656274 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532f30a-af1d-4ad4-aaad-ebd9bbc7a328 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:58.656557 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532f30a-af1d-4ad4-aaad-ebd9bbc7a328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:58.656971 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532f30a-af1d-4ad4-aaad-ebd9bbc7a328 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:58.657931 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532f30a-af1d-4ad4-aaad-ebd9bbc7a328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:58.660207 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532f30a-af1d-4ad4-aaad-ebd9bbc7a328 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:58.671449 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93ced8-c2b4-4337-9549-0345213e3201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:58.672857 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93ced8-c2b4-4337-9549-0345213e3201 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:58.673221 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93ced8-c2b4-4337-9549-0345213e3201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:58.673571 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93ced8-c2b4-4337-9549-0345213e3201 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:58.674337 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd93ced8-c2b4-4337-9549-0345213e3201 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:58.676417 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd93ced8-c2b4-4337-9549-0345213e3201 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:58.676902 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 738/1455] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:24:58.678276 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca58ab9-999d-451d-84fd-2b7976c50ece None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:58.678569 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca58ab9-999d-451d-84fd-2b7976c50ece None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:58.678897 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca58ab9-999d-451d-84fd-2b7976c50ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:58.715062 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-fca58ab9-999d-451d-84fd-2b7976c50ece None None] MFA Rules not processed for user `4c81fa10455d44b5b1fe36dcc3d63a60`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:58.716620 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fca58ab9-999d-451d-84fd-2b7976c50ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:58.731403 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 718/1456] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:24:58 2022] POST /identity/v3/projects => generated 387 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:24:58.732294 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93ced8-c2b4-4337-9549-0345213e3201 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:58.760973 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:58.837665 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93ced8-c2b4-4337-9549-0345213e3201 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:58.842635 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 739/1457] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:58 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:58.843072 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50b8f3-f4c6-44a7-84f4-c111b6922880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:58.843751 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50b8f3-f4c6-44a7-84f4-c111b6922880 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:58.844068 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50b8f3-f4c6-44a7-84f4-c111b6922880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:58.844493 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca58ab9-999d-451d-84fd-2b7976c50ece None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:58.844602 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50b8f3-f4c6-44a7-84f4-c111b6922880 admin admin] PATH_INFO: `/v3/projects/e6b2b9b3da4d44bd8d5242637346501d/users/d218bad62c1e48268ea1b231a7e9161b/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:58.849181 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50b8f3-f4c6-44a7-84f4-c111b6922880 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6b2b9b3da4d44bd8d5242637346501d, user_id=d218bad62c1e48268ea1b231a7e9161b, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:58.855087 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50b8f3-f4c6-44a7-84f4-c111b6922880 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:58.856894 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca58ab9-999d-451d-84fd-2b7976c50ece None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:58.864055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ed764-505e-4985-8c32-8e5666496276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:58.864814 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ed764-505e-4985-8c32-8e5666496276 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:58.865193 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ed764-505e-4985-8c32-8e5666496276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:58.865633 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ed764-505e-4985-8c32-8e5666496276 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:58.866507 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ed764-505e-4985-8c32-8e5666496276 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:58.876078 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 719/1458] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:24:58 2022] PUT /identity/v3/projects/e6b2b9b3da4d44bd8d5242637346501d/users/d218bad62c1e48268ea1b231a7e9161b/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:24:58.877553 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50b8f3-f4c6-44a7-84f4-c111b6922880 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:58.880271 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ed764-505e-4985-8c32-8e5666496276 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:58.883571 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:58.913726 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 740/1459] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:24:58 2022] POST /identity/v3/users => generated 294 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:24:58.919748 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e0712-b0db-489c-9ac9-78ee0a8dac12 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:58.920187 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e0712-b0db-489c-9ac9-78ee0a8dac12 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:58.920581 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e0712-b0db-489c-9ac9-78ee0a8dac12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:58.981428 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-199e0712-b0db-489c-9ac9-78ee0a8dac12 None None] MFA Rules not processed for user `d218bad62c1e48268ea1b231a7e9161b`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:58.991997 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-199e0712-b0db-489c-9ac9-78ee0a8dac12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:59.083887 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50b8f3-f4c6-44a7-84f4-c111b6922880 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:59.090105 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9becdba8-aeea-4e74-b559-79e6ef3a52b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:59.090826 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becdba8-aeea-4e74-b559-79e6ef3a52b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:59.091234 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becdba8-aeea-4e74-b559-79e6ef3a52b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:59.091796 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becdba8-aeea-4e74-b559-79e6ef3a52b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:59.092508 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9becdba8-aeea-4e74-b559-79e6ef3a52b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:59.094844 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9becdba8-aeea-4e74-b559-79e6ef3a52b9 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:59.151984 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 720/1460] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:24:58 2022] POST /identity/v3/projects => generated 401 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:24:59.151984 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9becdba8-aeea-4e74-b559-79e6ef3a52b9 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:59.303214 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9becdba8-aeea-4e74-b559-79e6ef3a52b9 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:59.316263 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f44e8-0fa1-4f5c-b491-191b11d0e758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:59.317207 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f44e8-0fa1-4f5c-b491-191b11d0e758 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:59.319716 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f44e8-0fa1-4f5c-b491-191b11d0e758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:59.320638 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f44e8-0fa1-4f5c-b491-191b11d0e758 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:59.322634 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f44e8-0fa1-4f5c-b491-191b11d0e758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:59.329489 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f44e8-0fa1-4f5c-b491-191b11d0e758 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:59.350060 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 741/1461] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:58 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:59.353909 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e0712-b0db-489c-9ac9-78ee0a8dac12 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:59.367193 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 721/1462] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:24:59.371152 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc9677-9fb0-4fd3-893f-31a7c0840674 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:59.371446 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc9677-9fb0-4fd3-893f-31a7c0840674 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:59.371730 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc9677-9fb0-4fd3-893f-31a7c0840674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:59.393434 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e0712-b0db-489c-9ac9-78ee0a8dac12 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:59.420614 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb712a01-516f-48e4-9837-515697441815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:59.421251 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb712a01-516f-48e4-9837-515697441815 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:59.421534 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb712a01-516f-48e4-9837-515697441815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:59.421809 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb712a01-516f-48e4-9837-515697441815 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:59.423185 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb712a01-516f-48e4-9837-515697441815 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:59.425283 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb712a01-516f-48e4-9837-515697441815 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:59.505477 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 742/1463] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:24:59 2022] POST /identity/v3/users => generated 307 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:24:59.508071 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb712a01-516f-48e4-9837-515697441815 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:24:59.511990 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-eb712a01-516f-48e4-9837-515697441815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:59.695070 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb712a01-516f-48e4-9837-515697441815 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:24:59.704672 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099caba-ab35-4390-9385-b40be702c247 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:24:59.705391 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099caba-ab35-4390-9385-b40be702c247 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:59.705830 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099caba-ab35-4390-9385-b40be702c247 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:59.706104 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099caba-ab35-4390-9385-b40be702c247 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:59.713115 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-cefc9677-9fb0-4fd3-893f-31a7c0840674 None None] MFA Rules not processed for user `9d5d4691dca848d58bd280d2fad79fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:24:59.716163 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-cefc9677-9fb0-4fd3-893f-31a7c0840674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:24:59.799549 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:59.897980 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099caba-ab35-4390-9385-b40be702c247 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:24:59.900358 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099caba-ab35-4390-9385-b40be702c247 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:24:59.928603 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:24:59.948939 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 743/1464] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:24:59 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:24:59.949550 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 722/1465] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 25 13:24:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 582 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:24:59.950897 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da0d20-e809-4edd-b61b-870264a59253 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:24:59.951185 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da0d20-e809-4edd-b61b-870264a59253 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:24:59.951461 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da0d20-e809-4edd-b61b-870264a59253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:24:59.952851 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099caba-ab35-4390-9385-b40be702c247 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:00.013496 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099caba-ab35-4390-9385-b40be702c247 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:00.040844 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4decef1f-227d-4102-8da9-8d72b20b37f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:00.043195 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decef1f-227d-4102-8da9-8d72b20b37f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:00.043488 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decef1f-227d-4102-8da9-8d72b20b37f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:00.043771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decef1f-227d-4102-8da9-8d72b20b37f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:00.048565 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4decef1f-227d-4102-8da9-8d72b20b37f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:00.050600 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4decef1f-227d-4102-8da9-8d72b20b37f1 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:00.078280 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-c0da0d20-e809-4edd-b61b-870264a59253 None None] MFA Rules not processed for user `2a2ed118a399479ab355bfd5734d04d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:00.079887 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 744/1466] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:00.080651 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4decef1f-227d-4102-8da9-8d72b20b37f1 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:00.094924 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4decef1f-227d-4102-8da9-8d72b20b37f1 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:00.096574 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c0da0d20-e809-4edd-b61b-870264a59253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:00.104908 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480be12-30e8-476e-8d2a-2d2bbe5ad861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:00.106747 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480be12-30e8-476e-8d2a-2d2bbe5ad861 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:00.107589 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480be12-30e8-476e-8d2a-2d2bbe5ad861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:00.107882 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480be12-30e8-476e-8d2a-2d2bbe5ad861 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:00.111227 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480be12-30e8-476e-8d2a-2d2bbe5ad861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:00.116561 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480be12-30e8-476e-8d2a-2d2bbe5ad861 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:00.150456 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 745/1467] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:00 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:00.150456 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480be12-30e8-476e-8d2a-2d2bbe5ad861 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:00.177851 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480be12-30e8-476e-8d2a-2d2bbe5ad861 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:00.184244 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbf2de-83d2-4644-802a-ff28d0213fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:00.184955 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbf2de-83d2-4644-802a-ff28d0213fc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:00.185322 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbf2de-83d2-4644-802a-ff28d0213fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:00.185683 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbf2de-83d2-4644-802a-ff28d0213fc5 admin admin] PATH_INFO: `/v3/projects/c96ee337480b4e89b2d64c9cb8ed67fa/users/7c8fcc45d80f416a90f823c5e1bd28eb/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:00.216654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fbf2de-83d2-4644-802a-ff28d0213fc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c96ee337480b4e89b2d64c9cb8ed67fa, user_id=7c8fcc45d80f416a90f823c5e1bd28eb, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:00.220542 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fbf2de-83d2-4644-802a-ff28d0213fc5 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:00.257009 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 746/1468] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:25:00 2022] PUT /identity/v3/projects/c96ee337480b4e89b2d64c9cb8ed67fa/users/7c8fcc45d80f416a90f823c5e1bd28eb/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:00.257009 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbf2de-83d2-4644-802a-ff28d0213fc5 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:00.259635 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c9fbf2de-83d2-4644-802a-ff28d0213fc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:00.314405 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 723/1469] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:24:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:00.315617 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da0d20-e809-4edd-b61b-870264a59253 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:00.365677 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da0d20-e809-4edd-b61b-870264a59253 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:00.384619 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbf2de-83d2-4644-802a-ff28d0213fc5 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:00.392092 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c13498-8f2a-4a7f-bffd-082fec802970 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:00.392890 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c13498-8f2a-4a7f-bffd-082fec802970 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:00.393665 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c13498-8f2a-4a7f-bffd-082fec802970 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:00.393961 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c13498-8f2a-4a7f-bffd-082fec802970 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:00.396432 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-60c13498-8f2a-4a7f-bffd-082fec802970 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:00.577250 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a64305-405d-425e-9699-e394a5b996e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:00.578136 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a64305-405d-425e-9699-e394a5b996e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:00.578607 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a64305-405d-425e-9699-e394a5b996e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:00.579447 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a64305-405d-425e-9699-e394a5b996e4 admin admin] PATH_INFO: `/v3/projects/baa55084b14d4297bba60fc770220424/users/c96d04edeeef4abebb3d79fff8b46643/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:00.622270 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a64305-405d-425e-9699-e394a5b996e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baa55084b14d4297bba60fc770220424, user_id=c96d04edeeef4abebb3d79fff8b46643, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:00.625086 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a64305-405d-425e-9699-e394a5b996e4 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:00.635182 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c13498-8f2a-4a7f-bffd-082fec802970 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:00.643539 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c13498-8f2a-4a7f-bffd-082fec802970 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:00.651385 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 724/1470] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:25:00 2022] PUT /identity/v3/projects/baa55084b14d4297bba60fc770220424/users/c96d04edeeef4abebb3d79fff8b46643/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:00.652867 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb08403-d04d-46ea-aa17-6c9653b255ee None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:00.653160 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb08403-d04d-46ea-aa17-6c9653b255ee None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:00.658139 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb08403-d04d-46ea-aa17-6c9653b255ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:00.707235 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 747/1471] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:25:00.709293 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c13498-8f2a-4a7f-bffd-082fec802970 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:00.721148 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-60c13498-8f2a-4a7f-bffd-082fec802970 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:00.766464 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-7bb08403-d04d-46ea-aa17-6c9653b255ee None None] MFA Rules not processed for user `7c8fcc45d80f416a90f823c5e1bd28eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:00.770199 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-7bb08403-d04d-46ea-aa17-6c9653b255ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:00.836162 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:00.979086 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 725/1472] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:00.980156 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb08403-d04d-46ea-aa17-6c9653b255ee None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:01.023121 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:01.041677 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c13498-8f2a-4a7f-bffd-082fec802970 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:01.123545 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb08403-d04d-46ea-aa17-6c9653b255ee None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:01.132370 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a001ff-9a09-4650-9369-206ba0220319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:01.133164 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a001ff-9a09-4650-9369-206ba0220319 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:01.134191 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a001ff-9a09-4650-9369-206ba0220319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:01.134191 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a001ff-9a09-4650-9369-206ba0220319 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:01.134793 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a001ff-9a09-4650-9369-206ba0220319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:01.138035 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a001ff-9a09-4650-9369-206ba0220319 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:01.156683 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 726/1473] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:00 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:01.157837 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a001ff-9a09-4650-9369-206ba0220319 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:01.179204 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a001ff-9a09-4650-9369-206ba0220319 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:01.204716 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b4862-6cea-431d-b17b-1816574380a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:01.206952 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b4862-6cea-431d-b17b-1816574380a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:01.207230 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b4862-6cea-431d-b17b-1816574380a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:01.210844 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b4862-6cea-431d-b17b-1816574380a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:01.211525 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b4862-6cea-431d-b17b-1816574380a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:01.226973 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b4862-6cea-431d-b17b-1816574380a9 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:01.385316 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 727/1474] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:25:01 2022] POST /identity/v3/projects => generated 385 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:25:01.386294 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b4862-6cea-431d-b17b-1816574380a9 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:01.436516 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d4e88b-c4c3-4cd4-b50a-e4c12926c349 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07413369b0c14e878d04ee528487801d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:01.441296 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4e88b-c4c3-4cd4-b50a-e4c12926c349 service swift] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:01.441606 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4e88b-c4c3-4cd4-b50a-e4c12926c349 service swift] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:01.448124 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4e88b-c4c3-4cd4-b50a-e4c12926c349 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:01.622693 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b4862-6cea-431d-b17b-1816574380a9 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:01.635151 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da3fba-fc61-44a5-96e6-3a1bfb3aa5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:01.637877 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da3fba-fc61-44a5-96e6-3a1bfb3aa5a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:01.638158 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da3fba-fc61-44a5-96e6-3a1bfb3aa5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:01.638434 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da3fba-fc61-44a5-96e6-3a1bfb3aa5a0 admin admin] PATH_INFO: `/v3/projects/baa55084b14d4297bba60fc770220424/users/c96d04edeeef4abebb3d79fff8b46643/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:01.640381 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d4e88b-c4c3-4cd4-b50a-e4c12926c349 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:01.642952 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d4e88b-c4c3-4cd4-b50a-e4c12926c349 service swift] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:01.645535 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da3fba-fc61-44a5-96e6-3a1bfb3aa5a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baa55084b14d4297bba60fc770220424, user_id=c96d04edeeef4abebb3d79fff8b46643, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:01.651337 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da3fba-fc61-44a5-96e6-3a1bfb3aa5a0 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:01.667786 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 748/1475] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 25 13:25:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 959 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 25 13:25:01.669455 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d4e88b-c4c3-4cd4-b50a-e4c12926c349 service swift] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:01.700600 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 728/1476] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:25:01 2022] PUT /identity/v3/projects/baa55084b14d4297bba60fc770220424/users/c96d04edeeef4abebb3d79fff8b46643/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:01.714108 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f29eb7-45a2-44be-94d1-49d039b0dc9b None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:01.714394 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f29eb7-45a2-44be-94d1-49d039b0dc9b None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:01.714773 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f29eb7-45a2-44be-94d1-49d039b0dc9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:01.737908 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d4e88b-c4c3-4cd4-b50a-e4c12926c349 service swift] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:01.873831 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-08f29eb7-45a2-44be-94d1-49d039b0dc9b None None] MFA Rules not processed for user `c96d04edeeef4abebb3d79fff8b46643`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:01.875150 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-08f29eb7-45a2-44be-94d1-49d039b0dc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:02.056991 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:02.105974 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaff0ba-fbcc-4710-8138-6d899ebf359e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:02.108458 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaff0ba-fbcc-4710-8138-6d899ebf359e admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:02.112537 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaff0ba-fbcc-4710-8138-6d899ebf359e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:02.113653 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaff0ba-fbcc-4710-8138-6d899ebf359e admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:02.115626 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaff0ba-fbcc-4710-8138-6d899ebf359e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:02.121944 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaff0ba-fbcc-4710-8138-6d899ebf359e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:02.173124 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 729/1477] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:01 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:02.174894 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f29eb7-45a2-44be-94d1-49d039b0dc9b None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:02.208951 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:02.217228 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 749/1478] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:25:01 2022] POST /identity/v3/users => generated 299 bytes in 546 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:25:02.238118 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaff0ba-fbcc-4710-8138-6d899ebf359e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:02.295425 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaff0ba-fbcc-4710-8138-6d899ebf359e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:02.317322 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abac060-6b22-4ac4-a720-087d4dbe087e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:02.334190 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abac060-6b22-4ac4-a720-087d4dbe087e admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:02.334190 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abac060-6b22-4ac4-a720-087d4dbe087e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:02.335185 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abac060-6b22-4ac4-a720-087d4dbe087e admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:02.335185 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abac060-6b22-4ac4-a720-087d4dbe087e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:02.349279 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abac060-6b22-4ac4-a720-087d4dbe087e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:02.378774 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f29eb7-45a2-44be-94d1-49d039b0dc9b None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:02.392164 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee06b0-5c7b-4d15-868a-1f9060e93248 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:02.393275 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee06b0-5c7b-4d15-868a-1f9060e93248 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:02.393719 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee06b0-5c7b-4d15-868a-1f9060e93248 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:02.394311 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee06b0-5c7b-4d15-868a-1f9060e93248 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:02.419540 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 750/1479] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:02.420492 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee06b0-5c7b-4d15-868a-1f9060e93248 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:02.422928 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee06b0-5c7b-4d15-868a-1f9060e93248 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:02.424526 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abac060-6b22-4ac4-a720-087d4dbe087e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:02.472486 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 730/1480] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:02 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:25:02.479850 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abac060-6b22-4ac4-a720-087d4dbe087e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:02.522557 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce143125-9306-4463-91d0-adcd0beabf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:02.528864 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce143125-9306-4463-91d0-adcd0beabf4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:02.530383 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce143125-9306-4463-91d0-adcd0beabf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:02.538168 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce143125-9306-4463-91d0-adcd0beabf4d admin admin] PATH_INFO: `/v3/projects/15e9f9ba409b474e9fa79df4c5b7e602/users/2f0f2d980fb4424985b19e4ca42ca158/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:02.608119 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee06b0-5c7b-4d15-868a-1f9060e93248 service cinder] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:02.620506 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee06b0-5c7b-4d15-868a-1f9060e93248 service cinder] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:02.636633 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5f404-791f-4024-a8e0-6bffa3e8ec7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:02.637334 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5f404-791f-4024-a8e0-6bffa3e8ec7d service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:02.637623 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5f404-791f-4024-a8e0-6bffa3e8ec7d service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:02.637899 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5f404-791f-4024-a8e0-6bffa3e8ec7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:02.646353 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce143125-9306-4463-91d0-adcd0beabf4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=15e9f9ba409b474e9fa79df4c5b7e602, user_id=2f0f2d980fb4424985b19e4ca42ca158, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:02.667331 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce143125-9306-4463-91d0-adcd0beabf4d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:02.757492 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 751/1481] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:25:02 2022] PUT /identity/v3/projects/15e9f9ba409b474e9fa79df4c5b7e602/users/2f0f2d980fb4424985b19e4ca42ca158/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:02.761189 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce143125-9306-4463-91d0-adcd0beabf4d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:02.966467 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5f404-791f-4024-a8e0-6bffa3e8ec7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:02.970728 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5f404-791f-4024-a8e0-6bffa3e8ec7d service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:03.024421 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 731/1482] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:02 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 13:25:03.120306 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce143125-9306-4463-91d0-adcd0beabf4d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:03.157288 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b14eb4-2e7c-46bf-8aa6-02e338e63a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:03.157940 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b14eb4-2e7c-46bf-8aa6-02e338e63a5f admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:03.158222 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b14eb4-2e7c-46bf-8aa6-02e338e63a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:03.158493 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b14eb4-2e7c-46bf-8aa6-02e338e63a5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:03.159153 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b14eb4-2e7c-46bf-8aa6-02e338e63a5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:03.160798 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b14eb4-2e7c-46bf-8aa6-02e338e63a5f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:03.245869 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5f404-791f-4024-a8e0-6bffa3e8ec7d service cinder] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:03.249091 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 752/1483] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 486 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:03.288869 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5f404-791f-4024-a8e0-6bffa3e8ec7d service cinder] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:03.311252 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8edcbc2-0703-4239-b699-2525c4df3941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:03.312091 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8edcbc2-0703-4239-b699-2525c4df3941 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:03.312276 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8edcbc2-0703-4239-b699-2525c4df3941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:03.312518 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8edcbc2-0703-4239-b699-2525c4df3941 admin admin] PATH_INFO: `/v3/projects/15e9f9ba409b474e9fa79df4c5b7e602/users/2f0f2d980fb4424985b19e4ca42ca158/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:03.340973 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8edcbc2-0703-4239-b699-2525c4df3941 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15e9f9ba409b474e9fa79df4c5b7e602, user_id=2f0f2d980fb4424985b19e4ca42ca158, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:03.343669 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8edcbc2-0703-4239-b699-2525c4df3941 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:03.426675 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 732/1484] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:25:03 2022] PUT /identity/v3/projects/15e9f9ba409b474e9fa79df4c5b7e602/users/2f0f2d980fb4424985b19e4ca42ca158/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:03.428834 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8af0d-5e95-4545-b44e-54dbc1f1af28 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:03.429035 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8af0d-5e95-4545-b44e-54dbc1f1af28 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:03.429382 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8af0d-5e95-4545-b44e-54dbc1f1af28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:03.535176 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-2bd8af0d-5e95-4545-b44e-54dbc1f1af28 None None] MFA Rules not processed for user `2f0f2d980fb4424985b19e4ca42ca158`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:03.536487 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2bd8af0d-5e95-4545-b44e-54dbc1f1af28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:03.855881 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 753/1485] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:03 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:03.879324 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8edcbc2-0703-4239-b699-2525c4df3941 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:04.162615 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8edcbc2-0703-4239-b699-2525c4df3941 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:04.194640 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9112b3d-1af7-4a59-b443-5265d7ff8afa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:04.202635 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9112b3d-1af7-4a59-b443-5265d7ff8afa service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:04.204048 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9112b3d-1af7-4a59-b443-5265d7ff8afa service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:04.204362 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9112b3d-1af7-4a59-b443-5265d7ff8afa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:04.239202 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9112b3d-1af7-4a59-b443-5265d7ff8afa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:04.242249 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9112b3d-1af7-4a59-b443-5265d7ff8afa service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:04.296265 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 733/1486] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:03 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:25:04.346259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8af0d-5e95-4545-b44e-54dbc1f1af28 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:04.494352 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:04.616525 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8af0d-5e95-4545-b44e-54dbc1f1af28 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:04.623413 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bac04d-7131-47e8-ada6-48e4c3dc2e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:04.624615 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bac04d-7131-47e8-ada6-48e4c3dc2e89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:04.625210 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bac04d-7131-47e8-ada6-48e4c3dc2e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:04.626398 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bac04d-7131-47e8-ada6-48e4c3dc2e89 admin admin] PATH_INFO: `/v3/users/7c8fcc45d80f416a90f823c5e1bd28eb` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:04.628405 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bac04d-7131-47e8-ada6-48e4c3dc2e89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c8fcc45d80f416a90f823c5e1bd28eb)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:04.630828 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bac04d-7131-47e8-ada6-48e4c3dc2e89 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:04.737864 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f7bac04d-7131-47e8-ada6-48e4c3dc2e89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c8fcc45d80f416a90f823c5e1bd28eb'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:04.739017 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f7bac04d-7131-47e8-ada6-48e4c3dc2e89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c8fcc45d80f416a90f823c5e1bd28eb'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:04.764605 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f7bac04d-7131-47e8-ada6-48e4c3dc2e89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c8fcc45d80f416a90f823c5e1bd28eb'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:04.784139 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f7bac04d-7131-47e8-ada6-48e4c3dc2e89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c8fcc45d80f416a90f823c5e1bd28eb'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:04.804560 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f7bac04d-7131-47e8-ada6-48e4c3dc2e89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c8fcc45d80f416a90f823c5e1bd28eb'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:04.823404 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 754/1487] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:25:04 2022] DELETE /identity/v3/users/7c8fcc45d80f416a90f823c5e1bd28eb => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:04.830377 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26fb74-3041-4b11-b980-6958da75be89 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:04.830478 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26fb74-3041-4b11-b980-6958da75be89 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:04.830809 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26fb74-3041-4b11-b980-6958da75be89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:04.889738 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-8f26fb74-3041-4b11-b980-6958da75be89 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:04.894511 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-8f26fb74-3041-4b11-b980-6958da75be89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:05.020571 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:05.085312 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 734/1488] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:05.257771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bac04d-7131-47e8-ada6-48e4c3dc2e89 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:05.259469 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f7bac04d-7131-47e8-ada6-48e4c3dc2e89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:05.471384 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bac04d-7131-47e8-ada6-48e4c3dc2e89 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:05.483721 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebbb564-2b0a-44f3-8af2-b1e8364d0b07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:05.489424 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbb564-2b0a-44f3-8af2-b1e8364d0b07 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:05.490075 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbb564-2b0a-44f3-8af2-b1e8364d0b07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:05.490564 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbb564-2b0a-44f3-8af2-b1e8364d0b07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:05.530331 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebbb564-2b0a-44f3-8af2-b1e8364d0b07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:05.534407 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebbb564-2b0a-44f3-8af2-b1e8364d0b07 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:05.591208 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 755/1489] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:25:06.510577 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0ffa6-4081-4094-b5a0-9e0ecf4f847b None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:06.511662 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0ffa6-4081-4094-b5a0-9e0ecf4f847b None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:06.512119 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0ffa6-4081-4094-b5a0-9e0ecf4f847b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:06.583396 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-74d0ffa6-4081-4094-b5a0-9e0ecf4f847b None None] MFA Rules not processed for user `cec40e8c81fe4eafb474d40bc7bf38fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:06.586874 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-74d0ffa6-4081-4094-b5a0-9e0ecf4f847b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:06.629455 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 735/1490] 10.222.0.44 () {58 vars in 1015 bytes} [Tue Oct 25 13:25:06 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:25:06.718793 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebbb564-2b0a-44f3-8af2-b1e8364d0b07 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:06.720598 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0ffa6-4081-4094-b5a0-9e0ecf4f847b None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:06.723062 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-74d0ffa6-4081-4094-b5a0-9e0ecf4f847b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:06.723961 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6ebbb564-2b0a-44f3-8af2-b1e8364d0b07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:06.802726 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebbb564-2b0a-44f3-8af2-b1e8364d0b07 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:06.807983 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0ffa6-4081-4094-b5a0-9e0ecf4f847b None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:06.836297 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71c142-360c-461a-99d0-0314a86b37b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:06.836944 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71c142-360c-461a-99d0-0314a86b37b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:06.837230 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71c142-360c-461a-99d0-0314a86b37b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:06.837512 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71c142-360c-461a-99d0-0314a86b37b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:06.849713 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c547d-282a-4e43-b9ca-9c4ba4350088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:06.850346 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c547d-282a-4e43-b9ca-9c4ba4350088 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:06.850629 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c547d-282a-4e43-b9ca-9c4ba4350088 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:06.850905 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c547d-282a-4e43-b9ca-9c4ba4350088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:06.900758 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71c142-360c-461a-99d0-0314a86b37b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:06.910808 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71c142-360c-461a-99d0-0314a86b37b1 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:06.912071 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c547d-282a-4e43-b9ca-9c4ba4350088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:06.917364 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c547d-282a-4e43-b9ca-9c4ba4350088 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:06.986100 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 756/1491] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:25:06.989374 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71c142-360c-461a-99d0-0314a86b37b1 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:06.996866 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 736/1492] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:25:07.025849 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71c142-360c-461a-99d0-0314a86b37b1 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:07.064522 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29483cad-c11c-4449-a968-16c44b549b62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:07.073832 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29483cad-c11c-4449-a968-16c44b549b62 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:07.074125 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29483cad-c11c-4449-a968-16c44b549b62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:07.074417 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29483cad-c11c-4449-a968-16c44b549b62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:07.124081 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29483cad-c11c-4449-a968-16c44b549b62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:07.129788 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29483cad-c11c-4449-a968-16c44b549b62 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:07.174589 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 757/1493] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:25:07.576608 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c547d-282a-4e43-b9ca-9c4ba4350088 service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:07.578030 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-f03c547d-282a-4e43-b9ca-9c4ba4350088 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:07.621538 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c547d-282a-4e43-b9ca-9c4ba4350088 service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:07.628241 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f292224-e20f-4a83-bd94-1690b551b73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:07.629148 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f292224-e20f-4a83-bd94-1690b551b73a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:07.629588 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f292224-e20f-4a83-bd94-1690b551b73a admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:07.630303 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f292224-e20f-4a83-bd94-1690b551b73a admin admin] PATH_INFO: `/v3/users/a4fcf98faa9645feae506fc4a2a59c00` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:07.631951 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f292224-e20f-4a83-bd94-1690b551b73a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4fcf98faa9645feae506fc4a2a59c00)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:07.634677 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f292224-e20f-4a83-bd94-1690b551b73a admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:07.820467 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-7f292224-e20f-4a83-bd94-1690b551b73a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4fcf98faa9645feae506fc4a2a59c00'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:07.879657 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-7f292224-e20f-4a83-bd94-1690b551b73a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4fcf98faa9645feae506fc4a2a59c00'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:07.883485 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-7f292224-e20f-4a83-bd94-1690b551b73a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4fcf98faa9645feae506fc4a2a59c00'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:07.898240 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-7f292224-e20f-4a83-bd94-1690b551b73a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4fcf98faa9645feae506fc4a2a59c00'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:07.899001 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-7f292224-e20f-4a83-bd94-1690b551b73a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4fcf98faa9645feae506fc4a2a59c00'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:07.920107 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 737/1494] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:25:07 2022] DELETE /identity/v3/users/a4fcf98faa9645feae506fc4a2a59c00 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:07.925290 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2548f-e798-4265-8b23-58c7dec0199f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:07.925840 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2548f-e798-4265-8b23-58c7dec0199f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:07.925840 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2548f-e798-4265-8b23-58c7dec0199f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:07.962775 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-88c2548f-e798-4265-8b23-58c7dec0199f None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:07.964263 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-88c2548f-e798-4265-8b23-58c7dec0199f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:08.022180 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:08.137303 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 758/1495] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:08.277657 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f292224-e20f-4a83-bd94-1690b551b73a admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:08.279985 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-7f292224-e20f-4a83-bd94-1690b551b73a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:08.467549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f292224-e20f-4a83-bd94-1690b551b73a admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:08.485771 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f65ff-92ab-457f-80c6-462aecf9df6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:08.486725 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f65ff-92ab-457f-80c6-462aecf9df6d service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:08.487368 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f65ff-92ab-457f-80c6-462aecf9df6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:08.487809 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f65ff-92ab-457f-80c6-462aecf9df6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:08.533861 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f65ff-92ab-457f-80c6-462aecf9df6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:08.539570 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f65ff-92ab-457f-80c6-462aecf9df6d service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:08.585311 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 738/1496] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:25:09.639810 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2548f-e798-4265-8b23-58c7dec0199f None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:09.642502 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-88c2548f-e798-4265-8b23-58c7dec0199f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:09.669822 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2548f-e798-4265-8b23-58c7dec0199f None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:09.688734 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c07dba-775e-4472-96d3-043aa1276a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:09.689411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c07dba-775e-4472-96d3-043aa1276a64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:09.689795 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c07dba-775e-4472-96d3-043aa1276a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:09.689963 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c07dba-775e-4472-96d3-043aa1276a64 admin admin] PATH_INFO: `/v3/users/4c81fa10455d44b5b1fe36dcc3d63a60` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:09.692147 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c07dba-775e-4472-96d3-043aa1276a64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c81fa10455d44b5b1fe36dcc3d63a60)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:09.694256 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c07dba-775e-4472-96d3-043aa1276a64 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:09.814281 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-61c07dba-775e-4472-96d3-043aa1276a64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c81fa10455d44b5b1fe36dcc3d63a60'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:09.822506 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-61c07dba-775e-4472-96d3-043aa1276a64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c81fa10455d44b5b1fe36dcc3d63a60'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:09.890225 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-61c07dba-775e-4472-96d3-043aa1276a64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c81fa10455d44b5b1fe36dcc3d63a60'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:09.932865 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-61c07dba-775e-4472-96d3-043aa1276a64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c81fa10455d44b5b1fe36dcc3d63a60'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:10.015702 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-61c07dba-775e-4472-96d3-043aa1276a64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c81fa10455d44b5b1fe36dcc3d63a60'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:10.031418 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8a453-e432-4a13-9336-3d6a12679eed None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:10.032609 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8a453-e432-4a13-9336-3d6a12679eed None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:10.032609 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8a453-e432-4a13-9336-3d6a12679eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:10.039717 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 759/1497] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:25:09 2022] DELETE /identity/v3/users/4c81fa10455d44b5b1fe36dcc3d63a60 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:10.057297 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-b8f8a453-e432-4a13-9336-3d6a12679eed None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:10.058794 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b8f8a453-e432-4a13-9336-3d6a12679eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:10.096336 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:10.165479 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 739/1498] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:10.271560 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c07dba-775e-4472-96d3-043aa1276a64 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:10.273169 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-61c07dba-775e-4472-96d3-043aa1276a64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:10.476663 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c07dba-775e-4472-96d3-043aa1276a64 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:10.490784 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6cf06-cb64-45ec-ad4d-0c3f8cf8c420 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:10.491626 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6cf06-cb64-45ec-ad4d-0c3f8cf8c420 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:10.492212 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6cf06-cb64-45ec-ad4d-0c3f8cf8c420 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:10.492502 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6cf06-cb64-45ec-ad4d-0c3f8cf8c420 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:10.517038 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6cf06-cb64-45ec-ad4d-0c3f8cf8c420 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:10.525187 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6cf06-cb64-45ec-ad4d-0c3f8cf8c420 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:10.552297 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 760/1499] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:25:11.191102 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8a453-e432-4a13-9336-3d6a12679eed None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:11.192954 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b8f8a453-e432-4a13-9336-3d6a12679eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:11.229826 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8a453-e432-4a13-9336-3d6a12679eed None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:11.247139 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a27f5-0df4-4250-b244-e848cc7536ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:11.249203 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a27f5-0df4-4250-b244-e848cc7536ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:11.250474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a27f5-0df4-4250-b244-e848cc7536ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:11.251984 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a27f5-0df4-4250-b244-e848cc7536ae admin admin] PATH_INFO: `/v3/projects/c96ee337480b4e89b2d64c9cb8ed67fa` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:11.254483 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a27f5-0df4-4250-b244-e848cc7536ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=c96ee337480b4e89b2d64c9cb8ed67fa)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:11.266374 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a27f5-0df4-4250-b244-e848cc7536ae admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:11.468338 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-6f6a27f5-0df4-4250-b244-e848cc7536ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c96ee337480b4e89b2d64c9cb8ed67fa', 'request_id': 'req-6f6a27f5-0df4-4250-b244-e848cc7536ae'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:11.491003 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-6f6a27f5-0df4-4250-b244-e848cc7536ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c96ee337480b4e89b2d64c9cb8ed67fa', 'request_id': 'req-6f6a27f5-0df4-4250-b244-e848cc7536ae'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:11.509335 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-6f6a27f5-0df4-4250-b244-e848cc7536ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c96ee337480b4e89b2d64c9cb8ed67fa', 'request_id': 'req-6f6a27f5-0df4-4250-b244-e848cc7536ae'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:11.526583 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-6f6a27f5-0df4-4250-b244-e848cc7536ae admin admin] The token cache is being invalidate because project c96ee337480b4e89b2d64c9cb8ed67fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:25:11.527100 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-6f6a27f5-0df4-4250-b244-e848cc7536ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:11.528001 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-6f6a27f5-0df4-4250-b244-e848cc7536ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:11.530264 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 740/1500] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:25:11 2022] DELETE /identity/v3/projects/c96ee337480b4e89b2d64c9cb8ed67fa => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:11.538822 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6cf06-cb64-45ec-ad4d-0c3f8cf8c420 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:11.554291 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6cf06-cb64-45ec-ad4d-0c3f8cf8c420 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:11.635134 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:11.691479 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa4413-0042-4d23-a197-f514e066a8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:11.693553 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa4413-0042-4d23-a197-f514e066a8fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:11.694414 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa4413-0042-4d23-a197-f514e066a8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:11.695525 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa4413-0042-4d23-a197-f514e066a8fb admin admin] PATH_INFO: `/v3/users/2f0f2d980fb4424985b19e4ca42ca158` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:11.696970 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa4413-0042-4d23-a197-f514e066a8fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f0f2d980fb4424985b19e4ca42ca158)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:11.699844 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa4413-0042-4d23-a197-f514e066a8fb admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:11.840491 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-46aa4413-0042-4d23-a197-f514e066a8fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f0f2d980fb4424985b19e4ca42ca158'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:11.841416 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-46aa4413-0042-4d23-a197-f514e066a8fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f0f2d980fb4424985b19e4ca42ca158'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:11.880520 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-46aa4413-0042-4d23-a197-f514e066a8fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f0f2d980fb4424985b19e4ca42ca158'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:11.902915 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-46aa4413-0042-4d23-a197-f514e066a8fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f0f2d980fb4424985b19e4ca42ca158'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:11.917365 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-46aa4413-0042-4d23-a197-f514e066a8fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f0f2d980fb4424985b19e4ca42ca158'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:11.939934 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 761/1501] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:25:11 2022] DELETE /identity/v3/users/2f0f2d980fb4424985b19e4ca42ca158 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:25:12.143173 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65821fac-13d0-4ca6-8dbd-c7628c61e543 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:12.143625 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65821fac-13d0-4ca6-8dbd-c7628c61e543 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:12.144091 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65821fac-13d0-4ca6-8dbd-c7628c61e543 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:12.145914 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 741/1502] 10.222.0.25 () {54 vars in 921 bytes} [Tue Oct 25 13:25:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:25:12.160240 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa4413-0042-4d23-a197-f514e066a8fb admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:12.162609 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-46aa4413-0042-4d23-a197-f514e066a8fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:12.187542 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab496a-090d-44b3-b0a3-4021537489ca None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:12.189037 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab496a-090d-44b3-b0a3-4021537489ca None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:12.189328 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab496a-090d-44b3-b0a3-4021537489ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:12.358020 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-16ab496a-090d-44b3-b0a3-4021537489ca None None] MFA Rules not processed for user `63e73c00cadb4deea934db6111ed76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:12.369852 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-16ab496a-090d-44b3-b0a3-4021537489ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:12.627819 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa4413-0042-4d23-a197-f514e066a8fb admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:12.640279 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96d6a9-d123-40f5-aa03-7a9faa4d7f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:12.641229 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96d6a9-d123-40f5-aa03-7a9faa4d7f51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:12.641425 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96d6a9-d123-40f5-aa03-7a9faa4d7f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:12.643941 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96d6a9-d123-40f5-aa03-7a9faa4d7f51 admin admin] PATH_INFO: `/v3/projects/2f8e54cc4f2e483c8d2a9212136cfedf` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:12.646830 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca96d6a9-d123-40f5-aa03-7a9faa4d7f51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f8e54cc4f2e483c8d2a9212136cfedf)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:12.655586 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca96d6a9-d123-40f5-aa03-7a9faa4d7f51 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:12.682055 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 742/1503] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Oct 25 13:25:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 498 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:25:12.685461 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab496a-090d-44b3-b0a3-4021537489ca None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:12.690968 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-16ab496a-090d-44b3-b0a3-4021537489ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:12.724797 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab496a-090d-44b3-b0a3-4021537489ca None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:12.745868 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373524e-2f1c-4194-bf6f-0ff65e17101f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:12.747165 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373524e-2f1c-4194-bf6f-0ff65e17101f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:12.747563 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373524e-2f1c-4194-bf6f-0ff65e17101f admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:12.747966 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373524e-2f1c-4194-bf6f-0ff65e17101f admin admin] PATH_INFO: `/v3/projects/12b191ec07884b2184f82fcb2fff6d80` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:12.749509 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3373524e-2f1c-4194-bf6f-0ff65e17101f admin admin] RBAC: Authorizing `identity:delete_project(project_id=12b191ec07884b2184f82fcb2fff6d80)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:12.752791 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3373524e-2f1c-4194-bf6f-0ff65e17101f admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:12.809179 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ca96d6a9-d123-40f5-aa03-7a9faa4d7f51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f8e54cc4f2e483c8d2a9212136cfedf', 'request_id': 'req-ca96d6a9-d123-40f5-aa03-7a9faa4d7f51'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:12.823207 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ca96d6a9-d123-40f5-aa03-7a9faa4d7f51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f8e54cc4f2e483c8d2a9212136cfedf', 'request_id': 'req-ca96d6a9-d123-40f5-aa03-7a9faa4d7f51'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:12.829288 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:12.835059 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ca96d6a9-d123-40f5-aa03-7a9faa4d7f51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f8e54cc4f2e483c8d2a9212136cfedf', 'request_id': 'req-ca96d6a9-d123-40f5-aa03-7a9faa4d7f51'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:12.866137 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:12.873015 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ca96d6a9-d123-40f5-aa03-7a9faa4d7f51 admin admin] The token cache is being invalidate because project 2f8e54cc4f2e483c8d2a9212136cfedf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:25:12.873605 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ca96d6a9-d123-40f5-aa03-7a9faa4d7f51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:12.874570 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3373524e-2f1c-4194-bf6f-0ff65e17101f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12b191ec07884b2184f82fcb2fff6d80', 'request_id': 'req-3373524e-2f1c-4194-bf6f-0ff65e17101f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:12.875106 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ca96d6a9-d123-40f5-aa03-7a9faa4d7f51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:12.882043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 762/1504] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:25:12 2022] DELETE /identity/v3/projects/2f8e54cc4f2e483c8d2a9212136cfedf => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:12.884040 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c04e5e-72be-440a-ac37-45d742860698 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:12.884652 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c04e5e-72be-440a-ac37-45d742860698 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:12.885375 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c04e5e-72be-440a-ac37-45d742860698 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:12.887007 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 763/1505] 10.222.0.25 () {54 vars in 921 bytes} [Tue Oct 25 13:25:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:25:12.889536 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c04e5e-72be-440a-ac37-45d742860698 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:12.891091 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3373524e-2f1c-4194-bf6f-0ff65e17101f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12b191ec07884b2184f82fcb2fff6d80', 'request_id': 'req-3373524e-2f1c-4194-bf6f-0ff65e17101f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:12.903526 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-63c04e5e-72be-440a-ac37-45d742860698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:12.941281 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3373524e-2f1c-4194-bf6f-0ff65e17101f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12b191ec07884b2184f82fcb2fff6d80', 'request_id': 'req-3373524e-2f1c-4194-bf6f-0ff65e17101f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:12.963280 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3373524e-2f1c-4194-bf6f-0ff65e17101f admin admin] The token cache is being invalidate because project 12b191ec07884b2184f82fcb2fff6d80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:25:12.964231 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3373524e-2f1c-4194-bf6f-0ff65e17101f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:12.966174 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3373524e-2f1c-4194-bf6f-0ff65e17101f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:12.972064 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 743/1506] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:25:12 2022] DELETE /identity/v3/projects/12b191ec07884b2184f82fcb2fff6d80 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:12.974558 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373524e-2f1c-4194-bf6f-0ff65e17101f admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:12.977117 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-3373524e-2f1c-4194-bf6f-0ff65e17101f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:13.039681 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c04e5e-72be-440a-ac37-45d742860698 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:13.066032 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ca3f4-a5db-431d-bb1b-b68582b5f17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:13.066694 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ca3f4-a5db-431d-bb1b-b68582b5f17f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:13.067030 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ca3f4-a5db-431d-bb1b-b68582b5f17f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:13.067310 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ca3f4-a5db-431d-bb1b-b68582b5f17f admin admin] PATH_INFO: `/v3/users/d218bad62c1e48268ea1b231a7e9161b` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:13.074037 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ca3f4-a5db-431d-bb1b-b68582b5f17f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d218bad62c1e48268ea1b231a7e9161b)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:13.077035 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ca3f4-a5db-431d-bb1b-b68582b5f17f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:13.230860 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373524e-2f1c-4194-bf6f-0ff65e17101f admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:13.245000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99888820-f32c-40a9-b5dd-ef5d143ca22e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:13.245959 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99888820-f32c-40a9-b5dd-ef5d143ca22e service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:13.246531 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99888820-f32c-40a9-b5dd-ef5d143ca22e service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:13.246987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99888820-f32c-40a9-b5dd-ef5d143ca22e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:13.251513 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-661ca3f4-a5db-431d-bb1b-b68582b5f17f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd218bad62c1e48268ea1b231a7e9161b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:13.252385 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-661ca3f4-a5db-431d-bb1b-b68582b5f17f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd218bad62c1e48268ea1b231a7e9161b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:13.255483 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-99888820-f32c-40a9-b5dd-ef5d143ca22e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:13.278622 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99888820-f32c-40a9-b5dd-ef5d143ca22e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:13.280589 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99888820-f32c-40a9-b5dd-ef5d143ca22e service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:13.293746 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-661ca3f4-a5db-431d-bb1b-b68582b5f17f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd218bad62c1e48268ea1b231a7e9161b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:13.299945 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 744/1507] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:25:13.301107 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99888820-f32c-40a9-b5dd-ef5d143ca22e service nova] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:13.302702 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-99888820-f32c-40a9-b5dd-ef5d143ca22e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:13.318597 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-661ca3f4-a5db-431d-bb1b-b68582b5f17f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd218bad62c1e48268ea1b231a7e9161b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:13.319997 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99888820-f32c-40a9-b5dd-ef5d143ca22e service nova] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:13.325721 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca265dd-a62d-4900-b071-a34d105fc88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:13.326712 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca265dd-a62d-4900-b071-a34d105fc88f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:13.327229 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca265dd-a62d-4900-b071-a34d105fc88f admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:13.327717 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca265dd-a62d-4900-b071-a34d105fc88f admin admin] PATH_INFO: `/v3/users/c96d04edeeef4abebb3d79fff8b46643` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:13.329899 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca265dd-a62d-4900-b071-a34d105fc88f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c96d04edeeef4abebb3d79fff8b46643)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:13.332458 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca265dd-a62d-4900-b071-a34d105fc88f admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:13.339559 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-661ca3f4-a5db-431d-bb1b-b68582b5f17f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd218bad62c1e48268ea1b231a7e9161b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:13.361139 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 764/1508] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:25:12 2022] DELETE /identity/v3/users/d218bad62c1e48268ea1b231a7e9161b => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:13.373667 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f02e30-da73-4b9b-8f60-410c6c9a1488 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:13.373968 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f02e30-da73-4b9b-8f60-410c6c9a1488 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:13.374249 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f02e30-da73-4b9b-8f60-410c6c9a1488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:13.438794 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-98f02e30-da73-4b9b-8f60-410c6c9a1488 None None] MFA Rules not processed for user `63e73c00cadb4deea934db6111ed76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:13.440112 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-98f02e30-da73-4b9b-8f60-410c6c9a1488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:13.474168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-fca265dd-a62d-4900-b071-a34d105fc88f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c96d04edeeef4abebb3d79fff8b46643'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:13.548640 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-fca265dd-a62d-4900-b071-a34d105fc88f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c96d04edeeef4abebb3d79fff8b46643'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:13.549662 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-fca265dd-a62d-4900-b071-a34d105fc88f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c96d04edeeef4abebb3d79fff8b46643'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:13.574091 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-fca265dd-a62d-4900-b071-a34d105fc88f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c96d04edeeef4abebb3d79fff8b46643'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:13.575335 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-fca265dd-a62d-4900-b071-a34d105fc88f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c96d04edeeef4abebb3d79fff8b46643'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:13.612626 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:13.634519 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 745/1509] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:25:13 2022] DELETE /identity/v3/users/c96d04edeeef4abebb3d79fff8b46643 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:13.638675 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 765/1510] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Oct 25 13:25:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:14.650415 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca265dd-a62d-4900-b071-a34d105fc88f admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:14.651933 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-fca265dd-a62d-4900-b071-a34d105fc88f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:14.731940 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:14.738563 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f02e30-da73-4b9b-8f60-410c6c9a1488 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:14.740066 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-98f02e30-da73-4b9b-8f60-410c6c9a1488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:14.810234 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca265dd-a62d-4900-b071-a34d105fc88f admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:14.820361 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757dfbf2-ab68-426d-9284-3c38e036410b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:14.821039 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757dfbf2-ab68-426d-9284-3c38e036410b service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:14.821907 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757dfbf2-ab68-426d-9284-3c38e036410b service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:14.822284 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757dfbf2-ab68-426d-9284-3c38e036410b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:14.835602 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757dfbf2-ab68-426d-9284-3c38e036410b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:14.837553 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757dfbf2-ab68-426d-9284-3c38e036410b service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:14.840016 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f02e30-da73-4b9b-8f60-410c6c9a1488 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:14.855626 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 746/1511] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:25:14.925240 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56042db-36a9-4b7d-b8c7-7ff3d6e56901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:14.925951 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56042db-36a9-4b7d-b8c7-7ff3d6e56901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:14.926366 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56042db-36a9-4b7d-b8c7-7ff3d6e56901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:14.926836 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56042db-36a9-4b7d-b8c7-7ff3d6e56901 admin admin] PATH_INFO: `/v3/projects/15e9f9ba409b474e9fa79df4c5b7e602` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:14.928144 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56042db-36a9-4b7d-b8c7-7ff3d6e56901 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15e9f9ba409b474e9fa79df4c5b7e602)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:14.930469 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56042db-36a9-4b7d-b8c7-7ff3d6e56901 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:14.951138 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757dfbf2-ab68-426d-9284-3c38e036410b service nova] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:14.952717 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-757dfbf2-ab68-426d-9284-3c38e036410b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:14.986893 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757dfbf2-ab68-426d-9284-3c38e036410b service nova] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:14.997624 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486fe3a-8d95-4646-bfbc-6a504333b3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:14.998416 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486fe3a-8d95-4646-bfbc-6a504333b3b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:14.998726 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486fe3a-8d95-4646-bfbc-6a504333b3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:14.999003 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486fe3a-8d95-4646-bfbc-6a504333b3b2 admin admin] PATH_INFO: `/v3/projects/baa55084b14d4297bba60fc770220424` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:15.000357 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0486fe3a-8d95-4646-bfbc-6a504333b3b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=baa55084b14d4297bba60fc770220424)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:15.002583 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0486fe3a-8d95-4646-bfbc-6a504333b3b2 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:15.031031 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d56042db-36a9-4b7d-b8c7-7ff3d6e56901 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15e9f9ba409b474e9fa79df4c5b7e602', 'request_id': 'req-d56042db-36a9-4b7d-b8c7-7ff3d6e56901'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:15.046376 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d56042db-36a9-4b7d-b8c7-7ff3d6e56901 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15e9f9ba409b474e9fa79df4c5b7e602', 'request_id': 'req-d56042db-36a9-4b7d-b8c7-7ff3d6e56901'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:15.053971 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d56042db-36a9-4b7d-b8c7-7ff3d6e56901 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15e9f9ba409b474e9fa79df4c5b7e602', 'request_id': 'req-d56042db-36a9-4b7d-b8c7-7ff3d6e56901'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:15.068436 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d56042db-36a9-4b7d-b8c7-7ff3d6e56901 admin admin] The token cache is being invalidate because project 15e9f9ba409b474e9fa79df4c5b7e602 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:25:15.068972 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d56042db-36a9-4b7d-b8c7-7ff3d6e56901 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:15.070008 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d56042db-36a9-4b7d-b8c7-7ff3d6e56901 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:15.071887 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 766/1512] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:25:14 2022] DELETE /identity/v3/projects/15e9f9ba409b474e9fa79df4c5b7e602 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:15.076452 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56042db-36a9-4b7d-b8c7-7ff3d6e56901 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:15.079578 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d56042db-36a9-4b7d-b8c7-7ff3d6e56901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:15.080058 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0486fe3a-8d95-4646-bfbc-6a504333b3b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baa55084b14d4297bba60fc770220424', 'request_id': 'req-0486fe3a-8d95-4646-bfbc-6a504333b3b2'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:15.090530 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0486fe3a-8d95-4646-bfbc-6a504333b3b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baa55084b14d4297bba60fc770220424', 'request_id': 'req-0486fe3a-8d95-4646-bfbc-6a504333b3b2'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:15.103718 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0486fe3a-8d95-4646-bfbc-6a504333b3b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baa55084b14d4297bba60fc770220424', 'request_id': 'req-0486fe3a-8d95-4646-bfbc-6a504333b3b2'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:15.119939 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0486fe3a-8d95-4646-bfbc-6a504333b3b2 admin admin] The token cache is being invalidate because project baa55084b14d4297bba60fc770220424 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:25:15.119939 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0486fe3a-8d95-4646-bfbc-6a504333b3b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:15.119939 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0486fe3a-8d95-4646-bfbc-6a504333b3b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:15.120706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 747/1513] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:25:14 2022] DELETE /identity/v3/projects/baa55084b14d4297bba60fc770220424 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:15.121904 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a3e16-b740-424c-8789-9ec7e8ac126a None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:15.122187 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a3e16-b740-424c-8789-9ec7e8ac126a None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:15.122464 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a3e16-b740-424c-8789-9ec7e8ac126a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:15.135502 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:15.143942 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-c43a3e16-b740-424c-8789-9ec7e8ac126a None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:15.145168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c43a3e16-b740-424c-8789-9ec7e8ac126a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:15.162515 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56042db-36a9-4b7d-b8c7-7ff3d6e56901 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:15.214675 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 748/1514] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:15.217203 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa21ea4-a055-41c3-ba72-92eee2fb9fb1 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:15.217490 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa21ea4-a055-41c3-ba72-92eee2fb9fb1 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:15.217768 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa21ea4-a055-41c3-ba72-92eee2fb9fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:15.238349 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5682f-a339-423f-9690-313063d4f9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:15.239096 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5682f-a339-423f-9690-313063d4f9ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:15.239946 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5682f-a339-423f-9690-313063d4f9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:15.239946 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5682f-a339-423f-9690-313063d4f9ce admin admin] PATH_INFO: `/v3/projects/e6b2b9b3da4d44bd8d5242637346501d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:15.241022 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5682f-a339-423f-9690-313063d4f9ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6b2b9b3da4d44bd8d5242637346501d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:15.243083 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5682f-a339-423f-9690-313063d4f9ce admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:15.365498 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-ffa21ea4-a055-41c3-ba72-92eee2fb9fb1 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:15.366659 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ffa21ea4-a055-41c3-ba72-92eee2fb9fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:15.374714 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 749/1515] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:15.376169 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4b57f-e995-4e8b-a7ff-756d665c64a2 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:15.376441 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4b57f-e995-4e8b-a7ff-756d665c64a2 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:15.376714 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4b57f-e995-4e8b-a7ff-756d665c64a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:15.400597 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-eff4b57f-e995-4e8b-a7ff-756d665c64a2 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:15.401945 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-eff4b57f-e995-4e8b-a7ff-756d665c64a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:15.411183 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 750/1516] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:15.412476 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ff6e8-bca5-4b04-9952-ee2086c4e67c None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:15.412758 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ff6e8-bca5-4b04-9952-ee2086c4e67c None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:15.413028 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ff6e8-bca5-4b04-9952-ee2086c4e67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:15.420527 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-aaa5682f-a339-423f-9690-313063d4f9ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6b2b9b3da4d44bd8d5242637346501d', 'request_id': 'req-aaa5682f-a339-423f-9690-313063d4f9ce'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:15.428475 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-aaa5682f-a339-423f-9690-313063d4f9ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6b2b9b3da4d44bd8d5242637346501d', 'request_id': 'req-aaa5682f-a339-423f-9690-313063d4f9ce'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:15.432951 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-806ff6e8-bca5-4b04-9952-ee2086c4e67c None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:15.434139 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-806ff6e8-bca5-4b04-9952-ee2086c4e67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:15.434285 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-aaa5682f-a339-423f-9690-313063d4f9ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6b2b9b3da4d44bd8d5242637346501d', 'request_id': 'req-aaa5682f-a339-423f-9690-313063d4f9ce'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:15.445830 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-aaa5682f-a339-423f-9690-313063d4f9ce admin admin] The token cache is being invalidate because project e6b2b9b3da4d44bd8d5242637346501d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:25:15.446112 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-aaa5682f-a339-423f-9690-313063d4f9ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:15.446800 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-aaa5682f-a339-423f-9690-313063d4f9ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:15.448344 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 767/1517] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:25:15 2022] DELETE /identity/v3/projects/e6b2b9b3da4d44bd8d5242637346501d => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:15.449099 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5682f-a339-423f-9690-313063d4f9ce admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:15.450379 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-aaa5682f-a339-423f-9690-313063d4f9ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:15.454867 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:15.496563 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 751/1518] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:15.497882 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd758a-2953-47dd-97b4-e4a2a5c22466 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:15.498171 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd758a-2953-47dd-97b4-e4a2a5c22466 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:15.498448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd758a-2953-47dd-97b4-e4a2a5c22466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:15.519747 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-dbdd758a-2953-47dd-97b4-e4a2a5c22466 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:15.520141 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5682f-a339-423f-9690-313063d4f9ce admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:15.520980 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-dbdd758a-2953-47dd-97b4-e4a2a5c22466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:15.524910 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13867910-5125-4ff7-a0be-653f93194445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:15.525516 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13867910-5125-4ff7-a0be-653f93194445 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:15.525784 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13867910-5125-4ff7-a0be-653f93194445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:15.526058 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13867910-5125-4ff7-a0be-653f93194445 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:15.526764 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13867910-5125-4ff7-a0be-653f93194445 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:25:15.527071 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13867910-5125-4ff7-a0be-653f93194445 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:15.528696 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13867910-5125-4ff7-a0be-653f93194445 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:15.532711 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 752/1519] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:15.536816 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd758a-2953-47dd-97b4-e4a2a5c22466 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:15.548069 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 768/1520] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:25:15.549524 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50eaa29-ee62-444b-babf-228fecea8a3e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:15.549814 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50eaa29-ee62-444b-babf-228fecea8a3e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:15.550085 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50eaa29-ee62-444b-babf-228fecea8a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:15.554488 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd758a-2953-47dd-97b4-e4a2a5c22466 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:15.559736 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7134236-e793-40ef-b309-c061ee30f9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:15.560365 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7134236-e793-40ef-b309-c061ee30f9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:15.560640 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7134236-e793-40ef-b309-c061ee30f9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:15.560909 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7134236-e793-40ef-b309-c061ee30f9e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:15.561553 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7134236-e793-40ef-b309-c061ee30f9e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:25:15.561855 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7134236-e793-40ef-b309-c061ee30f9e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:15.564636 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7134236-e793-40ef-b309-c061ee30f9e3 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:15.574736 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a50eaa29-ee62-444b-babf-228fecea8a3e None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:15.576461 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a50eaa29-ee62-444b-babf-228fecea8a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:15.582718 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 753/1521] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:25:15.582718 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7134236-e793-40ef-b309-c061ee30f9e3 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:15.585420 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 769/1522] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:15.586050 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50eaa29-ee62-444b-babf-228fecea8a3e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:15.590250 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7134236-e793-40ef-b309-c061ee30f9e3 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:15.591046 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:15.596207 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525a002-7991-4d97-8916-aad6e5980600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:15.596923 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525a002-7991-4d97-8916-aad6e5980600 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:15.597301 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525a002-7991-4d97-8916-aad6e5980600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:15.597690 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525a002-7991-4d97-8916-aad6e5980600 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:15.597933 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50eaa29-ee62-444b-babf-228fecea8a3e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:15.598562 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6525a002-7991-4d97-8916-aad6e5980600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:15.600844 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6525a002-7991-4d97-8916-aad6e5980600 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:15.603595 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5ee11-b5ca-41c0-8db6-266c915b7361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:15.604618 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5ee11-b5ca-41c0-8db6-266c915b7361 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:15.605092 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5ee11-b5ca-41c0-8db6-266c915b7361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:15.605419 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5ee11-b5ca-41c0-8db6-266c915b7361 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:15.606047 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5ee11-b5ca-41c0-8db6-266c915b7361 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:15.607948 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5ee11-b5ca-41c0-8db6-266c915b7361 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:15.630616 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 754/1523] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:25:15 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:25:15.631530 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525a002-7991-4d97-8916-aad6e5980600 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:15.639638 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 770/1524] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:25:15 2022] POST /identity/v3/projects => generated 409 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:25:15.639638 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5ee11-b5ca-41c0-8db6-266c915b7361 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:15.699592 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525a002-7991-4d97-8916-aad6e5980600 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:15.756345 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5ee11-b5ca-41c0-8db6-266c915b7361 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:15.768830 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a2e56-49be-4a7d-8e02-40916e75db19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:15.769834 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a2e56-49be-4a7d-8e02-40916e75db19 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:15.770269 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a2e56-49be-4a7d-8e02-40916e75db19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:15.770541 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a2e56-49be-4a7d-8e02-40916e75db19 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:15.771180 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a2e56-49be-4a7d-8e02-40916e75db19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:15.773207 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a2e56-49be-4a7d-8e02-40916e75db19 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:15.782312 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9194d-f512-4443-9e5b-d10e8866ee53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:15.783310 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9194d-f512-4443-9e5b-d10e8866ee53 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:15.783779 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9194d-f512-4443-9e5b-d10e8866ee53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:15.784218 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9194d-f512-4443-9e5b-d10e8866ee53 admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:15.785243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a9194d-f512-4443-9e5b-d10e8866ee53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:25:15.785913 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a9194d-f512-4443-9e5b-d10e8866ee53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:15.787995 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a9194d-f512-4443-9e5b-d10e8866ee53 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:15.799682 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 771/1525] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:25:15 2022] POST /identity/v3/users => generated 291 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:25:15.801020 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a2e56-49be-4a7d-8e02-40916e75db19 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:15.809077 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 755/1526] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:25:15.809077 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9194d-f512-4443-9e5b-d10e8866ee53 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:15.817838 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a2e56-49be-4a7d-8e02-40916e75db19 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:15.823120 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9194d-f512-4443-9e5b-d10e8866ee53 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:15.824484 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96677d5-ce46-4850-9c70-a1d139ad3b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:15.825265 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96677d5-ce46-4850-9c70-a1d139ad3b97 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:15.825600 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96677d5-ce46-4850-9c70-a1d139ad3b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:15.825973 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96677d5-ce46-4850-9c70-a1d139ad3b97 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:15.826711 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96677d5-ce46-4850-9c70-a1d139ad3b97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:15.829974 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557362e-3cdc-44bf-a303-a4da96237d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:15.830138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96677d5-ce46-4850-9c70-a1d139ad3b97 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:15.830982 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557362e-3cdc-44bf-a303-a4da96237d87 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:15.831214 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557362e-3cdc-44bf-a303-a4da96237d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:15.832395 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557362e-3cdc-44bf-a303-a4da96237d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:15.833237 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557362e-3cdc-44bf-a303-a4da96237d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:15.835486 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557362e-3cdc-44bf-a303-a4da96237d87 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:15.853779 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 756/1527] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:15.854685 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557362e-3cdc-44bf-a303-a4da96237d87 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:15.865564 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 772/1528] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:25:15 2022] POST /identity/v3/users => generated 305 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:25:15.866695 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96677d5-ce46-4850-9c70-a1d139ad3b97 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:15.880146 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96677d5-ce46-4850-9c70-a1d139ad3b97 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:15.881660 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557362e-3cdc-44bf-a303-a4da96237d87 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:15.885616 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40143b3a-8417-4a17-a056-a30048331183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:15.886247 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40143b3a-8417-4a17-a056-a30048331183 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:15.886524 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40143b3a-8417-4a17-a056-a30048331183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:15.886630 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea14468-860d-480b-a490-175d6bde5545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:15.887337 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40143b3a-8417-4a17-a056-a30048331183 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:15.887442 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea14468-860d-480b-a490-175d6bde5545 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:15.887523 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40143b3a-8417-4a17-a056-a30048331183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:15.887738 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea14468-860d-480b-a490-175d6bde5545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:15.888113 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea14468-860d-480b-a490-175d6bde5545 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:15.888936 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea14468-860d-480b-a490-175d6bde5545 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:15.889031 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40143b3a-8417-4a17-a056-a30048331183 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:15.892101 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea14468-860d-480b-a490-175d6bde5545 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:15.901566 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 773/1529] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:15.903078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40143b3a-8417-4a17-a056-a30048331183 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:15.903859 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:15.933820 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40143b3a-8417-4a17-a056-a30048331183 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:15.933964 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 757/1530] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:25:15 2022] POST /identity/v3/projects => generated 387 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:25:15.934569 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea14468-860d-480b-a490-175d6bde5545 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:15.936886 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f221d213-d895-405e-ae02-84977ea815af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:15.936886 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221d213-d895-405e-ae02-84977ea815af admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:15.936886 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221d213-d895-405e-ae02-84977ea815af admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:15.936886 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221d213-d895-405e-ae02-84977ea815af admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:15.937374 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f221d213-d895-405e-ae02-84977ea815af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:15.943265 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f221d213-d895-405e-ae02-84977ea815af admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:15.956010 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 774/1531] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:15.956762 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f221d213-d895-405e-ae02-84977ea815af admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:15.966531 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f221d213-d895-405e-ae02-84977ea815af admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:16.030310 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea14468-860d-480b-a490-175d6bde5545 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:16.035620 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b712c6-5051-4a11-ac89-feec5da14a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:16.036354 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b712c6-5051-4a11-ac89-feec5da14a7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:16.036779 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b712c6-5051-4a11-ac89-feec5da14a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:16.037068 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b712c6-5051-4a11-ac89-feec5da14a7d admin admin] PATH_INFO: `/v3/projects/0d4529d6794c45b19aab2d9f09a2d256/users/80143b618984400ba4f372e1682097ba/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:16.043795 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5149b2-54df-4376-94a1-46288b9acc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:16.044838 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5149b2-54df-4376-94a1-46288b9acc52 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:16.045260 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5149b2-54df-4376-94a1-46288b9acc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:16.045684 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5149b2-54df-4376-94a1-46288b9acc52 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:16.046600 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5149b2-54df-4376-94a1-46288b9acc52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:16.049085 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5149b2-54df-4376-94a1-46288b9acc52 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:16.053225 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b712c6-5051-4a11-ac89-feec5da14a7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d4529d6794c45b19aab2d9f09a2d256, user_id=80143b618984400ba4f372e1682097ba, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:16.056694 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b712c6-5051-4a11-ac89-feec5da14a7d admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:16.075632 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 758/1532] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:25:15 2022] PUT /identity/v3/projects/0d4529d6794c45b19aab2d9f09a2d256/users/80143b618984400ba4f372e1682097ba/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:16.076358 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b712c6-5051-4a11-ac89-feec5da14a7d admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:16.078933 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 775/1533] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:25:15 2022] POST /identity/v3/users => generated 294 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:25:16.086371 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5149b2-54df-4376-94a1-46288b9acc52 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:16.119722 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5149b2-54df-4376-94a1-46288b9acc52 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:16.157968 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:16.199758 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b712c6-5051-4a11-ac89-feec5da14a7d admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:16.206191 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea13852-0f89-4700-9c67-3015c28d70ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:16.206816 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea13852-0f89-4700-9c67-3015c28d70ab admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:16.207100 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea13852-0f89-4700-9c67-3015c28d70ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:16.207375 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea13852-0f89-4700-9c67-3015c28d70ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:16.208080 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea13852-0f89-4700-9c67-3015c28d70ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:16.209794 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea13852-0f89-4700-9c67-3015c28d70ab admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:16.224064 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 759/1534] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:16.225011 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104f875-6723-463b-a9c5-55a010f734f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:16.225863 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104f875-6723-463b-a9c5-55a010f734f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:16.225991 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff886d2-5279-4465-975d-ecb04fa34ffa None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:16.226145 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104f875-6723-463b-a9c5-55a010f734f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:16.226551 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104f875-6723-463b-a9c5-55a010f734f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:16.227018 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff886d2-5279-4465-975d-ecb04fa34ffa None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:16.229701 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104f875-6723-463b-a9c5-55a010f734f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:16.229832 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff886d2-5279-4465-975d-ecb04fa34ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:16.229914 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104f875-6723-463b-a9c5-55a010f734f7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:16.242679 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 776/1535] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:16.242679 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104f875-6723-463b-a9c5-55a010f734f7 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:16.255265 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104f875-6723-463b-a9c5-55a010f734f7 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:16.260257 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-dff886d2-5279-4465-975d-ecb04fa34ffa None None] MFA Rules not processed for user `80143b618984400ba4f372e1682097ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:16.260675 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b21733-d425-4b51-8c43-0d659d5033b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:16.261393 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-dff886d2-5279-4465-975d-ecb04fa34ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:16.261498 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b21733-d425-4b51-8c43-0d659d5033b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:16.261760 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b21733-d425-4b51-8c43-0d659d5033b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:16.262103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b21733-d425-4b51-8c43-0d659d5033b7 admin admin] PATH_INFO: `/v3/projects/f3d475a1e2c04c92b2b62aad9aa6930f/users/9b5a51a651ac41768e266fbda1f53963/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:16.280553 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b21733-d425-4b51-8c43-0d659d5033b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3d475a1e2c04c92b2b62aad9aa6930f, user_id=9b5a51a651ac41768e266fbda1f53963, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:16.284523 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b21733-d425-4b51-8c43-0d659d5033b7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:16.302217 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 777/1536] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:25:16 2022] PUT /identity/v3/projects/f3d475a1e2c04c92b2b62aad9aa6930f/users/9b5a51a651ac41768e266fbda1f53963/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:16.303109 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b21733-d425-4b51-8c43-0d659d5033b7 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:16.359271 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:16.367562 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 760/1537] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:16.372839 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f830c0-747f-4c78-9774-7d8bb72b0d6b None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:16.373416 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f830c0-747f-4c78-9774-7d8bb72b0d6b None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:16.373732 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f830c0-747f-4c78-9774-7d8bb72b0d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:16.418171 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b21733-d425-4b51-8c43-0d659d5033b7 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:16.426804 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494421ce-13eb-4fc2-9930-3bb9d9bef4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:16.428009 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494421ce-13eb-4fc2-9930-3bb9d9bef4ec admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:16.428437 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494421ce-13eb-4fc2-9930-3bb9d9bef4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:16.428935 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494421ce-13eb-4fc2-9930-3bb9d9bef4ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:16.429726 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494421ce-13eb-4fc2-9930-3bb9d9bef4ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:16.432066 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494421ce-13eb-4fc2-9930-3bb9d9bef4ec admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:16.448406 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-91f830c0-747f-4c78-9774-7d8bb72b0d6b None None] MFA Rules not processed for user `9b5a51a651ac41768e266fbda1f53963`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:16.450043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 778/1538] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:16.451083 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494421ce-13eb-4fc2-9930-3bb9d9bef4ec admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:16.457305 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-91f830c0-747f-4c78-9774-7d8bb72b0d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:16.468223 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494421ce-13eb-4fc2-9930-3bb9d9bef4ec admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:16.474033 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6781e41-a4be-4e42-bc74-9701c6091a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:16.474820 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6781e41-a4be-4e42-bc74-9701c6091a75 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:16.475243 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6781e41-a4be-4e42-bc74-9701c6091a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:16.475773 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6781e41-a4be-4e42-bc74-9701c6091a75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:16.476652 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6781e41-a4be-4e42-bc74-9701c6091a75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:16.479882 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6781e41-a4be-4e42-bc74-9701c6091a75 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:16.524184 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 779/1539] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:25:16 2022] POST /identity/v3/projects => generated 381 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:25:16.525453 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6781e41-a4be-4e42-bc74-9701c6091a75 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:16.601773 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 761/1540] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:16 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:16.601773 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f830c0-747f-4c78-9774-7d8bb72b0d6b None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:16.615434 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6781e41-a4be-4e42-bc74-9701c6091a75 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:16.639045 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2376aa8-a137-43f6-9c93-700e6324df51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:16.639255 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f830c0-747f-4c78-9774-7d8bb72b0d6b None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:16.641486 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2376aa8-a137-43f6-9c93-700e6324df51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:16.642078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2376aa8-a137-43f6-9c93-700e6324df51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:16.642504 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2376aa8-a137-43f6-9c93-700e6324df51 admin admin] PATH_INFO: `/v3/projects/d5aed05b657a40cb9fb149614addb1da/users/46416ec10bca4559bb948784ea4044ce/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:16.655390 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071bcbfc-393c-4b01-b849-1b8ec25d2014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:16.656696 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071bcbfc-393c-4b01-b849-1b8ec25d2014 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:16.656984 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071bcbfc-393c-4b01-b849-1b8ec25d2014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:16.657381 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071bcbfc-393c-4b01-b849-1b8ec25d2014 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:16.658583 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071bcbfc-393c-4b01-b849-1b8ec25d2014 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:16.660372 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071bcbfc-393c-4b01-b849-1b8ec25d2014 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:16.666594 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:16.673908 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2376aa8-a137-43f6-9c93-700e6324df51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5aed05b657a40cb9fb149614addb1da, user_id=46416ec10bca4559bb948784ea4044ce, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:16.678629 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2376aa8-a137-43f6-9c93-700e6324df51 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:16.708004 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 762/1542] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:25:16 2022] POST /identity/v3/users => generated 297 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:25:16.708004 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071bcbfc-393c-4b01-b849-1b8ec25d2014 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:16.711574 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 780/1542] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:25:16 2022] PUT /identity/v3/projects/d5aed05b657a40cb9fb149614addb1da/users/46416ec10bca4559bb948784ea4044ce/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:16.712635 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2376aa8-a137-43f6-9c93-700e6324df51 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:16.736347 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071bcbfc-393c-4b01-b849-1b8ec25d2014 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:16.825435 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2376aa8-a137-43f6-9c93-700e6324df51 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:16.835043 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860b8ef-1428-4f6c-a3fe-d0f3ffe74eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:16.835663 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860b8ef-1428-4f6c-a3fe-d0f3ffe74eb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:16.835980 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860b8ef-1428-4f6c-a3fe-d0f3ffe74eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:16.836256 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860b8ef-1428-4f6c-a3fe-d0f3ffe74eb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:16.836385 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c91716-1e15-459e-9b3c-fcaa85ae6501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:16.836893 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860b8ef-1428-4f6c-a3fe-d0f3ffe74eb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:16.837238 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c91716-1e15-459e-9b3c-fcaa85ae6501 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:16.837588 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c91716-1e15-459e-9b3c-fcaa85ae6501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:16.837925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c91716-1e15-459e-9b3c-fcaa85ae6501 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:16.838871 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860b8ef-1428-4f6c-a3fe-d0f3ffe74eb0 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:16.839687 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c91716-1e15-459e-9b3c-fcaa85ae6501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:16.842607 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c91716-1e15-459e-9b3c-fcaa85ae6501 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:16.857551 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 781/1543] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:16.859048 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7263ce-23f3-40fd-ba3e-8d8a85d18975 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:16.860238 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7263ce-23f3-40fd-ba3e-8d8a85d18975 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:16.860644 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7263ce-23f3-40fd-ba3e-8d8a85d18975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:16.876195 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 763/1544] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:25:16 2022] POST /identity/v3/projects => generated 409 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:25:16.877871 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860b8ef-1428-4f6c-a3fe-d0f3ffe74eb0 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:16.893400 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-df7263ce-23f3-40fd-ba3e-8d8a85d18975 None None] MFA Rules not processed for user `46416ec10bca4559bb948784ea4044ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:16.894730 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-df7263ce-23f3-40fd-ba3e-8d8a85d18975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:16.969746 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:16.976148 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860b8ef-1428-4f6c-a3fe-d0f3ffe74eb0 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:16.986065 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e5f23-0d9c-4799-8db7-b02e286d0078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:16.986748 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e5f23-0d9c-4799-8db7-b02e286d0078 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:16.987317 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e5f23-0d9c-4799-8db7-b02e286d0078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:16.987603 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e5f23-0d9c-4799-8db7-b02e286d0078 admin admin] PATH_INFO: `/v3/projects/f404a723da184b78a3053c1539bbf51a/users/1a1557e3fe4440aaa57e9e38f02ef355/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:16.991937 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 782/1545] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:16.993026 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7263ce-23f3-40fd-ba3e-8d8a85d18975 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:17.007585 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367e5f23-0d9c-4799-8db7-b02e286d0078 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f404a723da184b78a3053c1539bbf51a, user_id=1a1557e3fe4440aaa57e9e38f02ef355, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:17.009680 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7263ce-23f3-40fd-ba3e-8d8a85d18975 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:17.010863 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367e5f23-0d9c-4799-8db7-b02e286d0078 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:17.015791 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ee57f-782a-48f7-b457-89db46670649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:17.016708 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ee57f-782a-48f7-b457-89db46670649 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:17.017017 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ee57f-782a-48f7-b457-89db46670649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:17.017365 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ee57f-782a-48f7-b457-89db46670649 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:17.018267 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ee57f-782a-48f7-b457-89db46670649 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:17.020711 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ee57f-782a-48f7-b457-89db46670649 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:17.029795 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 764/1546] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:25:16 2022] PUT /identity/v3/projects/f404a723da184b78a3053c1539bbf51a/users/1a1557e3fe4440aaa57e9e38f02ef355/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:17.032058 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e5f23-0d9c-4799-8db7-b02e286d0078 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:17.076693 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 783/1547] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:25:16 2022] POST /identity/v3/users => generated 311 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:25:17.077756 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ee57f-782a-48f7-b457-89db46670649 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:17.098339 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ee57f-782a-48f7-b457-89db46670649 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:17.110347 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33dcc5-fa89-4604-8cc4-1b9792d9580d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:17.110570 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e5f23-0d9c-4799-8db7-b02e286d0078 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:17.111092 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33dcc5-fa89-4604-8cc4-1b9792d9580d admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:17.111446 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33dcc5-fa89-4604-8cc4-1b9792d9580d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:17.111785 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33dcc5-fa89-4604-8cc4-1b9792d9580d admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:17.112469 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc33dcc5-fa89-4604-8cc4-1b9792d9580d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:17.114070 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc33dcc5-fa89-4604-8cc4-1b9792d9580d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:17.115951 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb0761-8a6a-4853-85dc-28e8149a5305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:17.116638 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb0761-8a6a-4853-85dc-28e8149a5305 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:17.116987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb0761-8a6a-4853-85dc-28e8149a5305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:17.117348 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb0761-8a6a-4853-85dc-28e8149a5305 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:17.118434 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb0761-8a6a-4853-85dc-28e8149a5305 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:17.120558 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb0761-8a6a-4853-85dc-28e8149a5305 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:17.130349 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 784/1548] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:17.131635 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33dcc5-fa89-4604-8cc4-1b9792d9580d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:17.151889 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33dcc5-fa89-4604-8cc4-1b9792d9580d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:17.160067 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67097b0-ce53-4c1e-87ce-235542999290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:17.161106 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67097b0-ce53-4c1e-87ce-235542999290 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:17.161464 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 765/1549] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:25:17 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:25:17.161851 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67097b0-ce53-4c1e-87ce-235542999290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:17.162293 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67097b0-ce53-4c1e-87ce-235542999290 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:17.162437 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb0761-8a6a-4853-85dc-28e8149a5305 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:17.163726 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67097b0-ce53-4c1e-87ce-235542999290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:17.165614 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67097b0-ce53-4c1e-87ce-235542999290 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:17.182968 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 785/1550] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:17.184406 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67097b0-ce53-4c1e-87ce-235542999290 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:17.198897 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67097b0-ce53-4c1e-87ce-235542999290 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:17.262502 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:17.284408 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb0761-8a6a-4853-85dc-28e8149a5305 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:17.292893 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3aa22-28b2-478e-a7de-5ff87fcb6c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:17.293857 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3aa22-28b2-478e-a7de-5ff87fcb6c5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:17.294143 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3aa22-28b2-478e-a7de-5ff87fcb6c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:17.294426 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3aa22-28b2-478e-a7de-5ff87fcb6c5e admin admin] PATH_INFO: `/v3/projects/f404a723da184b78a3053c1539bbf51a/users/1a1557e3fe4440aaa57e9e38f02ef355/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:17.297408 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae3aa22-28b2-478e-a7de-5ff87fcb6c5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f404a723da184b78a3053c1539bbf51a, user_id=1a1557e3fe4440aaa57e9e38f02ef355, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:17.299932 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d9328-2e94-427c-b535-b7d12380b592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:17.300155 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae3aa22-28b2-478e-a7de-5ff87fcb6c5e admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:17.301655 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d9328-2e94-427c-b535-b7d12380b592 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:17.301655 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d9328-2e94-427c-b535-b7d12380b592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:17.301655 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d9328-2e94-427c-b535-b7d12380b592 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:17.301910 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4d9328-2e94-427c-b535-b7d12380b592 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:17.303851 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4d9328-2e94-427c-b535-b7d12380b592 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:17.313484 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 766/1551] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:25:17 2022] PUT /identity/v3/projects/f404a723da184b78a3053c1539bbf51a/users/1a1557e3fe4440aaa57e9e38f02ef355/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:17.314571 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3aa22-28b2-478e-a7de-5ff87fcb6c5e admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:17.341689 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 786/1552] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:25:17 2022] POST /identity/v3/users => generated 299 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:25:17.343980 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4be166-0e8a-4611-a3ae-16be6a83963c None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:17.344257 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4be166-0e8a-4611-a3ae-16be6a83963c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:17.344736 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4be166-0e8a-4611-a3ae-16be6a83963c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:17.396957 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-ce4be166-0e8a-4611-a3ae-16be6a83963c None None] MFA Rules not processed for user `1a1557e3fe4440aaa57e9e38f02ef355`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:17.398200 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ce4be166-0e8a-4611-a3ae-16be6a83963c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:17.418881 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3aa22-28b2-478e-a7de-5ff87fcb6c5e admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:17.434391 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93bc68-0a69-4c40-8456-2c02ab542738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:17.435646 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93bc68-0a69-4c40-8456-2c02ab542738 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:17.436320 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93bc68-0a69-4c40-8456-2c02ab542738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:17.436797 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93bc68-0a69-4c40-8456-2c02ab542738 admin admin] PATH_INFO: `/v3/projects/d750fe86fbfd4958a047ba0e3a23b4c0/users/7f4ef1bc182049b8920c4c559a3324ef/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:17.440421 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:17.472632 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93bc68-0a69-4c40-8456-2c02ab542738 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d750fe86fbfd4958a047ba0e3a23b4c0, user_id=7f4ef1bc182049b8920c4c559a3324ef, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:17.478048 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93bc68-0a69-4c40-8456-2c02ab542738 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:17.496468 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 787/1553] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:17 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:17.497586 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4be166-0e8a-4611-a3ae-16be6a83963c None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:17.509010 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4be166-0e8a-4611-a3ae-16be6a83963c None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:17.514004 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d43d9-bd2b-427d-98ef-f59f62f6a695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:17.514669 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d43d9-bd2b-427d-98ef-f59f62f6a695 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:17.514900 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d43d9-bd2b-427d-98ef-f59f62f6a695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:17.515178 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d43d9-bd2b-427d-98ef-f59f62f6a695 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:17.516557 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d43d9-bd2b-427d-98ef-f59f62f6a695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:17.518257 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d43d9-bd2b-427d-98ef-f59f62f6a695 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:17.525895 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 767/1554] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:25:17 2022] PUT /identity/v3/projects/d750fe86fbfd4958a047ba0e3a23b4c0/users/7f4ef1bc182049b8920c4c559a3324ef/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:17.527000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93bc68-0a69-4c40-8456-2c02ab542738 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:17.528752 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ce93bc68-0a69-4c40-8456-2c02ab542738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:17.532945 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 788/1555] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:17.534025 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d43d9-bd2b-427d-98ef-f59f62f6a695 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:17.548213 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d43d9-bd2b-427d-98ef-f59f62f6a695 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:17.594822 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93bc68-0a69-4c40-8456-2c02ab542738 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:17.600967 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7d466-2da6-4dcf-add0-81dfbc43f544 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:17.601812 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7d466-2da6-4dcf-add0-81dfbc43f544 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:17.602095 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7d466-2da6-4dcf-add0-81dfbc43f544 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:17.602370 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7d466-2da6-4dcf-add0-81dfbc43f544 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:17.613322 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25269a1-d35e-41b1-aa3d-7390ee72c105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:17.614542 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25269a1-d35e-41b1-aa3d-7390ee72c105 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:17.614813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25269a1-d35e-41b1-aa3d-7390ee72c105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:17.615242 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25269a1-d35e-41b1-aa3d-7390ee72c105 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:17.615887 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25269a1-d35e-41b1-aa3d-7390ee72c105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:17.618167 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25269a1-d35e-41b1-aa3d-7390ee72c105 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:17.628554 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 789/1556] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:17.629464 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25269a1-d35e-41b1-aa3d-7390ee72c105 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:17.639430 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25269a1-d35e-41b1-aa3d-7390ee72c105 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:17.646886 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae4974-3a29-44bb-9819-4378eb62ef39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:17.647242 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae4974-3a29-44bb-9819-4378eb62ef39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:17.647598 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae4974-3a29-44bb-9819-4378eb62ef39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:17.647999 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae4974-3a29-44bb-9819-4378eb62ef39 admin admin] PATH_INFO: `/v3/projects/8c2fff38f0d240b98512aa6829da1fd9/users/2bb95fb85309494b9abae6d6b4d7a11e/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:17.673743 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae4974-3a29-44bb-9819-4378eb62ef39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c2fff38f0d240b98512aa6829da1fd9, user_id=2bb95fb85309494b9abae6d6b4d7a11e, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:17.678699 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae4974-3a29-44bb-9819-4378eb62ef39 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:17.683508 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7d466-2da6-4dcf-add0-81dfbc43f544 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:17.685867 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7d466-2da6-4dcf-add0-81dfbc43f544 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:17.698410 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 768/1557] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:17 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:25:17.699441 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7d466-2da6-4dcf-add0-81dfbc43f544 service cinder] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:17.699777 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 790/1558] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:25:17 2022] PUT /identity/v3/projects/8c2fff38f0d240b98512aa6829da1fd9/users/2bb95fb85309494b9abae6d6b4d7a11e/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:17.704152 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae4974-3a29-44bb-9819-4378eb62ef39 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:17.718593 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7d466-2da6-4dcf-add0-81dfbc43f544 service cinder] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:17.733339 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:17.832162 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae4974-3a29-44bb-9819-4378eb62ef39 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:17.838468 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d137481-c75f-4059-8e62-47c25649c39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:17.839179 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d137481-c75f-4059-8e62-47c25649c39f admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:17.839465 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d137481-c75f-4059-8e62-47c25649c39f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:17.839776 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d137481-c75f-4059-8e62-47c25649c39f admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:17.840734 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d137481-c75f-4059-8e62-47c25649c39f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:17.843347 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d137481-c75f-4059-8e62-47c25649c39f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:17.860218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 791/1559] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:17.864198 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d137481-c75f-4059-8e62-47c25649c39f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:17.866253 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a64f4e-445f-4060-8bc0-f966e401c41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:17.867086 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a64f4e-445f-4060-8bc0-f966e401c41c admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:17.867467 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a64f4e-445f-4060-8bc0-f966e401c41c admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:17.867841 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a64f4e-445f-4060-8bc0-f966e401c41c admin admin] PATH_INFO: `/v3/projects/d750fe86fbfd4958a047ba0e3a23b4c0/users/7f4ef1bc182049b8920c4c559a3324ef/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:17.870174 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a64f4e-445f-4060-8bc0-f966e401c41c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d750fe86fbfd4958a047ba0e3a23b4c0, user_id=7f4ef1bc182049b8920c4c559a3324ef, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:17.874060 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a64f4e-445f-4060-8bc0-f966e401c41c admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:17.876334 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d137481-c75f-4059-8e62-47c25649c39f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:17.881410 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b134980-5563-4373-be3b-8180fc5f68a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:17.882440 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b134980-5563-4373-be3b-8180fc5f68a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:17.882720 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b134980-5563-4373-be3b-8180fc5f68a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:17.882995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b134980-5563-4373-be3b-8180fc5f68a1 admin admin] PATH_INFO: `/v3/projects/8c2fff38f0d240b98512aa6829da1fd9/users/2bb95fb85309494b9abae6d6b4d7a11e/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:17.886259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b134980-5563-4373-be3b-8180fc5f68a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c2fff38f0d240b98512aa6829da1fd9, user_id=2bb95fb85309494b9abae6d6b4d7a11e, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:17.889084 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b134980-5563-4373-be3b-8180fc5f68a1 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:17.899722 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 769/1560] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:25:17 2022] PUT /identity/v3/projects/d750fe86fbfd4958a047ba0e3a23b4c0/users/7f4ef1bc182049b8920c4c559a3324ef/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:17.901283 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58666e-f024-479b-9922-be0758dfd4bc None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:17.901570 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58666e-f024-479b-9922-be0758dfd4bc None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:17.901867 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58666e-f024-479b-9922-be0758dfd4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:17.927790 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 792/1561] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:25:17 2022] PUT /identity/v3/projects/8c2fff38f0d240b98512aa6829da1fd9/users/2bb95fb85309494b9abae6d6b4d7a11e/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:25:17.930394 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff79cc-9085-4af5-a288-38034866d386 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:17.930394 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff79cc-9085-4af5-a288-38034866d386 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:17.930601 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff79cc-9085-4af5-a288-38034866d386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:17.941424 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-3d58666e-f024-479b-9922-be0758dfd4bc None None] MFA Rules not processed for user `7f4ef1bc182049b8920c4c559a3324ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:17.943154 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-3d58666e-f024-479b-9922-be0758dfd4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:17.964398 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-77ff79cc-9085-4af5-a288-38034866d386 None None] MFA Rules not processed for user `2bb95fb85309494b9abae6d6b4d7a11e`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:17.965637 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-77ff79cc-9085-4af5-a288-38034866d386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:17.971041 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:18.076971 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 770/1562] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:17 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:18.093977 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58666e-f024-479b-9922-be0758dfd4bc None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:18.102620 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 793/1563] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:17 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:25:18.135104 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff79cc-9085-4af5-a288-38034866d386 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:18.136723 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-77ff79cc-9085-4af5-a288-38034866d386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:18.151181 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58666e-f024-479b-9922-be0758dfd4bc None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:18.154692 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf92e9-6aae-4d96-abb4-40704ec94f27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:18.155292 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf92e9-6aae-4d96-abb4-40704ec94f27 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:18.155565 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf92e9-6aae-4d96-abb4-40704ec94f27 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:18.155833 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf92e9-6aae-4d96-abb4-40704ec94f27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:18.165037 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf92e9-6aae-4d96-abb4-40704ec94f27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:18.166448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf92e9-6aae-4d96-abb4-40704ec94f27 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:18.177285 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 771/1564] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:18 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:25:18.194922 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff79cc-9085-4af5-a288-38034866d386 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:18.198578 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63494272-ff19-4b1d-85f5-3fc24e25a87d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:18.199189 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63494272-ff19-4b1d-85f5-3fc24e25a87d service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:18.199470 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63494272-ff19-4b1d-85f5-3fc24e25a87d service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:18.199745 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63494272-ff19-4b1d-85f5-3fc24e25a87d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:18.209463 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63494272-ff19-4b1d-85f5-3fc24e25a87d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:18.210878 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63494272-ff19-4b1d-85f5-3fc24e25a87d service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:18.220865 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 794/1565] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:18 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 13:25:18.336483 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf92e9-6aae-4d96-abb4-40704ec94f27 service cinder] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:18.387428 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63494272-ff19-4b1d-85f5-3fc24e25a87d service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:18.401726 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63494272-ff19-4b1d-85f5-3fc24e25a87d service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:18.406092 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570cfa4-6173-4898-8530-f5b760c224ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:18.406743 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570cfa4-6173-4898-8530-f5b760c224ac service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:18.407034 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570cfa4-6173-4898-8530-f5b760c224ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:18.407408 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570cfa4-6173-4898-8530-f5b760c224ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:18.433250 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:18.438347 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf92e9-6aae-4d96-abb4-40704ec94f27 service cinder] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:18.443694 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb01fb-04a3-4e92-bd75-99c5e6ea8bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:18.444470 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb01fb-04a3-4e92-bd75-99c5e6ea8bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:18.444748 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb01fb-04a3-4e92-bd75-99c5e6ea8bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:18.445068 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb01fb-04a3-4e92-bd75-99c5e6ea8bb4 admin admin] PATH_INFO: `/v3/users/46416ec10bca4559bb948784ea4044ce` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:18.446225 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb01fb-04a3-4e92-bd75-99c5e6ea8bb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46416ec10bca4559bb948784ea4044ce)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:18.448155 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb01fb-04a3-4e92-bd75-99c5e6ea8bb4 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:18.482376 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570cfa4-6173-4898-8530-f5b760c224ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:18.483807 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570cfa4-6173-4898-8530-f5b760c224ac service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:18.493487 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 795/1566] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:18 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:25:18.494305 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570cfa4-6173-4898-8530-f5b760c224ac service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:18.505359 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570cfa4-6173-4898-8530-f5b760c224ac service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:18.511020 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33889c0d-b98d-44ec-81fb-ecc26a5ca546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:18.512686 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33889c0d-b98d-44ec-81fb-ecc26a5ca546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:18.512935 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-4ffb01fb-04a3-4e92-bd75-99c5e6ea8bb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46416ec10bca4559bb948784ea4044ce'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:18.513406 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33889c0d-b98d-44ec-81fb-ecc26a5ca546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:18.514026 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33889c0d-b98d-44ec-81fb-ecc26a5ca546 admin admin] PATH_INFO: `/v3/users/80143b618984400ba4f372e1682097ba` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:18.515656 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33889c0d-b98d-44ec-81fb-ecc26a5ca546 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80143b618984400ba4f372e1682097ba)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:18.517904 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33889c0d-b98d-44ec-81fb-ecc26a5ca546 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:18.537253 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:18.550568 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-4ffb01fb-04a3-4e92-bd75-99c5e6ea8bb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46416ec10bca4559bb948784ea4044ce'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:18.551548 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-4ffb01fb-04a3-4e92-bd75-99c5e6ea8bb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46416ec10bca4559bb948784ea4044ce'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:18.564616 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-4ffb01fb-04a3-4e92-bd75-99c5e6ea8bb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46416ec10bca4559bb948784ea4044ce'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:18.565590 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-4ffb01fb-04a3-4e92-bd75-99c5e6ea8bb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46416ec10bca4559bb948784ea4044ce'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:18.578299 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-33889c0d-b98d-44ec-81fb-ecc26a5ca546 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80143b618984400ba4f372e1682097ba'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:18.579052 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-33889c0d-b98d-44ec-81fb-ecc26a5ca546 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80143b618984400ba4f372e1682097ba'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:18.586316 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 772/1567] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:25:18 2022] DELETE /identity/v3/users/46416ec10bca4559bb948784ea4044ce => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:18.587703 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7d744-15a7-4289-8b00-fb58301e636f None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:18.588021 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7d744-15a7-4289-8b00-fb58301e636f None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:18.588327 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7d744-15a7-4289-8b00-fb58301e636f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:18.596907 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-33889c0d-b98d-44ec-81fb-ecc26a5ca546 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80143b618984400ba4f372e1682097ba'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:18.611400 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-33889c0d-b98d-44ec-81fb-ecc26a5ca546 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80143b618984400ba4f372e1682097ba'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:18.613092 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-7eb7d744-15a7-4289-8b00-fb58301e636f None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:18.616268 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-7eb7d744-15a7-4289-8b00-fb58301e636f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:18.620152 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-33889c0d-b98d-44ec-81fb-ecc26a5ca546 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80143b618984400ba4f372e1682097ba'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:18.627643 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 796/1568] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:25:18 2022] DELETE /identity/v3/users/80143b618984400ba4f372e1682097ba => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:18.636190 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98d4ba-eef0-4d09-89bd-9e07f9d6c4b9 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:18.636509 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98d4ba-eef0-4d09-89bd-9e07f9d6c4b9 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:18.636794 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98d4ba-eef0-4d09-89bd-9e07f9d6c4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:18.664376 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-fe98d4ba-eef0-4d09-89bd-9e07f9d6c4b9 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:18.665803 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fe98d4ba-eef0-4d09-89bd-9e07f9d6c4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:18.745754 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 773/1569] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:18.757288 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7d744-15a7-4289-8b00-fb58301e636f None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:18.758988 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-7eb7d744-15a7-4289-8b00-fb58301e636f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:18.766111 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 797/1570] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:18.778972 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98d4ba-eef0-4d09-89bd-9e07f9d6c4b9 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:18.782843 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fe98d4ba-eef0-4d09-89bd-9e07f9d6c4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:18.832423 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:18.870779 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7d744-15a7-4289-8b00-fb58301e636f None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:18.881964 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d24e0-439d-4829-9239-8b2be804c1d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:18.884075 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98d4ba-eef0-4d09-89bd-9e07f9d6c4b9 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:18.884478 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d24e0-439d-4829-9239-8b2be804c1d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:18.884763 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d24e0-439d-4829-9239-8b2be804c1d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:18.885337 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d24e0-439d-4829-9239-8b2be804c1d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:18.889502 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec3864-b040-4c20-ad3a-4517eb5aaf32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:18.890215 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec3864-b040-4c20-ad3a-4517eb5aaf32 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:18.891294 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec3864-b040-4c20-ad3a-4517eb5aaf32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:18.892336 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec3864-b040-4c20-ad3a-4517eb5aaf32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:18.911623 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d24e0-439d-4829-9239-8b2be804c1d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:18.913421 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d24e0-439d-4829-9239-8b2be804c1d8 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:18.914392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec3864-b040-4c20-ad3a-4517eb5aaf32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:18.915943 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec3864-b040-4c20-ad3a-4517eb5aaf32 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:18.929557 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 774/1571] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 13:25:18.936001 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 798/1572] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 13:25:19.429956 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d24e0-439d-4829-9239-8b2be804c1d8 service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:19.431482 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-749d24e0-439d-4829-9239-8b2be804c1d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:19.448470 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d24e0-439d-4829-9239-8b2be804c1d8 service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:19.454024 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448fd773-0b4c-4ddb-bd67-7436b76c6519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:19.454665 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fd773-0b4c-4ddb-bd67-7436b76c6519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:19.454927 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fd773-0b4c-4ddb-bd67-7436b76c6519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:19.455197 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fd773-0b4c-4ddb-bd67-7436b76c6519 admin admin] PATH_INFO: `/v3/projects/0d4529d6794c45b19aab2d9f09a2d256` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:19.456368 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448fd773-0b4c-4ddb-bd67-7436b76c6519 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d4529d6794c45b19aab2d9f09a2d256)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:19.457939 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec3864-b040-4c20-ad3a-4517eb5aaf32 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:19.458719 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448fd773-0b4c-4ddb-bd67-7436b76c6519 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:19.459671 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-18ec3864-b040-4c20-ad3a-4517eb5aaf32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:19.484324 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec3864-b040-4c20-ad3a-4517eb5aaf32 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:19.490091 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52480e10-b150-4e35-92d9-c2bd9704a4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:19.491060 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52480e10-b150-4e35-92d9-c2bd9704a4e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:19.491348 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52480e10-b150-4e35-92d9-c2bd9704a4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:19.491683 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52480e10-b150-4e35-92d9-c2bd9704a4e3 admin admin] PATH_INFO: `/v3/projects/d5aed05b657a40cb9fb149614addb1da` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:19.492879 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52480e10-b150-4e35-92d9-c2bd9704a4e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5aed05b657a40cb9fb149614addb1da)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:19.494868 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52480e10-b150-4e35-92d9-c2bd9704a4e3 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:19.529334 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-448fd773-0b4c-4ddb-bd67-7436b76c6519 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d4529d6794c45b19aab2d9f09a2d256', 'request_id': 'req-448fd773-0b4c-4ddb-bd67-7436b76c6519'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:19.537652 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-448fd773-0b4c-4ddb-bd67-7436b76c6519 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d4529d6794c45b19aab2d9f09a2d256', 'request_id': 'req-448fd773-0b4c-4ddb-bd67-7436b76c6519'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:19.546649 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-448fd773-0b4c-4ddb-bd67-7436b76c6519 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d4529d6794c45b19aab2d9f09a2d256', 'request_id': 'req-448fd773-0b4c-4ddb-bd67-7436b76c6519'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:19.554266 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-52480e10-b150-4e35-92d9-c2bd9704a4e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5aed05b657a40cb9fb149614addb1da', 'request_id': 'req-52480e10-b150-4e35-92d9-c2bd9704a4e3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:19.555946 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:19.560595 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-448fd773-0b4c-4ddb-bd67-7436b76c6519 admin admin] The token cache is being invalidate because project 0d4529d6794c45b19aab2d9f09a2d256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:25:19.561169 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-448fd773-0b4c-4ddb-bd67-7436b76c6519 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:19.562842 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-448fd773-0b4c-4ddb-bd67-7436b76c6519 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:19.565322 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 775/1573] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:25:19 2022] DELETE /identity/v3/projects/0d4529d6794c45b19aab2d9f09a2d256 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:19.569524 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448fd773-0b4c-4ddb-bd67-7436b76c6519 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:19.571044 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-52480e10-b150-4e35-92d9-c2bd9704a4e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5aed05b657a40cb9fb149614addb1da', 'request_id': 'req-52480e10-b150-4e35-92d9-c2bd9704a4e3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:19.571284 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-448fd773-0b4c-4ddb-bd67-7436b76c6519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:19.580109 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-52480e10-b150-4e35-92d9-c2bd9704a4e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5aed05b657a40cb9fb149614addb1da', 'request_id': 'req-52480e10-b150-4e35-92d9-c2bd9704a4e3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:19.601091 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-52480e10-b150-4e35-92d9-c2bd9704a4e3 admin admin] The token cache is being invalidate because project d5aed05b657a40cb9fb149614addb1da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:25:19.601714 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-52480e10-b150-4e35-92d9-c2bd9704a4e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:19.602636 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-52480e10-b150-4e35-92d9-c2bd9704a4e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:19.604551 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 799/1574] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:25:19 2022] DELETE /identity/v3/projects/d5aed05b657a40cb9fb149614addb1da => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:19.608213 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52480e10-b150-4e35-92d9-c2bd9704a4e3 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:19.610564 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-52480e10-b150-4e35-92d9-c2bd9704a4e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:19.666696 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448fd773-0b4c-4ddb-bd67-7436b76c6519 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:19.686621 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52480e10-b150-4e35-92d9-c2bd9704a4e3 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:19.693492 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9307ad0-db8c-40e8-ac24-6416871b821a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:19.694137 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9307ad0-db8c-40e8-ac24-6416871b821a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:19.694419 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9307ad0-db8c-40e8-ac24-6416871b821a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:19.694693 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9307ad0-db8c-40e8-ac24-6416871b821a admin admin] PATH_INFO: `/v3/users/2bb95fb85309494b9abae6d6b4d7a11e` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:19.700448 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9307ad0-db8c-40e8-ac24-6416871b821a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bb95fb85309494b9abae6d6b4d7a11e)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:19.702458 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9307ad0-db8c-40e8-ac24-6416871b821a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:19.735658 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728a0e7-8aad-453d-94fd-026c2ee9a1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:19.736443 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728a0e7-8aad-453d-94fd-026c2ee9a1db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:19.736908 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728a0e7-8aad-453d-94fd-026c2ee9a1db admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:19.737191 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728a0e7-8aad-453d-94fd-026c2ee9a1db admin admin] PATH_INFO: `/v3/users/1a1557e3fe4440aaa57e9e38f02ef355` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:19.738745 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0728a0e7-8aad-453d-94fd-026c2ee9a1db admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a1557e3fe4440aaa57e9e38f02ef355)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:19.741527 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0728a0e7-8aad-453d-94fd-026c2ee9a1db admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:19.763179 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a9307ad0-db8c-40e8-ac24-6416871b821a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bb95fb85309494b9abae6d6b4d7a11e'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:19.763843 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a9307ad0-db8c-40e8-ac24-6416871b821a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bb95fb85309494b9abae6d6b4d7a11e'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:19.780656 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:19.783585 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a9307ad0-db8c-40e8-ac24-6416871b821a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bb95fb85309494b9abae6d6b4d7a11e'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:19.793481 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a9307ad0-db8c-40e8-ac24-6416871b821a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bb95fb85309494b9abae6d6b4d7a11e'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:19.800638 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0728a0e7-8aad-453d-94fd-026c2ee9a1db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a1557e3fe4440aaa57e9e38f02ef355'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:19.803666 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a9307ad0-db8c-40e8-ac24-6416871b821a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bb95fb85309494b9abae6d6b4d7a11e'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:19.809727 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 800/1575] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:25:19 2022] DELETE /identity/v3/users/2bb95fb85309494b9abae6d6b4d7a11e => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:25:19.817518 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0728a0e7-8aad-453d-94fd-026c2ee9a1db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a1557e3fe4440aaa57e9e38f02ef355'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:19.818340 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0728a0e7-8aad-453d-94fd-026c2ee9a1db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a1557e3fe4440aaa57e9e38f02ef355'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:19.830846 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0728a0e7-8aad-453d-94fd-026c2ee9a1db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a1557e3fe4440aaa57e9e38f02ef355'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:19.832063 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0728a0e7-8aad-453d-94fd-026c2ee9a1db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a1557e3fe4440aaa57e9e38f02ef355'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:19.848907 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 776/1576] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:25:19 2022] DELETE /identity/v3/users/1a1557e3fe4440aaa57e9e38f02ef355 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:20.283194 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9307ad0-db8c-40e8-ac24-6416871b821a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:20.284728 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a9307ad0-db8c-40e8-ac24-6416871b821a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:20.375037 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9307ad0-db8c-40e8-ac24-6416871b821a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:20.437017 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728a0e7-8aad-453d-94fd-026c2ee9a1db admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:20.439303 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-0728a0e7-8aad-453d-94fd-026c2ee9a1db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:20.493014 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:20.495691 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07f593-6ad7-47b3-8b70-dddd8096f158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:20.496435 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07f593-6ad7-47b3-8b70-dddd8096f158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:20.496829 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07f593-6ad7-47b3-8b70-dddd8096f158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:20.497205 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07f593-6ad7-47b3-8b70-dddd8096f158 admin admin] PATH_INFO: `/v3/projects/8c2fff38f0d240b98512aa6829da1fd9` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:20.498454 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b07f593-6ad7-47b3-8b70-dddd8096f158 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c2fff38f0d240b98512aa6829da1fd9)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:20.501161 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b07f593-6ad7-47b3-8b70-dddd8096f158 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:20.539854 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728a0e7-8aad-453d-94fd-026c2ee9a1db admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:20.554995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7b07f593-6ad7-47b3-8b70-dddd8096f158 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c2fff38f0d240b98512aa6829da1fd9', 'request_id': 'req-7b07f593-6ad7-47b3-8b70-dddd8096f158'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:20.564018 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7b07f593-6ad7-47b3-8b70-dddd8096f158 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c2fff38f0d240b98512aa6829da1fd9', 'request_id': 'req-7b07f593-6ad7-47b3-8b70-dddd8096f158'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:20.569740 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7b07f593-6ad7-47b3-8b70-dddd8096f158 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c2fff38f0d240b98512aa6829da1fd9', 'request_id': 'req-7b07f593-6ad7-47b3-8b70-dddd8096f158'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:20.581935 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7b07f593-6ad7-47b3-8b70-dddd8096f158 admin admin] The token cache is being invalidate because project 8c2fff38f0d240b98512aa6829da1fd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:25:20.582281 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7b07f593-6ad7-47b3-8b70-dddd8096f158 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:20.582937 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7b07f593-6ad7-47b3-8b70-dddd8096f158 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:20.585322 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 801/1577] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:25:20 2022] DELETE /identity/v3/projects/8c2fff38f0d240b98512aa6829da1fd9 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:20.590100 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3140f-7041-486e-9e48-9d1c86a44a38 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:20.590396 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3140f-7041-486e-9e48-9d1c86a44a38 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:20.590660 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3140f-7041-486e-9e48-9d1c86a44a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:20.605213 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e02ce-356c-4d11-885e-a6c98e5fe418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:20.605871 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e02ce-356c-4d11-885e-a6c98e5fe418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:20.606150 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e02ce-356c-4d11-885e-a6c98e5fe418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:20.606422 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e02ce-356c-4d11-885e-a6c98e5fe418 admin admin] PATH_INFO: `/v3/projects/f404a723da184b78a3053c1539bbf51a` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:20.607539 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e02ce-356c-4d11-885e-a6c98e5fe418 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f404a723da184b78a3053c1539bbf51a)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:20.609779 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e02ce-356c-4d11-885e-a6c98e5fe418 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:20.612196 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-b0b3140f-7041-486e-9e48-9d1c86a44a38 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:20.613414 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b0b3140f-7041-486e-9e48-9d1c86a44a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:20.621932 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 802/1578] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:25:20.630378 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6ad33-2b98-461f-a8cf-c2d65b6458f6 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:20.630775 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6ad33-2b98-461f-a8cf-c2d65b6458f6 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:20.631143 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6ad33-2b98-461f-a8cf-c2d65b6458f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:20.653273 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f1e6ad33-2b98-461f-a8cf-c2d65b6458f6 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:20.654649 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f1e6ad33-2b98-461f-a8cf-c2d65b6458f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:20.660139 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:20.661145 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-a07e02ce-356c-4d11-885e-a6c98e5fe418 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f404a723da184b78a3053c1539bbf51a', 'request_id': 'req-a07e02ce-356c-4d11-885e-a6c98e5fe418'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:20.668373 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-a07e02ce-356c-4d11-885e-a6c98e5fe418 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f404a723da184b78a3053c1539bbf51a', 'request_id': 'req-a07e02ce-356c-4d11-885e-a6c98e5fe418'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:20.676099 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-a07e02ce-356c-4d11-885e-a6c98e5fe418 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f404a723da184b78a3053c1539bbf51a', 'request_id': 'req-a07e02ce-356c-4d11-885e-a6c98e5fe418'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:20.688341 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-a07e02ce-356c-4d11-885e-a6c98e5fe418 admin admin] The token cache is being invalidate because project f404a723da184b78a3053c1539bbf51a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:25:20.688628 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-a07e02ce-356c-4d11-885e-a6c98e5fe418 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:20.689264 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-a07e02ce-356c-4d11-885e-a6c98e5fe418 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:20.690748 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 777/1579] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:25:20 2022] DELETE /identity/v3/projects/f404a723da184b78a3053c1539bbf51a => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:20.696311 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfae9c4-beec-4fa3-b2cf-1ec318845f76 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:20.696594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfae9c4-beec-4fa3-b2cf-1ec318845f76 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:20.696868 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfae9c4-beec-4fa3-b2cf-1ec318845f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:20.716417 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-2dfae9c4-beec-4fa3-b2cf-1ec318845f76 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:20.717530 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2dfae9c4-beec-4fa3-b2cf-1ec318845f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:20.727694 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 778/1580] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:20.730474 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 803/1581] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:20.734799 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfae9c4-beec-4fa3-b2cf-1ec318845f76 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:20.736718 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27bfbd-1eb0-483c-885b-45abd81e59b0 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:20.737009 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27bfbd-1eb0-483c-885b-45abd81e59b0 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:20.737290 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27bfbd-1eb0-483c-885b-45abd81e59b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:20.745079 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfae9c4-beec-4fa3-b2cf-1ec318845f76 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:20.751512 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55996e-0128-43cd-8d66-ede8c8e3af46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:20.751512 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55996e-0128-43cd-8d66-ede8c8e3af46 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:20.751717 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55996e-0128-43cd-8d66-ede8c8e3af46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:20.751805 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55996e-0128-43cd-8d66-ede8c8e3af46 admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:20.752473 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55996e-0128-43cd-8d66-ede8c8e3af46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:25:20.752769 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55996e-0128-43cd-8d66-ede8c8e3af46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:20.754380 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55996e-0128-43cd-8d66-ede8c8e3af46 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:20.759667 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-0f27bfbd-1eb0-483c-885b-45abd81e59b0 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:20.760992 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0f27bfbd-1eb0-483c-885b-45abd81e59b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:20.767147 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 779/1582] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:25:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:25:20.769761 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 804/1583] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:20.771389 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55996e-0128-43cd-8d66-ede8c8e3af46 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:20.774295 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27bfbd-1eb0-483c-885b-45abd81e59b0 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:20.783372 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55996e-0128-43cd-8d66-ede8c8e3af46 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:20.784642 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27bfbd-1eb0-483c-885b-45abd81e59b0 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:20.788121 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a3d2b-1bb0-4d09-9977-aaa2be148b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:20.788732 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a3d2b-1bb0-4d09-9977-aaa2be148b9b admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:20.789006 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a3d2b-1bb0-4d09-9977-aaa2be148b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:20.789272 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a3d2b-1bb0-4d09-9977-aaa2be148b9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:20.789840 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fbbfe-fdfa-4649-8184-05e213d48b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:20.789962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a3d2b-1bb0-4d09-9977-aaa2be148b9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:20.790453 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fbbfe-fdfa-4649-8184-05e213d48b18 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:20.790789 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fbbfe-fdfa-4649-8184-05e213d48b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:20.791070 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fbbfe-fdfa-4649-8184-05e213d48b18 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:20.791712 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899fbbfe-fdfa-4649-8184-05e213d48b18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:25:20.791816 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a3d2b-1bb0-4d09-9977-aaa2be148b9b admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:20.792307 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899fbbfe-fdfa-4649-8184-05e213d48b18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:20.794033 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899fbbfe-fdfa-4649-8184-05e213d48b18 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:20.812976 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 805/1584] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:25:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:25:20.814107 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fbbfe-fdfa-4649-8184-05e213d48b18 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:20.825710 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fbbfe-fdfa-4649-8184-05e213d48b18 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:20.830506 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c69f20-688f-4398-b6e6-668679279b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:20.831222 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c69f20-688f-4398-b6e6-668679279b5b admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:20.831556 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c69f20-688f-4398-b6e6-668679279b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:20.831841 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c69f20-688f-4398-b6e6-668679279b5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:20.832761 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c69f20-688f-4398-b6e6-668679279b5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:20.832994 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 780/1585] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:25:20 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:25:20.833860 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a3d2b-1bb0-4d09-9977-aaa2be148b9b admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:20.834520 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c69f20-688f-4398-b6e6-668679279b5b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:20.868291 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:20.868563 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 806/1586] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:25:20 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:25:20.872732 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c69f20-688f-4398-b6e6-668679279b5b admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:20.924656 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a3d2b-1bb0-4d09-9977-aaa2be148b9b admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:20.969521 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c69f20-688f-4398-b6e6-668679279b5b admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:20.974640 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5c367-92aa-4020-b0f9-059114f49608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:20.975259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5c367-92aa-4020-b0f9-059114f49608 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:20.975544 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5c367-92aa-4020-b0f9-059114f49608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:20.975824 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5c367-92aa-4020-b0f9-059114f49608 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:20.976487 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5c367-92aa-4020-b0f9-059114f49608 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:20.978408 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5c367-92aa-4020-b0f9-059114f49608 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:20.988470 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6d96d-c880-4e15-acc1-b587060c850e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:20.990133 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6d96d-c880-4e15-acc1-b587060c850e admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:20.990429 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6d96d-c880-4e15-acc1-b587060c850e admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:20.990707 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6d96d-c880-4e15-acc1-b587060c850e admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:20.991342 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc6d96d-c880-4e15-acc1-b587060c850e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:20.993499 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc6d96d-c880-4e15-acc1-b587060c850e admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:21.006372 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 807/1587] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:25:20 2022] POST /identity/v3/users => generated 291 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:25:21.010227 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5c367-92aa-4020-b0f9-059114f49608 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:21.021301 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 781/1588] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:25:20 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:25:21.024417 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5c367-92aa-4020-b0f9-059114f49608 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:21.025435 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6d96d-c880-4e15-acc1-b587060c850e admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:21.029942 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac596ff-d08f-453b-93e1-b5803457a1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:21.031969 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac596ff-d08f-453b-93e1-b5803457a1fd admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:21.032843 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac596ff-d08f-453b-93e1-b5803457a1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:21.033190 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac596ff-d08f-453b-93e1-b5803457a1fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:21.033842 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac596ff-d08f-453b-93e1-b5803457a1fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:21.035507 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac596ff-d08f-453b-93e1-b5803457a1fd admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:21.036823 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6d96d-c880-4e15-acc1-b587060c850e admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:21.041964 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d981a4-cd06-4b1e-9674-958f0958b018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:21.042886 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d981a4-cd06-4b1e-9674-958f0958b018 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:21.043172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d981a4-cd06-4b1e-9674-958f0958b018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:21.043440 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d981a4-cd06-4b1e-9674-958f0958b018 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:21.044134 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d981a4-cd06-4b1e-9674-958f0958b018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:21.045732 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d981a4-cd06-4b1e-9674-958f0958b018 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:21.050763 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 808/1589] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:21.052309 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac596ff-d08f-453b-93e1-b5803457a1fd admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:21.056856 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 782/1590] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:25:21.060731 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d981a4-cd06-4b1e-9674-958f0958b018 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:21.062095 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac596ff-d08f-453b-93e1-b5803457a1fd admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:21.068252 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa45e0f-bfd9-4cdc-ad2c-6035c487c054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:21.068863 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa45e0f-bfd9-4cdc-ad2c-6035c487c054 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:21.069141 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa45e0f-bfd9-4cdc-ad2c-6035c487c054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:21.069411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa45e0f-bfd9-4cdc-ad2c-6035c487c054 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:21.070043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa45e0f-bfd9-4cdc-ad2c-6035c487c054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:21.071617 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa45e0f-bfd9-4cdc-ad2c-6035c487c054 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:21.071733 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d981a4-cd06-4b1e-9674-958f0958b018 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:21.077253 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918e737-2497-4b56-b52b-02e501a48dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:21.078019 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918e737-2497-4b56-b52b-02e501a48dbb admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:21.078367 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918e737-2497-4b56-b52b-02e501a48dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:21.078667 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918e737-2497-4b56-b52b-02e501a48dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:21.079313 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918e737-2497-4b56-b52b-02e501a48dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:21.081017 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918e737-2497-4b56-b52b-02e501a48dbb admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:21.083435 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 809/1591] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:21.087970 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa45e0f-bfd9-4cdc-ad2c-6035c487c054 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:21.093232 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 783/1592] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:21.097130 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918e737-2497-4b56-b52b-02e501a48dbb admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:21.101188 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa45e0f-bfd9-4cdc-ad2c-6035c487c054 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:21.116127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd36830-a9a0-4644-bcdc-8a1f76de676b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:21.116259 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918e737-2497-4b56-b52b-02e501a48dbb admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:21.116363 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd36830-a9a0-4644-bcdc-8a1f76de676b admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:21.116363 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd36830-a9a0-4644-bcdc-8a1f76de676b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:21.116363 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd36830-a9a0-4644-bcdc-8a1f76de676b admin admin] PATH_INFO: `/v3/projects/84ab61e3e59448d19cbf1ea2bbbe5949/users/c4b6664a095444b3bc53b57c7b99ee70/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:21.116577 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5b7c8-5662-42d4-aff9-1fc90b496eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:21.116577 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5b7c8-5662-42d4-aff9-1fc90b496eb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:21.116577 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5b7c8-5662-42d4-aff9-1fc90b496eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:21.116577 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5b7c8-5662-42d4-aff9-1fc90b496eb3 admin admin] PATH_INFO: `/v3/projects/c56ed2604dad4ce1a827a3ce1c0170ea/users/215483574ac446a0b2b7afcea442c875/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:21.129509 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf5b7c8-5662-42d4-aff9-1fc90b496eb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c56ed2604dad4ce1a827a3ce1c0170ea, user_id=215483574ac446a0b2b7afcea442c875, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:21.132049 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd36830-a9a0-4644-bcdc-8a1f76de676b admin admin] RBAC: Authorizing `identity:create_grant(project_id=84ab61e3e59448d19cbf1ea2bbbe5949, user_id=c4b6664a095444b3bc53b57c7b99ee70, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:21.132194 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf5b7c8-5662-42d4-aff9-1fc90b496eb3 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:21.134701 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd36830-a9a0-4644-bcdc-8a1f76de676b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:21.146444 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 784/1593] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:25:21 2022] PUT /identity/v3/projects/c56ed2604dad4ce1a827a3ce1c0170ea/users/215483574ac446a0b2b7afcea442c875/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:25:21.149413 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 810/1594] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:25:21 2022] PUT /identity/v3/projects/84ab61e3e59448d19cbf1ea2bbbe5949/users/c4b6664a095444b3bc53b57c7b99ee70/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:21.158530 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a2124-ea24-4948-a922-0bb7a50a1e4d None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:21.158819 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a2124-ea24-4948-a922-0bb7a50a1e4d None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:21.159097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a2124-ea24-4948-a922-0bb7a50a1e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:21.161230 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c6243-680d-4316-b9e3-083643d094ea None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:21.161522 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c6243-680d-4316-b9e3-083643d094ea None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:21.161816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c6243-680d-4316-b9e3-083643d094ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:21.181887 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:21.189776 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-378a2124-ea24-4948-a922-0bb7a50a1e4d None None] MFA Rules not processed for user `215483574ac446a0b2b7afcea442c875`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:21.190211 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-ae7c6243-680d-4316-b9e3-083643d094ea None None] MFA Rules not processed for user `c4b6664a095444b3bc53b57c7b99ee70`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:21.190990 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-378a2124-ea24-4948-a922-0bb7a50a1e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:21.192153 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ae7c6243-680d-4316-b9e3-083643d094ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:21.269522 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 811/1595] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:25:21.273830 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c6243-680d-4316-b9e3-083643d094ea None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:21.274313 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 785/1596] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:21.275639 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a2124-ea24-4948-a922-0bb7a50a1e4d None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:21.284294 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:21.384393 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a2124-ea24-4948-a922-0bb7a50a1e4d None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:21.385021 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c6243-680d-4316-b9e3-083643d094ea None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:21.391220 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167d8c5-e783-421d-9369-0e6f18856b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:21.392114 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167d8c5-e783-421d-9369-0e6f18856b93 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:21.392514 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167d8c5-e783-421d-9369-0e6f18856b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:21.393210 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167d8c5-e783-421d-9369-0e6f18856b93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:21.394001 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167d8c5-e783-421d-9369-0e6f18856b93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:21.395558 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d8ac8-774d-48c2-92bf-12a2ce4cd222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:21.396225 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d8ac8-774d-48c2-92bf-12a2ce4cd222 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:21.396503 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d8ac8-774d-48c2-92bf-12a2ce4cd222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:21.396674 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167d8c5-e783-421d-9369-0e6f18856b93 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:21.396933 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d8ac8-774d-48c2-92bf-12a2ce4cd222 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:21.397707 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d8ac8-774d-48c2-92bf-12a2ce4cd222 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:21.399593 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d8ac8-774d-48c2-92bf-12a2ce4cd222 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:21.433935 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 786/1597] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:25:21 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:25:21.437645 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167d8c5-e783-421d-9369-0e6f18856b93 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:21.464306 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 812/1598] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:25:21 2022] POST /identity/v3/projects => generated 381 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:25:21.467882 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d8ac8-774d-48c2-92bf-12a2ce4cd222 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:21.565351 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167d8c5-e783-421d-9369-0e6f18856b93 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:21.639653 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d8ac8-774d-48c2-92bf-12a2ce4cd222 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:21.646234 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f8592-b6ca-4e40-bae8-b31e16d6796e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:21.647058 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f8592-b6ca-4e40-bae8-b31e16d6796e admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:21.647585 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f8592-b6ca-4e40-bae8-b31e16d6796e admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:21.648060 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f8592-b6ca-4e40-bae8-b31e16d6796e admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:21.648928 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f8592-b6ca-4e40-bae8-b31e16d6796e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:21.649494 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488ca08-e123-4e1d-99fb-a3a36ef856f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:21.651718 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f8592-b6ca-4e40-bae8-b31e16d6796e admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:21.652254 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488ca08-e123-4e1d-99fb-a3a36ef856f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:21.653646 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488ca08-e123-4e1d-99fb-a3a36ef856f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:21.653990 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488ca08-e123-4e1d-99fb-a3a36ef856f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:21.659304 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488ca08-e123-4e1d-99fb-a3a36ef856f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:21.662392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488ca08-e123-4e1d-99fb-a3a36ef856f0 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:21.704705 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 787/1599] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:25:21 2022] POST /identity/v3/users => generated 293 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:25:21.706195 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f8592-b6ca-4e40-bae8-b31e16d6796e admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:21.728605 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f8592-b6ca-4e40-bae8-b31e16d6796e admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:21.735409 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a398fe-9c8b-46f0-ae78-419c2b5b369c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:21.736644 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a398fe-9c8b-46f0-ae78-419c2b5b369c admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:21.737440 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a398fe-9c8b-46f0-ae78-419c2b5b369c admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:21.737890 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a398fe-9c8b-46f0-ae78-419c2b5b369c admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:21.738337 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 813/1600] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:25:21 2022] POST /identity/v3/users => generated 297 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:25:21.739070 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a398fe-9c8b-46f0-ae78-419c2b5b369c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:21.741242 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a398fe-9c8b-46f0-ae78-419c2b5b369c admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:21.742764 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488ca08-e123-4e1d-99fb-a3a36ef856f0 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:21.755309 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488ca08-e123-4e1d-99fb-a3a36ef856f0 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:21.760504 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383b00e-da23-4134-ab94-da5802cbcb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:21.761403 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383b00e-da23-4134-ab94-da5802cbcb86 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:21.761730 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383b00e-da23-4134-ab94-da5802cbcb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:21.762015 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383b00e-da23-4134-ab94-da5802cbcb86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:21.762676 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4383b00e-da23-4134-ab94-da5802cbcb86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:21.764403 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 788/1601] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:21.764500 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4383b00e-da23-4134-ab94-da5802cbcb86 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:21.779146 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a398fe-9c8b-46f0-ae78-419c2b5b369c admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:21.779146 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a398fe-9c8b-46f0-ae78-419c2b5b369c admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:21.784303 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25e937-b6f7-4de4-aad5-17c9ffc08a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:21.784922 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25e937-b6f7-4de4-aad5-17c9ffc08a4d admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:21.785202 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25e937-b6f7-4de4-aad5-17c9ffc08a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:21.785480 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25e937-b6f7-4de4-aad5-17c9ffc08a4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:21.786185 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25e937-b6f7-4de4-aad5-17c9ffc08a4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:21.787850 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25e937-b6f7-4de4-aad5-17c9ffc08a4d admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:21.789259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 814/1602] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:21.790529 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383b00e-da23-4134-ab94-da5802cbcb86 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:21.798134 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:21.806173 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383b00e-da23-4134-ab94-da5802cbcb86 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:21.807138 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 789/1603] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:25:21.809216 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25e937-b6f7-4de4-aad5-17c9ffc08a4d admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:21.815484 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e15af-3340-4ca2-b2cb-1ac37f1fbd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:21.816410 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e15af-3340-4ca2-b2cb-1ac37f1fbd87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:21.816695 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e15af-3340-4ca2-b2cb-1ac37f1fbd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:21.817515 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:21.817654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e15af-3340-4ca2-b2cb-1ac37f1fbd87 admin admin] PATH_INFO: `/v3/projects/984f780ec4814a1cbf2d82cdb06595f4/users/569761aa4ef346a09f7e974d02e909e0/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:21.825718 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25e937-b6f7-4de4-aad5-17c9ffc08a4d admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:21.832754 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b0525-df7c-4ff9-b87a-8febaea4f264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:21.833851 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b0525-df7c-4ff9-b87a-8febaea4f264 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:21.834879 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b0525-df7c-4ff9-b87a-8febaea4f264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:21.835623 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b0525-df7c-4ff9-b87a-8febaea4f264 admin admin] PATH_INFO: `/v3/projects/61012086ebfb4f8e885909834ae87a39/users/df7cc142c3514311978e3ff5530cb4b1/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:21.840287 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e15af-3340-4ca2-b2cb-1ac37f1fbd87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=984f780ec4814a1cbf2d82cdb06595f4, user_id=569761aa4ef346a09f7e974d02e909e0, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:21.843213 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e15af-3340-4ca2-b2cb-1ac37f1fbd87 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:21.865079 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 815/1604] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:25:21 2022] PUT /identity/v3/projects/984f780ec4814a1cbf2d82cdb06595f4/users/569761aa4ef346a09f7e974d02e909e0/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:21.866526 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b0525-df7c-4ff9-b87a-8febaea4f264 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61012086ebfb4f8e885909834ae87a39, user_id=df7cc142c3514311978e3ff5530cb4b1, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:21.868730 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e15af-3340-4ca2-b2cb-1ac37f1fbd87 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:21.869983 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b0525-df7c-4ff9-b87a-8febaea4f264 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:21.891490 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 790/1605] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:25:21 2022] PUT /identity/v3/projects/61012086ebfb4f8e885909834ae87a39/users/df7cc142c3514311978e3ff5530cb4b1/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:21.901222 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfa85c-0cfc-4d4a-b251-c153bf708ace None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:21.901510 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfa85c-0cfc-4d4a-b251-c153bf708ace None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:21.901785 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfa85c-0cfc-4d4a-b251-c153bf708ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:21.947338 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-2acfa85c-0cfc-4d4a-b251-c153bf708ace None None] MFA Rules not processed for user `df7cc142c3514311978e3ff5530cb4b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:21.949499 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2acfa85c-0cfc-4d4a-b251-c153bf708ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:21.989058 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e15af-3340-4ca2-b2cb-1ac37f1fbd87 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:22.063788 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 791/1606] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:25:22.065272 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297283fb-503c-4aa0-8220-96607e8e72bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:22.065917 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297283fb-503c-4aa0-8220-96607e8e72bb admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:22.066200 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297283fb-503c-4aa0-8220-96607e8e72bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:22.067226 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297283fb-503c-4aa0-8220-96607e8e72bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:22.067226 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297283fb-503c-4aa0-8220-96607e8e72bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:22.068883 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297283fb-503c-4aa0-8220-96607e8e72bb admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:22.071170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acfa85c-0cfc-4d4a-b251-c153bf708ace None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:22.085113 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acfa85c-0cfc-4d4a-b251-c153bf708ace None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:22.091436 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 816/1607] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:22.096709 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297283fb-503c-4aa0-8220-96607e8e72bb admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:22.097702 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493e66a-9aac-4c89-b510-59dbcdf83188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:22.098521 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493e66a-9aac-4c89-b510-59dbcdf83188 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:22.099458 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493e66a-9aac-4c89-b510-59dbcdf83188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:22.099458 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493e66a-9aac-4c89-b510-59dbcdf83188 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:22.099884 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7493e66a-9aac-4c89-b510-59dbcdf83188 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:22.103815 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7493e66a-9aac-4c89-b510-59dbcdf83188 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:22.107632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297283fb-503c-4aa0-8220-96607e8e72bb admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:22.113840 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b3569-5639-46b9-9369-29841dfd9ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:22.114516 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b3569-5639-46b9-9369-29841dfd9ad0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:22.114802 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b3569-5639-46b9-9369-29841dfd9ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:22.115085 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b3569-5639-46b9-9369-29841dfd9ad0 admin admin] PATH_INFO: `/v3/projects/984f780ec4814a1cbf2d82cdb06595f4/users/569761aa4ef346a09f7e974d02e909e0/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:22.118180 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b3569-5639-46b9-9369-29841dfd9ad0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=984f780ec4814a1cbf2d82cdb06595f4, user_id=569761aa4ef346a09f7e974d02e909e0, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:22.121101 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b3569-5639-46b9-9369-29841dfd9ad0 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:22.143999 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 817/1608] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:25:22 2022] PUT /identity/v3/projects/984f780ec4814a1cbf2d82cdb06595f4/users/569761aa4ef346a09f7e974d02e909e0/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:22.149420 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9033d-7a0d-4908-be43-d2234832a8d0 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:22.150265 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9033d-7a0d-4908-be43-d2234832a8d0 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:22.151019 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9033d-7a0d-4908-be43-d2234832a8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:22.153839 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 792/1609] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:25:22 2022] POST /identity/v3/projects => generated 385 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:25:22.156859 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493e66a-9aac-4c89-b510-59dbcdf83188 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:22.206212 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-06d9033d-7a0d-4908-be43-d2234832a8d0 None None] MFA Rules not processed for user `569761aa4ef346a09f7e974d02e909e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:22.208083 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-06d9033d-7a0d-4908-be43-d2234832a8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:22.260150 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493e66a-9aac-4c89-b510-59dbcdf83188 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:22.266786 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65009a2-5685-4f8c-bb94-9487700a3b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:22.267751 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65009a2-5685-4f8c-bb94-9487700a3b1f admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:22.268138 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65009a2-5685-4f8c-bb94-9487700a3b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:22.268614 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65009a2-5685-4f8c-bb94-9487700a3b1f admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:22.269327 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65009a2-5685-4f8c-bb94-9487700a3b1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:22.271405 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65009a2-5685-4f8c-bb94-9487700a3b1f admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:22.293682 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:22.300794 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 793/1610] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:25:22 2022] POST /identity/v3/users => generated 299 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:25:22.303653 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65009a2-5685-4f8c-bb94-9487700a3b1f admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:22.313597 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 818/1611] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:22 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:22.317493 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65009a2-5685-4f8c-bb94-9487700a3b1f admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:22.322509 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e809f-1681-4526-bd3c-ccc9b94e993b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:22.323190 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e809f-1681-4526-bd3c-ccc9b94e993b admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:22.324020 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e809f-1681-4526-bd3c-ccc9b94e993b admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:22.324020 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e809f-1681-4526-bd3c-ccc9b94e993b admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:22.324560 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e809f-1681-4526-bd3c-ccc9b94e993b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:22.326219 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e809f-1681-4526-bd3c-ccc9b94e993b admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:22.331873 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d9033d-7a0d-4908-be43-d2234832a8d0 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:22.335422 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-06d9033d-7a0d-4908-be43-d2234832a8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:22.339125 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 794/1612] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:22.344147 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e809f-1681-4526-bd3c-ccc9b94e993b admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:22.355500 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e809f-1681-4526-bd3c-ccc9b94e993b admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:22.360611 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e91f8-2cd8-471a-ac07-4a5adcf004a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:22.361343 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e91f8-2cd8-471a-ac07-4a5adcf004a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:22.361698 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e91f8-2cd8-471a-ac07-4a5adcf004a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:22.362032 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e91f8-2cd8-471a-ac07-4a5adcf004a2 admin admin] PATH_INFO: `/v3/projects/c5cc64edf27c48d3a19f340bc0401e7a/users/84cc431187db486a965dafcfbe157113/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:22.379791 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e91f8-2cd8-471a-ac07-4a5adcf004a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5cc64edf27c48d3a19f340bc0401e7a, user_id=84cc431187db486a965dafcfbe157113, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:22.383341 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e91f8-2cd8-471a-ac07-4a5adcf004a2 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:22.393707 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:22.399244 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 795/1613] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:25:22 2022] PUT /identity/v3/projects/c5cc64edf27c48d3a19f340bc0401e7a/users/84cc431187db486a965dafcfbe157113/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:22.403146 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e91f8-2cd8-471a-ac07-4a5adcf004a2 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:22.428444 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d9033d-7a0d-4908-be43-d2234832a8d0 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:22.472632 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e91f8-2cd8-471a-ac07-4a5adcf004a2 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:22.480299 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88406d-b111-42d9-a229-72c067243ebe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:22.480939 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88406d-b111-42d9-a229-72c067243ebe service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:22.481216 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88406d-b111-42d9-a229-72c067243ebe service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:22.481485 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88406d-b111-42d9-a229-72c067243ebe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:22.485084 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5dfed8-5d7a-4358-b533-a15737f59ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:22.485995 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5dfed8-5d7a-4358-b533-a15737f59ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:22.486682 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5dfed8-5d7a-4358-b533-a15737f59ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:22.486924 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5dfed8-5d7a-4358-b533-a15737f59ec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:22.489616 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5dfed8-5d7a-4358-b533-a15737f59ec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:22.491179 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5dfed8-5d7a-4358-b533-a15737f59ec5 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:22.505767 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 796/1614] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:22.511762 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5dfed8-5d7a-4358-b533-a15737f59ec5 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:22.522844 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5dfed8-5d7a-4358-b533-a15737f59ec5 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:22.528111 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e99f4-4228-4883-8fd6-dabdd637b9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:22.528774 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e99f4-4228-4883-8fd6-dabdd637b9d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:22.529057 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e99f4-4228-4883-8fd6-dabdd637b9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:22.529403 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e99f4-4228-4883-8fd6-dabdd637b9d1 admin admin] PATH_INFO: `/v3/projects/c5cc64edf27c48d3a19f340bc0401e7a/users/84cc431187db486a965dafcfbe157113/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:22.531864 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e99f4-4228-4883-8fd6-dabdd637b9d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5cc64edf27c48d3a19f340bc0401e7a, user_id=84cc431187db486a965dafcfbe157113, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:22.534576 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e99f4-4228-4883-8fd6-dabdd637b9d1 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:22.548092 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 797/1615] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:25:22 2022] PUT /identity/v3/projects/c5cc64edf27c48d3a19f340bc0401e7a/users/84cc431187db486a965dafcfbe157113/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:22.558837 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a65f55-51d0-4f92-8dc4-ba0ae25f99c0 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:22.559208 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a65f55-51d0-4f92-8dc4-ba0ae25f99c0 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:22.559558 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a65f55-51d0-4f92-8dc4-ba0ae25f99c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:22.567018 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a88406d-b111-42d9-a229-72c067243ebe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:22.568735 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a88406d-b111-42d9-a229-72c067243ebe service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:22.582505 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 819/1616] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:22 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 13:25:22.592614 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-06a65f55-51d0-4f92-8dc4-ba0ae25f99c0 None None] MFA Rules not processed for user `84cc431187db486a965dafcfbe157113`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:22.594174 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-06a65f55-51d0-4f92-8dc4-ba0ae25f99c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:22.675820 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 798/1617] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:22 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:25:22.684813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88406d-b111-42d9-a229-72c067243ebe service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:22.686918 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a65f55-51d0-4f92-8dc4-ba0ae25f99c0 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:22.688464 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-06a65f55-51d0-4f92-8dc4-ba0ae25f99c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:22.693823 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88406d-b111-42d9-a229-72c067243ebe service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:22.748078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098de27-aff8-45f7-868e-cf7b2dc68556 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:22.748598 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098de27-aff8-45f7-868e-cf7b2dc68556 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:22.748961 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098de27-aff8-45f7-868e-cf7b2dc68556 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:22.749243 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098de27-aff8-45f7-868e-cf7b2dc68556 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:22.751166 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a65f55-51d0-4f92-8dc4-ba0ae25f99c0 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:22.754698 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb2ae8-25fd-4da7-ae21-3e2256cfd43d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:22.755296 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb2ae8-25fd-4da7-ae21-3e2256cfd43d service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:22.755567 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb2ae8-25fd-4da7-ae21-3e2256cfd43d service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:22.755831 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb2ae8-25fd-4da7-ae21-3e2256cfd43d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:22.763045 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:22.764825 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb2ae8-25fd-4da7-ae21-3e2256cfd43d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:22.767100 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb2ae8-25fd-4da7-ae21-3e2256cfd43d service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:22.776870 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 799/1618] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:22 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 13:25:22.813992 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9098de27-aff8-45f7-868e-cf7b2dc68556 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:22.815563 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9098de27-aff8-45f7-868e-cf7b2dc68556 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:22.826477 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 820/1619] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:25:23.208770 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb2ae8-25fd-4da7-ae21-3e2256cfd43d service cinder] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:23.224077 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:23.299033 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb2ae8-25fd-4da7-ae21-3e2256cfd43d service cinder] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:23.303693 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87baa822-b4ff-4f22-b19b-390471d9ea60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:23.304359 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87baa822-b4ff-4f22-b19b-390471d9ea60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:23.305212 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87baa822-b4ff-4f22-b19b-390471d9ea60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:23.305212 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87baa822-b4ff-4f22-b19b-390471d9ea60 admin admin] PATH_INFO: `/v3/users/c4b6664a095444b3bc53b57c7b99ee70` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:23.309069 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87baa822-b4ff-4f22-b19b-390471d9ea60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4b6664a095444b3bc53b57c7b99ee70)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:23.310974 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87baa822-b4ff-4f22-b19b-390471d9ea60 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:23.394843 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-87baa822-b4ff-4f22-b19b-390471d9ea60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4b6664a095444b3bc53b57c7b99ee70'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:23.410728 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-87baa822-b4ff-4f22-b19b-390471d9ea60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4b6664a095444b3bc53b57c7b99ee70'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:23.412243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-87baa822-b4ff-4f22-b19b-390471d9ea60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4b6664a095444b3bc53b57c7b99ee70'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:23.423596 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-87baa822-b4ff-4f22-b19b-390471d9ea60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4b6664a095444b3bc53b57c7b99ee70'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:23.425200 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-87baa822-b4ff-4f22-b19b-390471d9ea60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4b6664a095444b3bc53b57c7b99ee70'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:23.463583 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 800/1620] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:25:23 2022] DELETE /identity/v3/users/c4b6664a095444b3bc53b57c7b99ee70 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:23.479447 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b7cae-6965-465c-8889-9b731bb95ac2 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:23.479447 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b7cae-6965-465c-8889-9b731bb95ac2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:23.479447 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b7cae-6965-465c-8889-9b731bb95ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:23.491514 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87baa822-b4ff-4f22-b19b-390471d9ea60 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:23.495996 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-87baa822-b4ff-4f22-b19b-390471d9ea60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:23.525410 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-5d4b7cae-6965-465c-8889-9b731bb95ac2 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:23.526646 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5d4b7cae-6965-465c-8889-9b731bb95ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:23.603587 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87baa822-b4ff-4f22-b19b-390471d9ea60 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:23.608596 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd46fa4-5033-4b3e-ab34-e6ded538a0bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:23.610276 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd46fa4-5033-4b3e-ab34-e6ded538a0bd service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:23.611001 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd46fa4-5033-4b3e-ab34-e6ded538a0bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:23.611279 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd46fa4-5033-4b3e-ab34-e6ded538a0bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:23.611503 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 821/1621] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:23.613238 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-8bd46fa4-5033-4b3e-ab34-e6ded538a0bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:23.622188 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b7cae-6965-465c-8889-9b731bb95ac2 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:23.623733 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5d4b7cae-6965-465c-8889-9b731bb95ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:23.681291 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:23.700203 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd46fa4-5033-4b3e-ab34-e6ded538a0bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:23.702430 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd46fa4-5033-4b3e-ab34-e6ded538a0bd service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:23.716316 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b7cae-6965-465c-8889-9b731bb95ac2 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:23.722681 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3cd9b-d33c-4628-b71e-53e3aecce70a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:23.723305 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3cd9b-d33c-4628-b71e-53e3aecce70a service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:23.723586 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3cd9b-d33c-4628-b71e-53e3aecce70a service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:23.723860 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3cd9b-d33c-4628-b71e-53e3aecce70a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:23.726084 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 801/1622] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 13:25:23.746321 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3cd9b-d33c-4628-b71e-53e3aecce70a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:23.747954 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3cd9b-d33c-4628-b71e-53e3aecce70a service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:23.761971 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376379a-1d6f-4870-9064-e9ea107a0ade None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:23.762343 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376379a-1d6f-4870-9064-e9ea107a0ade None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:23.762682 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376379a-1d6f-4870-9064-e9ea107a0ade None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:23.768652 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 802/1623] 10.222.0.25 () {54 vars in 921 bytes} [Tue Oct 25 13:25:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:25:23.768846 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 822/1624] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:25:23.783076 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba09d26-5cfa-4a6c-9ff8-3c689b8064f0 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:23.783446 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba09d26-5cfa-4a6c-9ff8-3c689b8064f0 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:23.784188 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba09d26-5cfa-4a6c-9ff8-3c689b8064f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:23.818250 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-fba09d26-5cfa-4a6c-9ff8-3c689b8064f0 None None] MFA Rules not processed for user `63e73c00cadb4deea934db6111ed76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:23.819675 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-fba09d26-5cfa-4a6c-9ff8-3c689b8064f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:23.928259 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 803/1625] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Oct 25 13:25:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:25:23.939036 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3cd9b-d33c-4628-b71e-53e3aecce70a service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:23.940656 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-eaa3cd9b-d33c-4628-b71e-53e3aecce70a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:23.959130 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3cd9b-d33c-4628-b71e-53e3aecce70a service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:23.966183 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507368c-0c82-478f-a672-ac6626276def service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:23.967277 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507368c-0c82-478f-a672-ac6626276def service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:23.967277 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507368c-0c82-478f-a672-ac6626276def service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:23.967469 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507368c-0c82-478f-a672-ac6626276def service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:23.978474 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507368c-0c82-478f-a672-ac6626276def service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:23.987613 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507368c-0c82-478f-a672-ac6626276def service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:24.023751 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 823/1626] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:25:24.206309 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba09d26-5cfa-4a6c-9ff8-3c689b8064f0 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:24.207731 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-fba09d26-5cfa-4a6c-9ff8-3c689b8064f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:24.223549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba09d26-5cfa-4a6c-9ff8-3c689b8064f0 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:24.232719 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056df062-f2de-4351-9990-1794338babd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:24.233470 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056df062-f2de-4351-9990-1794338babd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:24.233781 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056df062-f2de-4351-9990-1794338babd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:24.234584 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056df062-f2de-4351-9990-1794338babd8 admin admin] PATH_INFO: `/v3/projects/84ab61e3e59448d19cbf1ea2bbbe5949` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:24.235742 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056df062-f2de-4351-9990-1794338babd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84ab61e3e59448d19cbf1ea2bbbe5949)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:24.238166 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056df062-f2de-4351-9990-1794338babd8 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:24.317846 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-056df062-f2de-4351-9990-1794338babd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84ab61e3e59448d19cbf1ea2bbbe5949', 'request_id': 'req-056df062-f2de-4351-9990-1794338babd8'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:24.325512 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-056df062-f2de-4351-9990-1794338babd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84ab61e3e59448d19cbf1ea2bbbe5949', 'request_id': 'req-056df062-f2de-4351-9990-1794338babd8'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:24.337201 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-056df062-f2de-4351-9990-1794338babd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84ab61e3e59448d19cbf1ea2bbbe5949', 'request_id': 'req-056df062-f2de-4351-9990-1794338babd8'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:24.356117 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-056df062-f2de-4351-9990-1794338babd8 admin admin] The token cache is being invalidate because project 84ab61e3e59448d19cbf1ea2bbbe5949 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:25:24.356421 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-056df062-f2de-4351-9990-1794338babd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:24.357097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-056df062-f2de-4351-9990-1794338babd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:24.361341 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 804/1627] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:25:24 2022] DELETE /identity/v3/projects/84ab61e3e59448d19cbf1ea2bbbe5949 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:24.365090 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507368c-0c82-478f-a672-ac6626276def service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:24.377006 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507368c-0c82-478f-a672-ac6626276def service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:24.433036 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:24.450409 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f699b-a8af-4c56-a6b5-91f15b1ee361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:24.452022 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f699b-a8af-4c56-a6b5-91f15b1ee361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:24.453312 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f699b-a8af-4c56-a6b5-91f15b1ee361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:24.453615 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f699b-a8af-4c56-a6b5-91f15b1ee361 admin admin] PATH_INFO: `/v3/users/569761aa4ef346a09f7e974d02e909e0` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:24.455494 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f699b-a8af-4c56-a6b5-91f15b1ee361 admin admin] RBAC: Authorizing `identity:delete_user(user_id=569761aa4ef346a09f7e974d02e909e0)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:24.457656 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f699b-a8af-4c56-a6b5-91f15b1ee361 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:24.482738 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056df062-f2de-4351-9990-1794338babd8 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:24.484230 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-056df062-f2de-4351-9990-1794338babd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:24.499437 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056df062-f2de-4351-9990-1794338babd8 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:24.504716 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada856c-1445-4968-86af-b35f87149ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:24.505624 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada856c-1445-4968-86af-b35f87149ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:24.505624 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada856c-1445-4968-86af-b35f87149ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:24.506015 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada856c-1445-4968-86af-b35f87149ff0 admin admin] PATH_INFO: `/v3/users/9b5a51a651ac41768e266fbda1f53963` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:24.507115 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada856c-1445-4968-86af-b35f87149ff0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b5a51a651ac41768e266fbda1f53963)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:24.509093 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada856c-1445-4968-86af-b35f87149ff0 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:24.509687 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-133f699b-a8af-4c56-a6b5-91f15b1ee361 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '569761aa4ef346a09f7e974d02e909e0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:24.510677 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-133f699b-a8af-4c56-a6b5-91f15b1ee361 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '569761aa4ef346a09f7e974d02e909e0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:24.523557 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-133f699b-a8af-4c56-a6b5-91f15b1ee361 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '569761aa4ef346a09f7e974d02e909e0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:24.533017 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-133f699b-a8af-4c56-a6b5-91f15b1ee361 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '569761aa4ef346a09f7e974d02e909e0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:24.542662 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-133f699b-a8af-4c56-a6b5-91f15b1ee361 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '569761aa4ef346a09f7e974d02e909e0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:24.550104 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 824/1628] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:25:24 2022] DELETE /identity/v3/users/569761aa4ef346a09f7e974d02e909e0 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:24.567174 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0ada856c-1445-4968-86af-b35f87149ff0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b5a51a651ac41768e266fbda1f53963'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:24.573346 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:24.584887 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0ada856c-1445-4968-86af-b35f87149ff0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b5a51a651ac41768e266fbda1f53963'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:24.586135 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0ada856c-1445-4968-86af-b35f87149ff0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b5a51a651ac41768e266fbda1f53963'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:24.597295 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0ada856c-1445-4968-86af-b35f87149ff0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b5a51a651ac41768e266fbda1f53963'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:24.597974 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0ada856c-1445-4968-86af-b35f87149ff0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b5a51a651ac41768e266fbda1f53963'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:24.612655 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 805/1629] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:25:24 2022] DELETE /identity/v3/users/9b5a51a651ac41768e266fbda1f53963 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:25:24.617143 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89f4af-f280-428f-af4e-f53ca261fd08 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:24.617654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89f4af-f280-428f-af4e-f53ca261fd08 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:24.618200 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89f4af-f280-428f-af4e-f53ca261fd08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:24.660769 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-bd89f4af-f280-428f-af4e-f53ca261fd08 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:24.662878 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-bd89f4af-f280-428f-af4e-f53ca261fd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:24.735079 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 825/1630] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:24.744975 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada856c-1445-4968-86af-b35f87149ff0 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:24.746381 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-0ada856c-1445-4968-86af-b35f87149ff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:24.814056 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada856c-1445-4968-86af-b35f87149ff0 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:24.818637 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa922867-5c07-4287-ab92-6e123c2ff792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:24.819493 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa922867-5c07-4287-ab92-6e123c2ff792 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:24.820100 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa922867-5c07-4287-ab92-6e123c2ff792 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:24.820376 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa922867-5c07-4287-ab92-6e123c2ff792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:24.830793 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa922867-5c07-4287-ab92-6e123c2ff792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:24.832423 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa922867-5c07-4287-ab92-6e123c2ff792 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:24.842493 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 806/1631] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:25:24.955346 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89f4af-f280-428f-af4e-f53ca261fd08 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:24.957494 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-bd89f4af-f280-428f-af4e-f53ca261fd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:24.974638 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89f4af-f280-428f-af4e-f53ca261fd08 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:24.986278 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f7e2fe-b6d5-471a-9514-3b52c702be3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:24.986946 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7e2fe-b6d5-471a-9514-3b52c702be3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:24.987296 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7e2fe-b6d5-471a-9514-3b52c702be3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:24.987493 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7e2fe-b6d5-471a-9514-3b52c702be3b admin admin] PATH_INFO: `/v3/projects/984f780ec4814a1cbf2d82cdb06595f4` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:24.988677 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f7e2fe-b6d5-471a-9514-3b52c702be3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=984f780ec4814a1cbf2d82cdb06595f4)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:24.990608 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f7e2fe-b6d5-471a-9514-3b52c702be3b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:25.042886 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e2f7e2fe-b6d5-471a-9514-3b52c702be3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '984f780ec4814a1cbf2d82cdb06595f4', 'request_id': 'req-e2f7e2fe-b6d5-471a-9514-3b52c702be3b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:25.052616 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e2f7e2fe-b6d5-471a-9514-3b52c702be3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '984f780ec4814a1cbf2d82cdb06595f4', 'request_id': 'req-e2f7e2fe-b6d5-471a-9514-3b52c702be3b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:25.060815 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:25.064115 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e2f7e2fe-b6d5-471a-9514-3b52c702be3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '984f780ec4814a1cbf2d82cdb06595f4', 'request_id': 'req-e2f7e2fe-b6d5-471a-9514-3b52c702be3b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:25.078558 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e2f7e2fe-b6d5-471a-9514-3b52c702be3b admin admin] The token cache is being invalidate because project 984f780ec4814a1cbf2d82cdb06595f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:25:25.079249 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e2f7e2fe-b6d5-471a-9514-3b52c702be3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:25.080404 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e2f7e2fe-b6d5-471a-9514-3b52c702be3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:25.082075 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 826/1632] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:25:24 2022] DELETE /identity/v3/projects/984f780ec4814a1cbf2d82cdb06595f4 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:25.086796 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3c021-b774-40a4-bcbb-d62096a02079 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:25.087072 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3c021-b774-40a4-bcbb-d62096a02079 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:25.087352 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3c021-b774-40a4-bcbb-d62096a02079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:25.108898 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-d5d3c021-b774-40a4-bcbb-d62096a02079 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:25.110830 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-d5d3c021-b774-40a4-bcbb-d62096a02079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:25.191970 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 807/1633] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:25:25.198022 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f7e2fe-b6d5-471a-9514-3b52c702be3b admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:25.199703 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e2f7e2fe-b6d5-471a-9514-3b52c702be3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:25.209786 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8bde4-cdcc-4bb4-af1e-4de0162bcdb8 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:25.210078 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8bde4-cdcc-4bb4-af1e-4de0162bcdb8 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:25.210359 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8bde4-cdcc-4bb4-af1e-4de0162bcdb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:25.217322 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f7e2fe-b6d5-471a-9514-3b52c702be3b admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:25.231745 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-70f8bde4-cdcc-4bb4-af1e-4de0162bcdb8 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:25.233309 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-70f8bde4-cdcc-4bb4-af1e-4de0162bcdb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:25.243047 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 808/1634] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:25.243443 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87525da8-b725-45e2-8e83-676ecc5786dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:25.244317 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87525da8-b725-45e2-8e83-676ecc5786dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:25.244757 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87525da8-b725-45e2-8e83-676ecc5786dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:25.245085 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87525da8-b725-45e2-8e83-676ecc5786dc admin admin] PATH_INFO: `/v3/projects/f3d475a1e2c04c92b2b62aad9aa6930f` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:25.246734 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87525da8-b725-45e2-8e83-676ecc5786dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3d475a1e2c04c92b2b62aad9aa6930f)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:25.247848 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f8bde4-cdcc-4bb4-af1e-4de0162bcdb8 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:25.248907 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87525da8-b725-45e2-8e83-676ecc5786dc admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:25.262125 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f8bde4-cdcc-4bb4-af1e-4de0162bcdb8 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:25.267877 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d65d6-b975-4bcb-8f99-7b728436f16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:25.268513 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d65d6-b975-4bcb-8f99-7b728436f16c admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:25.268959 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d65d6-b975-4bcb-8f99-7b728436f16c admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:25.269246 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d65d6-b975-4bcb-8f99-7b728436f16c admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:25.270359 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d65d6-b975-4bcb-8f99-7b728436f16c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:25:25.270672 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d65d6-b975-4bcb-8f99-7b728436f16c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:25.272318 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d65d6-b975-4bcb-8f99-7b728436f16c admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:25.291482 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 809/1635] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:25:25.292987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d65d6-b975-4bcb-8f99-7b728436f16c admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:25.305173 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d65d6-b975-4bcb-8f99-7b728436f16c admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:25.310644 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233d503-d060-4b47-8342-02494e301427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:25.311640 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233d503-d060-4b47-8342-02494e301427 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:25.311956 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233d503-d060-4b47-8342-02494e301427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:25.312761 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233d503-d060-4b47-8342-02494e301427 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:25.313653 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233d503-d060-4b47-8342-02494e301427 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:25.315560 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233d503-d060-4b47-8342-02494e301427 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:25.342491 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-87525da8-b725-45e2-8e83-676ecc5786dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3d475a1e2c04c92b2b62aad9aa6930f', 'request_id': 'req-87525da8-b725-45e2-8e83-676ecc5786dc'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:25.351693 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-87525da8-b725-45e2-8e83-676ecc5786dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3d475a1e2c04c92b2b62aad9aa6930f', 'request_id': 'req-87525da8-b725-45e2-8e83-676ecc5786dc'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:25.353674 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 810/1636] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:25:25 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:25:25.358390 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233d503-d060-4b47-8342-02494e301427 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:25.360694 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-87525da8-b725-45e2-8e83-676ecc5786dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3d475a1e2c04c92b2b62aad9aa6930f', 'request_id': 'req-87525da8-b725-45e2-8e83-676ecc5786dc'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:25.377753 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-87525da8-b725-45e2-8e83-676ecc5786dc admin admin] The token cache is being invalidate because project f3d475a1e2c04c92b2b62aad9aa6930f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:25:25.378200 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-87525da8-b725-45e2-8e83-676ecc5786dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:25.379929 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-87525da8-b725-45e2-8e83-676ecc5786dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:25.386427 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 827/1637] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:25:25 2022] DELETE /identity/v3/projects/f3d475a1e2c04c92b2b62aad9aa6930f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:25.388463 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87525da8-b725-45e2-8e83-676ecc5786dc admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:25.391314 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-87525da8-b725-45e2-8e83-676ecc5786dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:25.405237 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:25.453972 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233d503-d060-4b47-8342-02494e301427 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:25.458913 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0327aca-c2a1-4b6a-b6ca-0a512fbd39cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:25.459600 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0327aca-c2a1-4b6a-b6ca-0a512fbd39cc admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:25.459911 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0327aca-c2a1-4b6a-b6ca-0a512fbd39cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:25.460196 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0327aca-c2a1-4b6a-b6ca-0a512fbd39cc admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:25.460822 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0327aca-c2a1-4b6a-b6ca-0a512fbd39cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:25.462744 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0327aca-c2a1-4b6a-b6ca-0a512fbd39cc admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:25.490027 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87525da8-b725-45e2-8e83-676ecc5786dc admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:25.492372 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 811/1638] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:25:25 2022] POST /identity/v3/users => generated 292 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:25:25.496515 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40a5df-92ec-404c-ab4a-234c408887ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:25.497240 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0327aca-c2a1-4b6a-b6ca-0a512fbd39cc admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:25.497797 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40a5df-92ec-404c-ab4a-234c408887ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:25.499129 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-f0327aca-c2a1-4b6a-b6ca-0a512fbd39cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:25.502842 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40a5df-92ec-404c-ab4a-234c408887ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:25.502842 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40a5df-92ec-404c-ab4a-234c408887ab admin admin] PATH_INFO: `/v3/users/7f4ef1bc182049b8920c4c559a3324ef` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:25.504226 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40a5df-92ec-404c-ab4a-234c408887ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f4ef1bc182049b8920c4c559a3324ef)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:25.507274 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40a5df-92ec-404c-ab4a-234c408887ab admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:25.520524 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0327aca-c2a1-4b6a-b6ca-0a512fbd39cc admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:25.526928 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a46f9-eb45-4164-bc70-c50680b7c8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:25.530011 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a46f9-eb45-4164-bc70-c50680b7c8b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:25.530549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a46f9-eb45-4164-bc70-c50680b7c8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:25.531467 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a46f9-eb45-4164-bc70-c50680b7c8b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:25.533828 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a46f9-eb45-4164-bc70-c50680b7c8b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:25.540308 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a46f9-eb45-4164-bc70-c50680b7c8b7 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:25.556521 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 812/1639] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:25:25.560991 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a46f9-eb45-4164-bc70-c50680b7c8b7 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:25.574722 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a46f9-eb45-4164-bc70-c50680b7c8b7 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:25.579722 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4d40a5df-92ec-404c-ab4a-234c408887ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f4ef1bc182049b8920c4c559a3324ef'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:25.580260 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4d40a5df-92ec-404c-ab4a-234c408887ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f4ef1bc182049b8920c4c559a3324ef'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:25.580355 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0566670-9a73-4a19-99fb-ee2b00965eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:25.580916 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0566670-9a73-4a19-99fb-ee2b00965eed admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:25.581192 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0566670-9a73-4a19-99fb-ee2b00965eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:25.581478 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0566670-9a73-4a19-99fb-ee2b00965eed admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:25.582303 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0566670-9a73-4a19-99fb-ee2b00965eed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:25.585058 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0566670-9a73-4a19-99fb-ee2b00965eed admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:25.601055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4d40a5df-92ec-404c-ab4a-234c408887ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f4ef1bc182049b8920c4c559a3324ef'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:25.603178 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 813/1640] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:25.607680 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0566670-9a73-4a19-99fb-ee2b00965eed admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:25.619359 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0566670-9a73-4a19-99fb-ee2b00965eed admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:25.623025 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4d40a5df-92ec-404c-ab4a-234c408887ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f4ef1bc182049b8920c4c559a3324ef'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:25.625466 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c077c-1840-4b8a-b979-371d245c10c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:25.626257 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c077c-1840-4b8a-b979-371d245c10c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:25.626641 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c077c-1840-4b8a-b979-371d245c10c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:25.627051 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c077c-1840-4b8a-b979-371d245c10c1 admin admin] PATH_INFO: `/v3/projects/256264ed8edc48eb97373ab334cb8be8/users/cde15273045b49958de46b9ae9b8ddf8/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:25.629361 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:25.641565 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4d40a5df-92ec-404c-ab4a-234c408887ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f4ef1bc182049b8920c4c559a3324ef'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:25.646609 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c077c-1840-4b8a-b979-371d245c10c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=256264ed8edc48eb97373ab334cb8be8, user_id=cde15273045b49958de46b9ae9b8ddf8, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:25.649538 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c077c-1840-4b8a-b979-371d245c10c1 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:25.650933 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 828/1641] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:25:25 2022] DELETE /identity/v3/users/7f4ef1bc182049b8920c4c559a3324ef => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:25.682918 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 814/1642] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:25:25 2022] PUT /identity/v3/projects/256264ed8edc48eb97373ab334cb8be8/users/cde15273045b49958de46b9ae9b8ddf8/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:25:25.694626 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5772f-7ee7-4bb9-8d44-aa61735624cd None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:25.694949 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5772f-7ee7-4bb9-8d44-aa61735624cd None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:25.695820 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5772f-7ee7-4bb9-8d44-aa61735624cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:25.732519 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e2e5772f-7ee7-4bb9-8d44-aa61735624cd None None] MFA Rules not processed for user `cde15273045b49958de46b9ae9b8ddf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:25.736889 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e2e5772f-7ee7-4bb9-8d44-aa61735624cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:25.860322 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c077c-1840-4b8a-b979-371d245c10c1 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:25.862273 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 829/1643] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:25.863060 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c29c077c-1840-4b8a-b979-371d245c10c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:25.996671 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c077c-1840-4b8a-b979-371d245c10c1 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:26.019873 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d2753-8308-4e65-96b1-88f7e08e8e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:26.020718 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d2753-8308-4e65-96b1-88f7e08e8e02 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:26.021148 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d2753-8308-4e65-96b1-88f7e08e8e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:26.021598 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d2753-8308-4e65-96b1-88f7e08e8e02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:26.022599 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993d2753-8308-4e65-96b1-88f7e08e8e02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:26.024888 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993d2753-8308-4e65-96b1-88f7e08e8e02 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:26.057479 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 815/1644] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:25:25 2022] POST /identity/v3/projects => generated 385 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:25:26.061661 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5772f-7ee7-4bb9-8d44-aa61735624cd None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:26.075366 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5772f-7ee7-4bb9-8d44-aa61735624cd None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:26.116091 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d2753-8308-4e65-96b1-88f7e08e8e02 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:26.119097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-993d2753-8308-4e65-96b1-88f7e08e8e02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:26.151173 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f69280-5ca3-48a0-8bbe-1a7a7a452745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:26.151788 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f69280-5ca3-48a0-8bbe-1a7a7a452745 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:26.152685 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f69280-5ca3-48a0-8bbe-1a7a7a452745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:26.152685 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f69280-5ca3-48a0-8bbe-1a7a7a452745 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:26.153000 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f69280-5ca3-48a0-8bbe-1a7a7a452745 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:26.157233 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f69280-5ca3-48a0-8bbe-1a7a7a452745 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:26.213995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 830/1645] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:25:26 2022] POST /identity/v3/users => generated 299 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:25:26.220814 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f69280-5ca3-48a0-8bbe-1a7a7a452745 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:26.232269 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f69280-5ca3-48a0-8bbe-1a7a7a452745 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:26.238093 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b377d-841f-4ba0-886b-99695b2f4a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:26.238710 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b377d-841f-4ba0-886b-99695b2f4a2f admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:26.239039 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b377d-841f-4ba0-886b-99695b2f4a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:26.239316 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b377d-841f-4ba0-886b-99695b2f4a2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:26.240059 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b377d-841f-4ba0-886b-99695b2f4a2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:26.241670 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b377d-841f-4ba0-886b-99695b2f4a2f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:26.242452 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d2753-8308-4e65-96b1-88f7e08e8e02 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:26.248265 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc566a-730b-48ba-bf70-6ad1f7e71f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:26.248903 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc566a-730b-48ba-bf70-6ad1f7e71f11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:26.249187 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc566a-730b-48ba-bf70-6ad1f7e71f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:26.249462 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc566a-730b-48ba-bf70-6ad1f7e71f11 admin admin] PATH_INFO: `/v3/projects/d750fe86fbfd4958a047ba0e3a23b4c0` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:26.252581 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc566a-730b-48ba-bf70-6ad1f7e71f11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d750fe86fbfd4958a047ba0e3a23b4c0)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:26.253806 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 831/1646] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:25:26.254508 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc566a-730b-48ba-bf70-6ad1f7e71f11 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:26.258098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:26.258230 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b377d-841f-4ba0-886b-99695b2f4a2f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:26.269965 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b377d-841f-4ba0-886b-99695b2f4a2f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:26.274737 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a099018-cca5-45de-af0b-0b620a2742a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:26.275394 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a099018-cca5-45de-af0b-0b620a2742a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:26.275733 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a099018-cca5-45de-af0b-0b620a2742a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:26.275974 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a099018-cca5-45de-af0b-0b620a2742a3 admin admin] PATH_INFO: `/v3/projects/e4961c38c3ad42d5a9d13edde5c2959c/users/14049bb2652e49d5b3abaa984f3f3655/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:26.294603 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a099018-cca5-45de-af0b-0b620a2742a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4961c38c3ad42d5a9d13edde5c2959c, user_id=14049bb2652e49d5b3abaa984f3f3655, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:26.298223 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a099018-cca5-45de-af0b-0b620a2742a3 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:26.312634 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 832/1647] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:25:26 2022] PUT /identity/v3/projects/e4961c38c3ad42d5a9d13edde5c2959c/users/14049bb2652e49d5b3abaa984f3f3655/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:25:26.316616 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a099018-cca5-45de-af0b-0b620a2742a3 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:26.318795 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-13bc566a-730b-48ba-bf70-6ad1f7e71f11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd750fe86fbfd4958a047ba0e3a23b4c0', 'request_id': 'req-13bc566a-730b-48ba-bf70-6ad1f7e71f11'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:26.325963 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-13bc566a-730b-48ba-bf70-6ad1f7e71f11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd750fe86fbfd4958a047ba0e3a23b4c0', 'request_id': 'req-13bc566a-730b-48ba-bf70-6ad1f7e71f11'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:26.336497 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-13bc566a-730b-48ba-bf70-6ad1f7e71f11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd750fe86fbfd4958a047ba0e3a23b4c0', 'request_id': 'req-13bc566a-730b-48ba-bf70-6ad1f7e71f11'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:26.349474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-13bc566a-730b-48ba-bf70-6ad1f7e71f11 admin admin] The token cache is being invalidate because project d750fe86fbfd4958a047ba0e3a23b4c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:25:26.349685 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-13bc566a-730b-48ba-bf70-6ad1f7e71f11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:26.350767 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-13bc566a-730b-48ba-bf70-6ad1f7e71f11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:26.352351 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 816/1648] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:25:26 2022] DELETE /identity/v3/projects/d750fe86fbfd4958a047ba0e3a23b4c0 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:26.357011 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a71fc-0679-4994-a0a4-c899edadb8a2 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:26.357285 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a71fc-0679-4994-a0a4-c899edadb8a2 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:26.357565 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a71fc-0679-4994-a0a4-c899edadb8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:26.360521 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:26.384143 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-948a71fc-0679-4994-a0a4-c899edadb8a2 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:26.385730 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-948a71fc-0679-4994-a0a4-c899edadb8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:26.392012 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a099018-cca5-45de-af0b-0b620a2742a3 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:26.397208 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5795549-9ef5-4d86-89a6-062e2b597d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:26.398222 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5795549-9ef5-4d86-89a6-062e2b597d78 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:26.398222 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5795549-9ef5-4d86-89a6-062e2b597d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:26.398402 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5795549-9ef5-4d86-89a6-062e2b597d78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:26.398489 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 817/1649] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:26.399056 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5795549-9ef5-4d86-89a6-062e2b597d78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:26.400686 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5795549-9ef5-4d86-89a6-062e2b597d78 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:26.405903 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07acec-134a-4fdb-9e1d-988a7ec791d1 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:26.406191 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07acec-134a-4fdb-9e1d-988a7ec791d1 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:26.406468 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07acec-134a-4fdb-9e1d-988a7ec791d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:26.415698 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 833/1650] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:25:26.418240 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5795549-9ef5-4d86-89a6-062e2b597d78 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:26.420014 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f5795549-9ef5-4d86-89a6-062e2b597d78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:26.430323 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-ce07acec-134a-4fdb-9e1d-988a7ec791d1 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:26.432259 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ce07acec-134a-4fdb-9e1d-988a7ec791d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:26.434740 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5795549-9ef5-4d86-89a6-062e2b597d78 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:26.441887 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5734bd3-71c5-4cae-a96c-3555f83c3a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:26.442566 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5734bd3-71c5-4cae-a96c-3555f83c3a62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:26.442842 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5734bd3-71c5-4cae-a96c-3555f83c3a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:26.443177 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5734bd3-71c5-4cae-a96c-3555f83c3a62 admin admin] PATH_INFO: `/v3/projects/e4961c38c3ad42d5a9d13edde5c2959c/users/14049bb2652e49d5b3abaa984f3f3655/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:26.445358 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5734bd3-71c5-4cae-a96c-3555f83c3a62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4961c38c3ad42d5a9d13edde5c2959c, user_id=14049bb2652e49d5b3abaa984f3f3655, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:26.448577 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5734bd3-71c5-4cae-a96c-3555f83c3a62 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:26.448970 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 818/1651] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:26.450033 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07acec-134a-4fdb-9e1d-988a7ec791d1 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:26.462195 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07acec-134a-4fdb-9e1d-988a7ec791d1 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:26.464086 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 834/1652] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:25:26 2022] PUT /identity/v3/projects/e4961c38c3ad42d5a9d13edde5c2959c/users/14049bb2652e49d5b3abaa984f3f3655/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:26.477101 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb90d7a-390f-47ba-8bea-6b7a488956a9 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:26.477499 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb90d7a-390f-47ba-8bea-6b7a488956a9 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:26.478115 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb90d7a-390f-47ba-8bea-6b7a488956a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:26.523453 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-0eb90d7a-390f-47ba-8bea-6b7a488956a9 None None] MFA Rules not processed for user `14049bb2652e49d5b3abaa984f3f3655`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:26.525616 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0eb90d7a-390f-47ba-8bea-6b7a488956a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:26.594571 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318777a-d148-4897-a9a7-9543ed99f508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:26.595438 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318777a-d148-4897-a9a7-9543ed99f508 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:26.595724 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318777a-d148-4897-a9a7-9543ed99f508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:26.596161 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318777a-d148-4897-a9a7-9543ed99f508 admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:26.596819 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318777a-d148-4897-a9a7-9543ed99f508 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:25:26.597123 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318777a-d148-4897-a9a7-9543ed99f508 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:26.598984 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318777a-d148-4897-a9a7-9543ed99f508 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:26.613089 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 819/1653] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:25:26.617353 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318777a-d148-4897-a9a7-9543ed99f508 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:26.631471 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318777a-d148-4897-a9a7-9543ed99f508 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:26.643821 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 835/1654] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:26 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:26.644468 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc371b-a85d-4ab3-ae72-24c3ed4b7b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:26.645651 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc371b-a85d-4ab3-ae72-24c3ed4b7b9c admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:26.646005 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc371b-a85d-4ab3-ae72-24c3ed4b7b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:26.646356 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc371b-a85d-4ab3-ae72-24c3ed4b7b9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:26.647774 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcc371b-a85d-4ab3-ae72-24c3ed4b7b9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:26.648960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb90d7a-390f-47ba-8bea-6b7a488956a9 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:26.650940 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0eb90d7a-390f-47ba-8bea-6b7a488956a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:26.652482 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcc371b-a85d-4ab3-ae72-24c3ed4b7b9c admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:26.706635 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 820/1655] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:25:26 2022] POST /identity/v3/projects => generated 375 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:25:26.710349 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc371b-a85d-4ab3-ae72-24c3ed4b7b9c admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:26.744808 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb90d7a-390f-47ba-8bea-6b7a488956a9 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:26.829766 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:26.849435 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc371b-a85d-4ab3-ae72-24c3ed4b7b9c admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:26.856187 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362430f0-971c-4c57-b9de-93e5cbd26bc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:26.857966 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362430f0-971c-4c57-b9de-93e5cbd26bc6 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:26.858505 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362430f0-971c-4c57-b9de-93e5cbd26bc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:26.858787 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362430f0-971c-4c57-b9de-93e5cbd26bc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:26.866793 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc931110-4c81-45dc-ba97-84c48aec597c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:26.867637 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc931110-4c81-45dc-ba97-84c48aec597c admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:26.867976 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc931110-4c81-45dc-ba97-84c48aec597c admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:26.868331 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc931110-4c81-45dc-ba97-84c48aec597c admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:26.870988 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc931110-4c81-45dc-ba97-84c48aec597c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:26.871396 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc931110-4c81-45dc-ba97-84c48aec597c admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:26.874042 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-362430f0-971c-4c57-b9de-93e5cbd26bc6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:26.897313 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:26.921703 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 821/1656] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:25:26 2022] POST /identity/v3/users => generated 288 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:25:26.926604 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc931110-4c81-45dc-ba97-84c48aec597c admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:26.939076 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc931110-4c81-45dc-ba97-84c48aec597c admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:26.946161 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7458503-6570-48c0-9efc-5bac200f5bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:26.946886 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7458503-6570-48c0-9efc-5bac200f5bcd admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:26.947267 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7458503-6570-48c0-9efc-5bac200f5bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:26.947611 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7458503-6570-48c0-9efc-5bac200f5bcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:26.948456 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7458503-6570-48c0-9efc-5bac200f5bcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:26.950192 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7458503-6570-48c0-9efc-5bac200f5bcd admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:26.962481 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 822/1657] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:25:26.967121 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7458503-6570-48c0-9efc-5bac200f5bcd admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:26.979283 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7458503-6570-48c0-9efc-5bac200f5bcd admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:26.987218 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e478306-804b-4916-bfbc-489b9fac9831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:26.988321 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e478306-804b-4916-bfbc-489b9fac9831 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:26.988321 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e478306-804b-4916-bfbc-489b9fac9831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:26.988513 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e478306-804b-4916-bfbc-489b9fac9831 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:26.989317 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e478306-804b-4916-bfbc-489b9fac9831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:26.991194 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e478306-804b-4916-bfbc-489b9fac9831 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:27.002995 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 823/1658] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:25:27.004552 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362430f0-971c-4c57-b9de-93e5cbd26bc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:27.006514 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362430f0-971c-4c57-b9de-93e5cbd26bc6 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:27.007308 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e478306-804b-4916-bfbc-489b9fac9831 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:27.020342 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 836/1659] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:25:27.035410 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e478306-804b-4916-bfbc-489b9fac9831 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:27.044357 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e747a-40f1-4c56-9675-e90b5797f942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:27.045449 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e747a-40f1-4c56-9675-e90b5797f942 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:27.047039 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e747a-40f1-4c56-9675-e90b5797f942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:27.047654 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e747a-40f1-4c56-9675-e90b5797f942 admin admin] PATH_INFO: `/v3/projects/7724432fbf984ee6a481ddc45149dbfa/users/e70ac72014374ee2ac2d527d5a3fa5d2/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:27.066756 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e747a-40f1-4c56-9675-e90b5797f942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7724432fbf984ee6a481ddc45149dbfa, user_id=e70ac72014374ee2ac2d527d5a3fa5d2, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:27.069633 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e747a-40f1-4c56-9675-e90b5797f942 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:27.084066 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 824/1660] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:25:27 2022] PUT /identity/v3/projects/7724432fbf984ee6a481ddc45149dbfa/users/e70ac72014374ee2ac2d527d5a3fa5d2/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:27.096707 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c0d29-766a-4731-8f5c-cee4ac2031d6 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:27.097207 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c0d29-766a-4731-8f5c-cee4ac2031d6 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:27.097693 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c0d29-766a-4731-8f5c-cee4ac2031d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:27.132558 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c47c0d29-766a-4731-8f5c-cee4ac2031d6 None None] MFA Rules not processed for user `e70ac72014374ee2ac2d527d5a3fa5d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:27.134055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c47c0d29-766a-4731-8f5c-cee4ac2031d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:27.206905 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 837/1661] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:27.211373 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e747a-40f1-4c56-9675-e90b5797f942 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:27.280999 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e747a-40f1-4c56-9675-e90b5797f942 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:27.286330 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078d5aa-438e-476a-bb50-75cd973f62c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:27.287074 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078d5aa-438e-476a-bb50-75cd973f62c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:27.287448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078d5aa-438e-476a-bb50-75cd973f62c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:27.287621 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078d5aa-438e-476a-bb50-75cd973f62c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:27.288379 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f078d5aa-438e-476a-bb50-75cd973f62c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:27.290278 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f078d5aa-438e-476a-bb50-75cd973f62c4 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:27.322695 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 825/1662] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:25:27 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:25:27.327005 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c0d29-766a-4731-8f5c-cee4ac2031d6 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:27.340494 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c0d29-766a-4731-8f5c-cee4ac2031d6 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:27.451555 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c8305-1762-47be-b735-bceeb538721c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:27.452343 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c8305-1762-47be-b735-bceeb538721c admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:27.453476 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c8305-1762-47be-b735-bceeb538721c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:27.453850 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c8305-1762-47be-b735-bceeb538721c admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:27.454649 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5c8305-1762-47be-b735-bceeb538721c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:27.456712 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5c8305-1762-47be-b735-bceeb538721c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:27.483310 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 838/1663] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:25:27 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:25:27.488029 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078d5aa-438e-476a-bb50-75cd973f62c4 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:27.499371 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078d5aa-438e-476a-bb50-75cd973f62c4 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:27.506478 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d65bb-d7ee-4d4a-8540-7fb546d90917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:27.507217 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d65bb-d7ee-4d4a-8540-7fb546d90917 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:27.515753 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d65bb-d7ee-4d4a-8540-7fb546d90917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:27.516682 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d65bb-d7ee-4d4a-8540-7fb546d90917 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:27.517443 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d65bb-d7ee-4d4a-8540-7fb546d90917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:27.519204 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d65bb-d7ee-4d4a-8540-7fb546d90917 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:27.530648 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 826/1664] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:27.536028 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c8305-1762-47be-b735-bceeb538721c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:27.549666 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c8305-1762-47be-b735-bceeb538721c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:27.557988 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc11455-0783-4d2c-8ae4-4610e6b3b4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:27.559298 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc11455-0783-4d2c-8ae4-4610e6b3b4a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:27.559584 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc11455-0783-4d2c-8ae4-4610e6b3b4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:27.559865 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc11455-0783-4d2c-8ae4-4610e6b3b4a4 admin admin] PATH_INFO: `/v3/projects/2c97bda0ec9d499f84c4ffaa46c48091/users/668f922e095a4d5b8aac84185af367f9/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:27.576074 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc11455-0783-4d2c-8ae4-4610e6b3b4a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c97bda0ec9d499f84c4ffaa46c48091, user_id=668f922e095a4d5b8aac84185af367f9, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:27.579097 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc11455-0783-4d2c-8ae4-4610e6b3b4a4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:27.594758 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 839/1665] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:25:27 2022] PUT /identity/v3/projects/2c97bda0ec9d499f84c4ffaa46c48091/users/668f922e095a4d5b8aac84185af367f9/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:27.598840 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d65bb-d7ee-4d4a-8540-7fb546d90917 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:27.608724 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d65bb-d7ee-4d4a-8540-7fb546d90917 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:27.668878 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b60f01-446a-4b25-9770-d015925336aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:27.669501 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b60f01-446a-4b25-9770-d015925336aa admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:27.669781 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b60f01-446a-4b25-9770-d015925336aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:27.670057 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b60f01-446a-4b25-9770-d015925336aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:27.670722 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b60f01-446a-4b25-9770-d015925336aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:27.673167 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b60f01-446a-4b25-9770-d015925336aa admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:27.683717 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 827/1666] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:27.687856 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc11455-0783-4d2c-8ae4-4610e6b3b4a4 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:27.699314 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc11455-0783-4d2c-8ae4-4610e6b3b4a4 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:27.704043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34957d72-c972-4854-bbb5-9cae440a04aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:27.704736 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34957d72-c972-4854-bbb5-9cae440a04aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:27.705017 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34957d72-c972-4854-bbb5-9cae440a04aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:27.705292 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34957d72-c972-4854-bbb5-9cae440a04aa admin admin] PATH_INFO: `/v3/projects/2c97bda0ec9d499f84c4ffaa46c48091/users/668f922e095a4d5b8aac84185af367f9/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:27.707329 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34957d72-c972-4854-bbb5-9cae440a04aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c97bda0ec9d499f84c4ffaa46c48091, user_id=668f922e095a4d5b8aac84185af367f9, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:27.709986 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34957d72-c972-4854-bbb5-9cae440a04aa admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:27.713507 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:27.732854 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 840/1667] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:25:27 2022] PUT /identity/v3/projects/2c97bda0ec9d499f84c4ffaa46c48091/users/668f922e095a4d5b8aac84185af367f9/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:25:27.744711 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3cca9d-32ce-492b-bb87-98251bc27991 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:27.745084 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3cca9d-32ce-492b-bb87-98251bc27991 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:27.745600 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3cca9d-32ce-492b-bb87-98251bc27991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:27.755043 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:27.783333 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-dc3cca9d-32ce-492b-bb87-98251bc27991 None None] MFA Rules not processed for user `668f922e095a4d5b8aac84185af367f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:27.784789 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-dc3cca9d-32ce-492b-bb87-98251bc27991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:27.883468 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 828/1668] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:27.895413 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34957d72-c972-4854-bbb5-9cae440a04aa admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:27.966728 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34957d72-c972-4854-bbb5-9cae440a04aa admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:27.971073 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d17448-8348-4545-87ed-c6401ac98985 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:27.971693 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d17448-8348-4545-87ed-c6401ac98985 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:27.972029 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d17448-8348-4545-87ed-c6401ac98985 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:27.976289 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d17448-8348-4545-87ed-c6401ac98985 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:28.054011 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d17448-8348-4545-87ed-c6401ac98985 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:28.054011 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d17448-8348-4545-87ed-c6401ac98985 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:28.064573 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 841/1669] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:25:28.127040 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3cca9d-32ce-492b-bb87-98251bc27991 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:28.128495 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-dc3cca9d-32ce-492b-bb87-98251bc27991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:28.142287 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3cca9d-32ce-492b-bb87-98251bc27991 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:28.145776 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f008b1-aca2-4205-8512-a9b9e2c30095 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:28.146387 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f008b1-aca2-4205-8512-a9b9e2c30095 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:28.146666 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f008b1-aca2-4205-8512-a9b9e2c30095 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:28.146947 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f008b1-aca2-4205-8512-a9b9e2c30095 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:28.148665 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-51f008b1-aca2-4205-8512-a9b9e2c30095 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:28.219489 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f008b1-aca2-4205-8512-a9b9e2c30095 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:28.221129 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f008b1-aca2-4205-8512-a9b9e2c30095 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:28.230884 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 829/1670] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:25:30.819283 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d17448-8348-4545-87ed-c6401ac98985 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:30.911368 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d17448-8348-4545-87ed-c6401ac98985 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:30.916726 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68237924-cb44-489e-b99a-41ec06601812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:30.917759 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68237924-cb44-489e-b99a-41ec06601812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:30.918046 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68237924-cb44-489e-b99a-41ec06601812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:30.918320 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68237924-cb44-489e-b99a-41ec06601812 admin admin] PATH_INFO: `/v3/users/e70ac72014374ee2ac2d527d5a3fa5d2` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:30.920640 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f008b1-aca2-4205-8512-a9b9e2c30095 service cinder] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:30.922831 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-51f008b1-aca2-4205-8512-a9b9e2c30095 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:30.924429 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68237924-cb44-489e-b99a-41ec06601812 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e70ac72014374ee2ac2d527d5a3fa5d2)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:30.926592 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68237924-cb44-489e-b99a-41ec06601812 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:30.937812 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f008b1-aca2-4205-8512-a9b9e2c30095 service cinder] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:30.943602 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9d11f-a836-4974-a9be-b3cc75d6cde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:30.944584 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9d11f-a836-4974-a9be-b3cc75d6cde3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:30.945094 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9d11f-a836-4974-a9be-b3cc75d6cde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:30.945598 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9d11f-a836-4974-a9be-b3cc75d6cde3 admin admin] PATH_INFO: `/v3/users/215483574ac446a0b2b7afcea442c875` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:30.946930 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9d11f-a836-4974-a9be-b3cc75d6cde3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=215483574ac446a0b2b7afcea442c875)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:30.949768 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9d11f-a836-4974-a9be-b3cc75d6cde3 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:31.007108 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-68237924-cb44-489e-b99a-41ec06601812 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e70ac72014374ee2ac2d527d5a3fa5d2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:31.007799 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-68237924-cb44-489e-b99a-41ec06601812 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e70ac72014374ee2ac2d527d5a3fa5d2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:31.013668 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:31.014347 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-22a9d11f-a836-4974-a9be-b3cc75d6cde3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '215483574ac446a0b2b7afcea442c875'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:31.027036 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-68237924-cb44-489e-b99a-41ec06601812 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e70ac72014374ee2ac2d527d5a3fa5d2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:31.035550 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-22a9d11f-a836-4974-a9be-b3cc75d6cde3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '215483574ac446a0b2b7afcea442c875'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:31.036707 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-22a9d11f-a836-4974-a9be-b3cc75d6cde3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '215483574ac446a0b2b7afcea442c875'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:31.037675 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-68237924-cb44-489e-b99a-41ec06601812 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e70ac72014374ee2ac2d527d5a3fa5d2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:31.050236 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-68237924-cb44-489e-b99a-41ec06601812 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e70ac72014374ee2ac2d527d5a3fa5d2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:31.054901 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-22a9d11f-a836-4974-a9be-b3cc75d6cde3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '215483574ac446a0b2b7afcea442c875'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:31.056283 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-22a9d11f-a836-4974-a9be-b3cc75d6cde3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '215483574ac446a0b2b7afcea442c875'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:31.061103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 842/1671] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:25:30 2022] DELETE /identity/v3/users/e70ac72014374ee2ac2d527d5a3fa5d2 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:31.064969 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d0b49-305c-4ef9-9f46-c6d3208b1cda None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:31.065432 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d0b49-305c-4ef9-9f46-c6d3208b1cda None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:31.065807 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d0b49-305c-4ef9-9f46-c6d3208b1cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:31.074767 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 830/1672] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:25:30 2022] DELETE /identity/v3/users/215483574ac446a0b2b7afcea442c875 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:25:31.076827 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:31.079953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42da57-2d9b-4047-9d26-64d61db7fec6 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:31.080514 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42da57-2d9b-4047-9d26-64d61db7fec6 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:31.081014 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42da57-2d9b-4047-9d26-64d61db7fec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:31.097545 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-3a1d0b49-305c-4ef9-9f46-c6d3208b1cda None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:31.098997 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3a1d0b49-305c-4ef9-9f46-c6d3208b1cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:31.105174 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-7d42da57-2d9b-4047-9d26-64d61db7fec6 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:31.106851 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-7d42da57-2d9b-4047-9d26-64d61db7fec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:31.184466 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 843/1673] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:31.192804 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 831/1674] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:31.193867 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d0b49-305c-4ef9-9f46-c6d3208b1cda None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:31.195241 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3a1d0b49-305c-4ef9-9f46-c6d3208b1cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:31.206581 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42da57-2d9b-4047-9d26-64d61db7fec6 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:31.208086 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-7d42da57-2d9b-4047-9d26-64d61db7fec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:31.275480 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d0b49-305c-4ef9-9f46-c6d3208b1cda None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:31.280212 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8cb2ae-831f-4f1a-b0f1-2dc21d0dc074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:31.280949 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8cb2ae-831f-4f1a-b0f1-2dc21d0dc074 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:31.281822 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42da57-2d9b-4047-9d26-64d61db7fec6 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:31.282181 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8cb2ae-831f-4f1a-b0f1-2dc21d0dc074 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:31.282610 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8cb2ae-831f-4f1a-b0f1-2dc21d0dc074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:31.286428 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351eff5-9985-436a-a9a8-835f1b901325 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:31.287261 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351eff5-9985-436a-a9a8-835f1b901325 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:31.287691 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351eff5-9985-436a-a9a8-835f1b901325 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:31.288142 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351eff5-9985-436a-a9a8-835f1b901325 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:31.294276 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8cb2ae-831f-4f1a-b0f1-2dc21d0dc074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:31.296092 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8cb2ae-831f-4f1a-b0f1-2dc21d0dc074 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:31.299773 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6351eff5-9985-436a-a9a8-835f1b901325 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:31.301757 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6351eff5-9985-436a-a9a8-835f1b901325 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:31.308104 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 844/1675] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 13:25:31.313612 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 832/1676] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:25:31.739769 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8cb2ae-831f-4f1a-b0f1-2dc21d0dc074 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:31.744875 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cf8cb2ae-831f-4f1a-b0f1-2dc21d0dc074 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:31.829099 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8cb2ae-831f-4f1a-b0f1-2dc21d0dc074 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:31.835327 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec732caf-71fc-40eb-befe-ba9a9299c676 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:31.836491 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec732caf-71fc-40eb-befe-ba9a9299c676 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:31.836836 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec732caf-71fc-40eb-befe-ba9a9299c676 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:31.837177 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec732caf-71fc-40eb-befe-ba9a9299c676 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:31.840570 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ec732caf-71fc-40eb-befe-ba9a9299c676 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:31.938618 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:32.034626 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec732caf-71fc-40eb-befe-ba9a9299c676 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:32.036709 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec732caf-71fc-40eb-befe-ba9a9299c676 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:32.048363 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351eff5-9985-436a-a9a8-835f1b901325 service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:32.050068 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-6351eff5-9985-436a-a9a8-835f1b901325 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:32.054091 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 845/1677] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:31 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:25:32.076252 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351eff5-9985-436a-a9a8-835f1b901325 service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:32.088082 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11570d-edcf-4251-aff0-e6d0d8af7802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:32.089052 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11570d-edcf-4251-aff0-e6d0d8af7802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:32.089723 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11570d-edcf-4251-aff0-e6d0d8af7802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:32.090481 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11570d-edcf-4251-aff0-e6d0d8af7802 admin admin] PATH_INFO: `/v3/projects/7724432fbf984ee6a481ddc45149dbfa` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:32.093146 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11570d-edcf-4251-aff0-e6d0d8af7802 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7724432fbf984ee6a481ddc45149dbfa)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:32.096583 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11570d-edcf-4251-aff0-e6d0d8af7802 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:32.207296 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ab11570d-edcf-4251-aff0-e6d0d8af7802 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7724432fbf984ee6a481ddc45149dbfa', 'request_id': 'req-ab11570d-edcf-4251-aff0-e6d0d8af7802'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:32.235946 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ab11570d-edcf-4251-aff0-e6d0d8af7802 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7724432fbf984ee6a481ddc45149dbfa', 'request_id': 'req-ab11570d-edcf-4251-aff0-e6d0d8af7802'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:32.251067 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ab11570d-edcf-4251-aff0-e6d0d8af7802 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7724432fbf984ee6a481ddc45149dbfa', 'request_id': 'req-ab11570d-edcf-4251-aff0-e6d0d8af7802'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:32.271507 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec732caf-71fc-40eb-befe-ba9a9299c676 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:32.271840 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ab11570d-edcf-4251-aff0-e6d0d8af7802 admin admin] The token cache is being invalidate because project 7724432fbf984ee6a481ddc45149dbfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:25:32.272369 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ab11570d-edcf-4251-aff0-e6d0d8af7802 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:32.273185 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ec732caf-71fc-40eb-befe-ba9a9299c676 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:32.274368 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ab11570d-edcf-4251-aff0-e6d0d8af7802 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:32.279689 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 833/1678] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:25:32 2022] DELETE /identity/v3/projects/7724432fbf984ee6a481ddc45149dbfa => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:25:32.285201 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11570d-edcf-4251-aff0-e6d0d8af7802 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:32.287354 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ab11570d-edcf-4251-aff0-e6d0d8af7802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:32.310871 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec732caf-71fc-40eb-befe-ba9a9299c676 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:32.337098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:32.411950 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11570d-edcf-4251-aff0-e6d0d8af7802 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:32.419806 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3703963-da85-47d0-81fc-724e2a2c00e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:32.420619 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3703963-da85-47d0-81fc-724e2a2c00e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:32.420904 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3703963-da85-47d0-81fc-724e2a2c00e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:32.421181 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3703963-da85-47d0-81fc-724e2a2c00e9 admin admin] PATH_INFO: `/v3/users/668f922e095a4d5b8aac84185af367f9` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:32.422463 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3703963-da85-47d0-81fc-724e2a2c00e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=668f922e095a4d5b8aac84185af367f9)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:32.434582 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3703963-da85-47d0-81fc-724e2a2c00e9 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:32.492276 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49973c0-04be-48f6-99ca-f19be97d6396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:32.494438 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49973c0-04be-48f6-99ca-f19be97d6396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:32.496156 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49973c0-04be-48f6-99ca-f19be97d6396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:32.496475 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49973c0-04be-48f6-99ca-f19be97d6396 admin admin] PATH_INFO: `/v3/projects/c56ed2604dad4ce1a827a3ce1c0170ea` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:32.500689 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49973c0-04be-48f6-99ca-f19be97d6396 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c56ed2604dad4ce1a827a3ce1c0170ea)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:32.506294 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49973c0-04be-48f6-99ca-f19be97d6396 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:32.537616 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c3703963-da85-47d0-81fc-724e2a2c00e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '668f922e095a4d5b8aac84185af367f9'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:32.555280 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c3703963-da85-47d0-81fc-724e2a2c00e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '668f922e095a4d5b8aac84185af367f9'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:32.556122 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c3703963-da85-47d0-81fc-724e2a2c00e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '668f922e095a4d5b8aac84185af367f9'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:32.565993 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c3703963-da85-47d0-81fc-724e2a2c00e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '668f922e095a4d5b8aac84185af367f9'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:32.566788 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c3703963-da85-47d0-81fc-724e2a2c00e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '668f922e095a4d5b8aac84185af367f9'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:32.595586 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 834/1679] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:25:32 2022] DELETE /identity/v3/users/668f922e095a4d5b8aac84185af367f9 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:32.606504 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e49973c0-04be-48f6-99ca-f19be97d6396 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c56ed2604dad4ce1a827a3ce1c0170ea', 'request_id': 'req-e49973c0-04be-48f6-99ca-f19be97d6396'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:32.616987 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e49973c0-04be-48f6-99ca-f19be97d6396 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c56ed2604dad4ce1a827a3ce1c0170ea', 'request_id': 'req-e49973c0-04be-48f6-99ca-f19be97d6396'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:32.624472 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e49973c0-04be-48f6-99ca-f19be97d6396 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c56ed2604dad4ce1a827a3ce1c0170ea', 'request_id': 'req-e49973c0-04be-48f6-99ca-f19be97d6396'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:32.669388 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e49973c0-04be-48f6-99ca-f19be97d6396 admin admin] The token cache is being invalidate because project c56ed2604dad4ce1a827a3ce1c0170ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:25:32.672681 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e49973c0-04be-48f6-99ca-f19be97d6396 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:32.674152 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e49973c0-04be-48f6-99ca-f19be97d6396 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:32.679356 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 846/1680] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:25:32 2022] DELETE /identity/v3/projects/c56ed2604dad4ce1a827a3ce1c0170ea => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:25:32.683626 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3703963-da85-47d0-81fc-724e2a2c00e9 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:32.685558 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c3703963-da85-47d0-81fc-724e2a2c00e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:32.843544 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3703963-da85-47d0-81fc-724e2a2c00e9 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:32.849594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b062d4d-7c0f-4cd1-aa52-124bd0fa2493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:32.850318 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b062d4d-7c0f-4cd1-aa52-124bd0fa2493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:32.850714 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b062d4d-7c0f-4cd1-aa52-124bd0fa2493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:32.851059 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b062d4d-7c0f-4cd1-aa52-124bd0fa2493 admin admin] PATH_INFO: `/v3/users/df7cc142c3514311978e3ff5530cb4b1` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:32.852552 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b062d4d-7c0f-4cd1-aa52-124bd0fa2493 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df7cc142c3514311978e3ff5530cb4b1)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:32.854735 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b062d4d-7c0f-4cd1-aa52-124bd0fa2493 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:32.927708 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-9b062d4d-7c0f-4cd1-aa52-124bd0fa2493 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df7cc142c3514311978e3ff5530cb4b1'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:32.931383 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:32.958659 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-9b062d4d-7c0f-4cd1-aa52-124bd0fa2493 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df7cc142c3514311978e3ff5530cb4b1'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:32.960192 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-9b062d4d-7c0f-4cd1-aa52-124bd0fa2493 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df7cc142c3514311978e3ff5530cb4b1'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:32.969816 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-9b062d4d-7c0f-4cd1-aa52-124bd0fa2493 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df7cc142c3514311978e3ff5530cb4b1'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:32.970488 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-9b062d4d-7c0f-4cd1-aa52-124bd0fa2493 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df7cc142c3514311978e3ff5530cb4b1'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:32.988197 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 835/1681] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:25:32 2022] DELETE /identity/v3/users/df7cc142c3514311978e3ff5530cb4b1 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:33.124056 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49973c0-04be-48f6-99ca-f19be97d6396 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:33.126735 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e49973c0-04be-48f6-99ca-f19be97d6396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:33.192791 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:33.206833 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49973c0-04be-48f6-99ca-f19be97d6396 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:33.272142 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a440a-96d7-407b-8ae3-71acf1e6d10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:33.272728 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a440a-96d7-407b-8ae3-71acf1e6d10c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:33.273013 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a440a-96d7-407b-8ae3-71acf1e6d10c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:33.273293 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a440a-96d7-407b-8ae3-71acf1e6d10c admin admin] PATH_INFO: `/v3/projects/2c97bda0ec9d499f84c4ffaa46c48091` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:33.274880 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a440a-96d7-407b-8ae3-71acf1e6d10c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c97bda0ec9d499f84c4ffaa46c48091)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:33.276403 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a440a-96d7-407b-8ae3-71acf1e6d10c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:33.331019 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-624a440a-96d7-407b-8ae3-71acf1e6d10c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c97bda0ec9d499f84c4ffaa46c48091', 'request_id': 'req-624a440a-96d7-407b-8ae3-71acf1e6d10c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:33.341145 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-624a440a-96d7-407b-8ae3-71acf1e6d10c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c97bda0ec9d499f84c4ffaa46c48091', 'request_id': 'req-624a440a-96d7-407b-8ae3-71acf1e6d10c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:33.348849 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-624a440a-96d7-407b-8ae3-71acf1e6d10c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c97bda0ec9d499f84c4ffaa46c48091', 'request_id': 'req-624a440a-96d7-407b-8ae3-71acf1e6d10c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:33.353632 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b062d4d-7c0f-4cd1-aa52-124bd0fa2493 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:33.355071 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-9b062d4d-7c0f-4cd1-aa52-124bd0fa2493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:33.366517 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-624a440a-96d7-407b-8ae3-71acf1e6d10c admin admin] The token cache is being invalidate because project 2c97bda0ec9d499f84c4ffaa46c48091 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:25:33.367166 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-624a440a-96d7-407b-8ae3-71acf1e6d10c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:33.368091 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-624a440a-96d7-407b-8ae3-71acf1e6d10c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:33.369621 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b062d4d-7c0f-4cd1-aa52-124bd0fa2493 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:33.372194 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 847/1682] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:25:33 2022] DELETE /identity/v3/projects/2c97bda0ec9d499f84c4ffaa46c48091 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:33.375471 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c2b2f-8dbc-4dde-ad11-2950600c4435 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:33.375755 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c2b2f-8dbc-4dde-ad11-2950600c4435 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:33.376060 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c2b2f-8dbc-4dde-ad11-2950600c4435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:33.401310 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-160c2b2f-8dbc-4dde-ad11-2950600c4435 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:33.402702 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-160c2b2f-8dbc-4dde-ad11-2950600c4435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:33.453107 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f521ae-34e2-46df-aed3-6c13a627473b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:33.454023 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f521ae-34e2-46df-aed3-6c13a627473b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:33.454190 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f521ae-34e2-46df-aed3-6c13a627473b admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:33.454534 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f521ae-34e2-46df-aed3-6c13a627473b admin admin] PATH_INFO: `/v3/projects/61012086ebfb4f8e885909834ae87a39` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:33.455983 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f521ae-34e2-46df-aed3-6c13a627473b admin admin] RBAC: Authorizing `identity:delete_project(project_id=61012086ebfb4f8e885909834ae87a39)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:33.458458 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f521ae-34e2-46df-aed3-6c13a627473b admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:33.485632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 848/1683] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:25:33.495928 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae61600-bce9-4fab-a29f-f1a6885f5876 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:33.496229 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae61600-bce9-4fab-a29f-f1a6885f5876 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:33.496508 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae61600-bce9-4fab-a29f-f1a6885f5876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:33.519435 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-8ae61600-bce9-4fab-a29f-f1a6885f5876 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:33.520703 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8ae61600-bce9-4fab-a29f-f1a6885f5876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:33.541811 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-64f521ae-34e2-46df-aed3-6c13a627473b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61012086ebfb4f8e885909834ae87a39', 'request_id': 'req-64f521ae-34e2-46df-aed3-6c13a627473b'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:33.555838 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-64f521ae-34e2-46df-aed3-6c13a627473b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61012086ebfb4f8e885909834ae87a39', 'request_id': 'req-64f521ae-34e2-46df-aed3-6c13a627473b'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:33.568391 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-64f521ae-34e2-46df-aed3-6c13a627473b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61012086ebfb4f8e885909834ae87a39', 'request_id': 'req-64f521ae-34e2-46df-aed3-6c13a627473b'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:33.572522 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:33.602499 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-64f521ae-34e2-46df-aed3-6c13a627473b admin admin] The token cache is being invalidate because project 61012086ebfb4f8e885909834ae87a39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:25:33.602798 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-64f521ae-34e2-46df-aed3-6c13a627473b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:33.603921 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-64f521ae-34e2-46df-aed3-6c13a627473b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:33.612219 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 836/1684] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:25:33 2022] DELETE /identity/v3/projects/61012086ebfb4f8e885909834ae87a39 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:25:33.616905 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f521ae-34e2-46df-aed3-6c13a627473b admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:33.618973 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-64f521ae-34e2-46df-aed3-6c13a627473b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:33.626551 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 849/1685] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:33.627997 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae61600-bce9-4fab-a29f-f1a6885f5876 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:33.632686 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f521ae-34e2-46df-aed3-6c13a627473b admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:33.637665 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebaf6c-e5af-4774-ad4a-38c3a31a4f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:33.638297 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebaf6c-e5af-4774-ad4a-38c3a31a4f2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:33.638581 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebaf6c-e5af-4774-ad4a-38c3a31a4f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:33.638840 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae61600-bce9-4fab-a29f-f1a6885f5876 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:33.638952 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebaf6c-e5af-4774-ad4a-38c3a31a4f2f admin admin] PATH_INFO: `/v3/users/84cc431187db486a965dafcfbe157113` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:33.640387 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eebaf6c-e5af-4774-ad4a-38c3a31a4f2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=84cc431187db486a965dafcfbe157113)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:33.643389 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eebaf6c-e5af-4774-ad4a-38c3a31a4f2f admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:33.645644 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e9e50-e902-4756-b5c1-ef672e14763e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:33.646389 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e9e50-e902-4756-b5c1-ef672e14763e admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:33.646912 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e9e50-e902-4756-b5c1-ef672e14763e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:33.647225 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e9e50-e902-4756-b5c1-ef672e14763e admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:33.648486 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e9e50-e902-4756-b5c1-ef672e14763e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:25:33.648486 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e9e50-e902-4756-b5c1-ef672e14763e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:33.650236 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e9e50-e902-4756-b5c1-ef672e14763e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:33.663663 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 850/1686] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:25:33.668127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e9e50-e902-4756-b5c1-ef672e14763e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:33.693353 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e9e50-e902-4756-b5c1-ef672e14763e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:33.698362 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c498041-2a28-464a-830a-42262406000d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:33.698969 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c498041-2a28-464a-830a-42262406000d admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:33.699248 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c498041-2a28-464a-830a-42262406000d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:33.699515 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c498041-2a28-464a-830a-42262406000d admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:33.700180 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c498041-2a28-464a-830a-42262406000d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:33.702056 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c498041-2a28-464a-830a-42262406000d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:33.702849 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2eebaf6c-e5af-4774-ad4a-38c3a31a4f2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84cc431187db486a965dafcfbe157113'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:33.705512 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:33.721075 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2eebaf6c-e5af-4774-ad4a-38c3a31a4f2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84cc431187db486a965dafcfbe157113'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:33.721365 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2eebaf6c-e5af-4774-ad4a-38c3a31a4f2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84cc431187db486a965dafcfbe157113'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:33.729504 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2eebaf6c-e5af-4774-ad4a-38c3a31a4f2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84cc431187db486a965dafcfbe157113'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:33.730461 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2eebaf6c-e5af-4774-ad4a-38c3a31a4f2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84cc431187db486a965dafcfbe157113'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:33.735935 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 851/1687] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:25:33 2022] POST /identity/v3/projects => generated 375 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:25:33.739567 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c498041-2a28-464a-830a-42262406000d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:33.741253 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8c498041-2a28-464a-830a-42262406000d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:33.743383 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 837/1688] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:25:33 2022] DELETE /identity/v3/users/84cc431187db486a965dafcfbe157113 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:33.865220 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c498041-2a28-464a-830a-42262406000d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:33.938531 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21821ebd-ef77-42a6-84ef-562921abaad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:33.939342 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21821ebd-ef77-42a6-84ef-562921abaad5 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:33.939617 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21821ebd-ef77-42a6-84ef-562921abaad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:33.940183 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21821ebd-ef77-42a6-84ef-562921abaad5 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:33.941040 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21821ebd-ef77-42a6-84ef-562921abaad5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:33.943700 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21821ebd-ef77-42a6-84ef-562921abaad5 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:33.986937 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 852/1689] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:25:33 2022] POST /identity/v3/users => generated 288 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:25:33.991708 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebaf6c-e5af-4774-ad4a-38c3a31a4f2f admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:34.004818 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebaf6c-e5af-4774-ad4a-38c3a31a4f2f admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:34.027298 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3185b2-6e2e-45ac-9897-9e19ba13ae2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:34.041183 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3185b2-6e2e-45ac-9897-9e19ba13ae2f admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:34.041463 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3185b2-6e2e-45ac-9897-9e19ba13ae2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:34.041842 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3185b2-6e2e-45ac-9897-9e19ba13ae2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:34.045374 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3185b2-6e2e-45ac-9897-9e19ba13ae2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:34.045374 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3185b2-6e2e-45ac-9897-9e19ba13ae2f admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:34.084692 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21821ebd-ef77-42a6-84ef-562921abaad5 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:34.092771 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 838/1690] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:34.124613 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21821ebd-ef77-42a6-84ef-562921abaad5 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:34.136544 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468177d-42f7-48f4-8e41-b9d80b8aea88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:34.137174 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468177d-42f7-48f4-8e41-b9d80b8aea88 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:34.137458 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468177d-42f7-48f4-8e41-b9d80b8aea88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:34.139604 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468177d-42f7-48f4-8e41-b9d80b8aea88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:34.140337 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a468177d-42f7-48f4-8e41-b9d80b8aea88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:34.146649 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a468177d-42f7-48f4-8e41-b9d80b8aea88 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:34.169814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3185b2-6e2e-45ac-9897-9e19ba13ae2f admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:34.172560 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 853/1691] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:34.199592 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3185b2-6e2e-45ac-9897-9e19ba13ae2f admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:34.206703 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f8d76-8cec-413a-8064-79375cf5d28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:34.207354 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f8d76-8cec-413a-8064-79375cf5d28a admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:34.207646 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f8d76-8cec-413a-8064-79375cf5d28a admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:34.208388 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f8d76-8cec-413a-8064-79375cf5d28a admin admin] PATH_INFO: `/v3/projects/9ca3d6149f5a4ecc8194da622d754232/users/b8b20948310d4223bb7945d1ed5f2b22/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:34.234471 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f8d76-8cec-413a-8064-79375cf5d28a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ca3d6149f5a4ecc8194da622d754232, user_id=b8b20948310d4223bb7945d1ed5f2b22, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:34.237370 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f8d76-8cec-413a-8064-79375cf5d28a admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:34.255573 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 839/1692] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:25:34 2022] PUT /identity/v3/projects/9ca3d6149f5a4ecc8194da622d754232/users/b8b20948310d4223bb7945d1ed5f2b22/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:34.268583 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a8d25-8bd2-4eed-9b17-fc9e4bedbd5b None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:34.268872 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a8d25-8bd2-4eed-9b17-fc9e4bedbd5b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:34.269151 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a8d25-8bd2-4eed-9b17-fc9e4bedbd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:34.320628 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-bb2a8d25-8bd2-4eed-9b17-fc9e4bedbd5b None None] MFA Rules not processed for user `b8b20948310d4223bb7945d1ed5f2b22`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:34.322153 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-bb2a8d25-8bd2-4eed-9b17-fc9e4bedbd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:34.345942 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:34.491490 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 854/1693] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:34.503384 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f8d76-8cec-413a-8064-79375cf5d28a admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:34.506330 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-eb2f8d76-8cec-413a-8064-79375cf5d28a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:34.535129 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a8d25-8bd2-4eed-9b17-fc9e4bedbd5b None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:34.537868 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-bb2a8d25-8bd2-4eed-9b17-fc9e4bedbd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:34.656477 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f8d76-8cec-413a-8064-79375cf5d28a admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:34.667944 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421cade1-d0e5-4c3a-ade4-94b0a7ef9176 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:34.668643 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cade1-d0e5-4c3a-ade4-94b0a7ef9176 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:34.669086 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cade1-d0e5-4c3a-ade4-94b0a7ef9176 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:34.669479 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cade1-d0e5-4c3a-ade4-94b0a7ef9176 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:34.681438 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421cade1-d0e5-4c3a-ade4-94b0a7ef9176 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:34.682911 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421cade1-d0e5-4c3a-ade4-94b0a7ef9176 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:34.694028 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 840/1694] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:25:34.709227 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a8d25-8bd2-4eed-9b17-fc9e4bedbd5b None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:34.715466 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c5e78-f56a-4631-aa2b-449ec97509ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:34.716282 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c5e78-f56a-4631-aa2b-449ec97509ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:34.716635 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c5e78-f56a-4631-aa2b-449ec97509ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:34.716983 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c5e78-f56a-4631-aa2b-449ec97509ac admin admin] PATH_INFO: `/v3/projects/c5cc64edf27c48d3a19f340bc0401e7a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:34.718225 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555c5e78-f56a-4631-aa2b-449ec97509ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5cc64edf27c48d3a19f340bc0401e7a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:34.720385 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555c5e78-f56a-4631-aa2b-449ec97509ac admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:34.799262 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-555c5e78-f56a-4631-aa2b-449ec97509ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5cc64edf27c48d3a19f340bc0401e7a', 'request_id': 'req-555c5e78-f56a-4631-aa2b-449ec97509ac'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:34.812696 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-555c5e78-f56a-4631-aa2b-449ec97509ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5cc64edf27c48d3a19f340bc0401e7a', 'request_id': 'req-555c5e78-f56a-4631-aa2b-449ec97509ac'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:34.821340 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-555c5e78-f56a-4631-aa2b-449ec97509ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5cc64edf27c48d3a19f340bc0401e7a', 'request_id': 'req-555c5e78-f56a-4631-aa2b-449ec97509ac'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:34.836540 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-555c5e78-f56a-4631-aa2b-449ec97509ac admin admin] The token cache is being invalidate because project c5cc64edf27c48d3a19f340bc0401e7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:25:34.836843 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-555c5e78-f56a-4631-aa2b-449ec97509ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:34.837562 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-555c5e78-f56a-4631-aa2b-449ec97509ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:34.846202 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca71ae-692f-4bd1-ab73-a75a94f15cbb None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:34.846744 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca71ae-692f-4bd1-ab73-a75a94f15cbb None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:34.847157 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 855/1695] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:25:34 2022] DELETE /identity/v3/projects/c5cc64edf27c48d3a19f340bc0401e7a => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:34.847279 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca71ae-692f-4bd1-ab73-a75a94f15cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:34.876726 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-3eca71ae-692f-4bd1-ab73-a75a94f15cbb None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:34.878772 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-3eca71ae-692f-4bd1-ab73-a75a94f15cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:34.974631 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 841/1696] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:34.987912 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca32a99-ccbe-4249-97b7-b3ef67d98b54 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:34.988249 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca32a99-ccbe-4249-97b7-b3ef67d98b54 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:34.988536 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca32a99-ccbe-4249-97b7-b3ef67d98b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:35.010329 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-dca32a99-ccbe-4249-97b7-b3ef67d98b54 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:35.011774 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-dca32a99-ccbe-4249-97b7-b3ef67d98b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:35.021441 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 856/1697] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:35.027132 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca71ae-692f-4bd1-ab73-a75a94f15cbb None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:35.039767 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca71ae-692f-4bd1-ab73-a75a94f15cbb None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:35.046229 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97786a73-e55e-447d-ad90-3dff1adb94a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:35.048568 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97786a73-e55e-447d-ad90-3dff1adb94a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:35.048863 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97786a73-e55e-447d-ad90-3dff1adb94a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:35.049189 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97786a73-e55e-447d-ad90-3dff1adb94a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:35.049797 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97786a73-e55e-447d-ad90-3dff1adb94a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:25:35.050105 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97786a73-e55e-447d-ad90-3dff1adb94a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:35.051778 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97786a73-e55e-447d-ad90-3dff1adb94a1 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:35.068403 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 842/1698] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:25:35.070940 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca32a99-ccbe-4249-97b7-b3ef67d98b54 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:35.082734 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca32a99-ccbe-4249-97b7-b3ef67d98b54 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:35.089362 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d7de9-fc15-4394-b421-f136855d66be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:35.090355 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d7de9-fc15-4394-b421-f136855d66be admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:35.090477 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d7de9-fc15-4394-b421-f136855d66be admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:35.090737 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d7de9-fc15-4394-b421-f136855d66be admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:35.091445 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d7de9-fc15-4394-b421-f136855d66be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:35.094328 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d7de9-fc15-4394-b421-f136855d66be admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:35.133738 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 857/1699] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:25:35 2022] POST /identity/v3/projects => generated 381 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:25:35.138937 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97786a73-e55e-447d-ad90-3dff1adb94a1 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:35.150918 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97786a73-e55e-447d-ad90-3dff1adb94a1 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:35.214403 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:35.360252 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5d556-3dbd-422f-8981-37a940d0412c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:35.361067 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5d556-3dbd-422f-8981-37a940d0412c admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:35.362651 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5d556-3dbd-422f-8981-37a940d0412c admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:35.364320 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5d556-3dbd-422f-8981-37a940d0412c admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:35.365209 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a5d556-3dbd-422f-8981-37a940d0412c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:35.372378 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a5d556-3dbd-422f-8981-37a940d0412c admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:35.420847 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 843/1700] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:25:35 2022] POST /identity/v3/users => generated 291 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:25:35.425695 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d7de9-fc15-4394-b421-f136855d66be admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:35.455445 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d7de9-fc15-4394-b421-f136855d66be admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:35.463566 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e06869-1b8a-42ce-9504-62de7938c1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:35.464737 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e06869-1b8a-42ce-9504-62de7938c1b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:35.465677 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e06869-1b8a-42ce-9504-62de7938c1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:35.466279 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e06869-1b8a-42ce-9504-62de7938c1b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:35.467483 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e06869-1b8a-42ce-9504-62de7938c1b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:35.470436 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e06869-1b8a-42ce-9504-62de7938c1b6 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:35.491146 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 858/1701] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:35.492271 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5d556-3dbd-422f-8981-37a940d0412c admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:35.504269 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5d556-3dbd-422f-8981-37a940d0412c admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:35.510127 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ff2db-78c0-4621-8a63-db4a3e2c95c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:35.510957 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ff2db-78c0-4621-8a63-db4a3e2c95c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:35.511378 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ff2db-78c0-4621-8a63-db4a3e2c95c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:35.512093 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ff2db-78c0-4621-8a63-db4a3e2c95c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:35.512926 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72ff2db-78c0-4621-8a63-db4a3e2c95c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:35.515304 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72ff2db-78c0-4621-8a63-db4a3e2c95c2 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:35.530221 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 844/1702] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:35.534744 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e06869-1b8a-42ce-9504-62de7938c1b6 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:35.540175 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:35.546333 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e06869-1b8a-42ce-9504-62de7938c1b6 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:35.553040 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c46e3f-00d5-4494-be4e-6e41964491ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:35.553866 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c46e3f-00d5-4494-be4e-6e41964491ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:35.554391 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c46e3f-00d5-4494-be4e-6e41964491ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:35.554929 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c46e3f-00d5-4494-be4e-6e41964491ed admin admin] PATH_INFO: `/v3/projects/67a40a45989844288e18ed71fffb47b3/users/dc5c73f4552245e29df14544e6bf62c6/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:35.572029 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c46e3f-00d5-4494-be4e-6e41964491ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=67a40a45989844288e18ed71fffb47b3, user_id=dc5c73f4552245e29df14544e6bf62c6, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:35.574821 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c46e3f-00d5-4494-be4e-6e41964491ed admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:35.592569 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 859/1703] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:25:35 2022] PUT /identity/v3/projects/67a40a45989844288e18ed71fffb47b3/users/dc5c73f4552245e29df14544e6bf62c6/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:25:35.605228 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186459a-604b-4938-936a-209bf10df5b3 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:35.605574 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186459a-604b-4938-936a-209bf10df5b3 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:35.606771 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186459a-604b-4938-936a-209bf10df5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:35.636602 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-8186459a-604b-4938-936a-209bf10df5b3 None None] MFA Rules not processed for user `dc5c73f4552245e29df14544e6bf62c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:35.638377 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-8186459a-604b-4938-936a-209bf10df5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:35.748408 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 845/1704] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:35.753747 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c46e3f-00d5-4494-be4e-6e41964491ed admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:35.874273 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c46e3f-00d5-4494-be4e-6e41964491ed admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:35.879529 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73fd93-0b74-4c2c-bce2-bc37b61908c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:35.880528 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73fd93-0b74-4c2c-bce2-bc37b61908c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:35.880528 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73fd93-0b74-4c2c-bce2-bc37b61908c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:35.881065 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73fd93-0b74-4c2c-bce2-bc37b61908c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:35.881731 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73fd93-0b74-4c2c-bce2-bc37b61908c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:35.884157 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73fd93-0b74-4c2c-bce2-bc37b61908c9 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:35.920261 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 860/1705] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:25:35 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:25:35.921511 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8186459a-604b-4938-936a-209bf10df5b3 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:35.935590 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8186459a-604b-4938-936a-209bf10df5b3 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:36.021551 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf626b-779b-4ecc-a182-05ebf06600b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:36.022197 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf626b-779b-4ecc-a182-05ebf06600b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:36.022479 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf626b-779b-4ecc-a182-05ebf06600b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:36.022751 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf626b-779b-4ecc-a182-05ebf06600b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:36.024368 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf626b-779b-4ecc-a182-05ebf06600b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:36.028623 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf626b-779b-4ecc-a182-05ebf06600b5 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:36.057836 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 846/1706] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:25:35 2022] POST /identity/v3/users => generated 296 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:25:36.059235 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73fd93-0b74-4c2c-bce2-bc37b61908c9 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:36.072356 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73fd93-0b74-4c2c-bce2-bc37b61908c9 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:36.077464 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae5be4-4a72-4168-b8fd-8a2a48c74113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:36.078383 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae5be4-4a72-4168-b8fd-8a2a48c74113 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:36.078720 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae5be4-4a72-4168-b8fd-8a2a48c74113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:36.079186 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae5be4-4a72-4168-b8fd-8a2a48c74113 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:36.079797 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ae5be4-4a72-4168-b8fd-8a2a48c74113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:36.081559 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ae5be4-4a72-4168-b8fd-8a2a48c74113 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:36.098759 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 861/1707] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:36.100984 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf626b-779b-4ecc-a182-05ebf06600b5 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:36.115047 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf626b-779b-4ecc-a182-05ebf06600b5 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:36.122003 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ace11-6c36-4626-8206-730947f8df39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:36.123376 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ace11-6c36-4626-8206-730947f8df39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:36.123732 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ace11-6c36-4626-8206-730947f8df39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:36.124021 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ace11-6c36-4626-8206-730947f8df39 admin admin] PATH_INFO: `/v3/projects/e19a99030c85464c926d7588685f534c/users/f9111c265f2d4175a06826ac77018eec/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:36.142736 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ace11-6c36-4626-8206-730947f8df39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e19a99030c85464c926d7588685f534c, user_id=f9111c265f2d4175a06826ac77018eec, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:36.145814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ace11-6c36-4626-8206-730947f8df39 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:36.150336 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:36.167375 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 847/1708] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:25:36 2022] PUT /identity/v3/projects/e19a99030c85464c926d7588685f534c/users/f9111c265f2d4175a06826ac77018eec/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:36.171245 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae5be4-4a72-4168-b8fd-8a2a48c74113 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:36.184247 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae5be4-4a72-4168-b8fd-8a2a48c74113 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:36.279924 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef293013-d004-43c1-a45c-ebc03dfe90a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:36.280579 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef293013-d004-43c1-a45c-ebc03dfe90a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:36.281051 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef293013-d004-43c1-a45c-ebc03dfe90a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:36.281846 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef293013-d004-43c1-a45c-ebc03dfe90a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:36.282611 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef293013-d004-43c1-a45c-ebc03dfe90a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:36.284887 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef293013-d004-43c1-a45c-ebc03dfe90a0 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:36.297349 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 862/1709] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:36.301533 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ace11-6c36-4626-8206-730947f8df39 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:36.316163 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ace11-6c36-4626-8206-730947f8df39 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:36.321322 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a34e11-0318-415b-8176-e028e76c1448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:36.322171 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a34e11-0318-415b-8176-e028e76c1448 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:36.322520 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a34e11-0318-415b-8176-e028e76c1448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:36.322856 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a34e11-0318-415b-8176-e028e76c1448 admin admin] PATH_INFO: `/v3/projects/e19a99030c85464c926d7588685f534c/users/f9111c265f2d4175a06826ac77018eec/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:36.326917 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a34e11-0318-415b-8176-e028e76c1448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e19a99030c85464c926d7588685f534c, user_id=f9111c265f2d4175a06826ac77018eec, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:36.330826 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a34e11-0318-415b-8176-e028e76c1448 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:36.355608 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34819c8b-2256-427c-8b8a-4904db58d6b1 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:36.355993 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34819c8b-2256-427c-8b8a-4904db58d6b1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:36.356282 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34819c8b-2256-427c-8b8a-4904db58d6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:36.358941 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 848/1710] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:25:36 2022] PUT /identity/v3/projects/e19a99030c85464c926d7588685f534c/users/f9111c265f2d4175a06826ac77018eec/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:25:36.412740 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-34819c8b-2256-427c-8b8a-4904db58d6b1 None None] MFA Rules not processed for user `f9111c265f2d4175a06826ac77018eec`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:36.414309 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-34819c8b-2256-427c-8b8a-4904db58d6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:36.480036 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:36.535290 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 863/1711] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:36 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:36.560337 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a34e11-0318-415b-8176-e028e76c1448 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:36.563342 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-05a34e11-0318-415b-8176-e028e76c1448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:36.645692 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a34e11-0318-415b-8176-e028e76c1448 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:36.650050 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c230e9-c2ab-48aa-92bc-9806533bed6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:36.651070 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c230e9-c2ab-48aa-92bc-9806533bed6e service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:36.651569 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c230e9-c2ab-48aa-92bc-9806533bed6e service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:36.652089 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c230e9-c2ab-48aa-92bc-9806533bed6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:36.664057 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c230e9-c2ab-48aa-92bc-9806533bed6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:36.665730 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c230e9-c2ab-48aa-92bc-9806533bed6e service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:36.686694 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 849/1712] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:36 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:25:37.011832 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34819c8b-2256-427c-8b8a-4904db58d6b1 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:37.021366 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-34819c8b-2256-427c-8b8a-4904db58d6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:37.040551 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34819c8b-2256-427c-8b8a-4904db58d6b1 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:37.046580 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bcbaff-25d6-4fea-80a7-ce377cc3c80d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:37.047953 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcbaff-25d6-4fea-80a7-ce377cc3c80d service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:37.048471 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcbaff-25d6-4fea-80a7-ce377cc3c80d service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:37.049115 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcbaff-25d6-4fea-80a7-ce377cc3c80d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:37.124883 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bcbaff-25d6-4fea-80a7-ce377cc3c80d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:37.126460 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bcbaff-25d6-4fea-80a7-ce377cc3c80d service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:37.136628 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 864/1713] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:25:37.999473 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c230e9-c2ab-48aa-92bc-9806533bed6e service cinder] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:38.001513 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-11c230e9-c2ab-48aa-92bc-9806533bed6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:38.129123 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c230e9-c2ab-48aa-92bc-9806533bed6e service cinder] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:38.141125 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c27b3a-5a92-4fb7-8cc6-7512daecac0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:38.141793 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c27b3a-5a92-4fb7-8cc6-7512daecac0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:38.142070 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c27b3a-5a92-4fb7-8cc6-7512daecac0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:38.147603 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c27b3a-5a92-4fb7-8cc6-7512daecac0f admin admin] PATH_INFO: `/v3/users/cde15273045b49958de46b9ae9b8ddf8` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:38.149915 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c27b3a-5a92-4fb7-8cc6-7512daecac0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cde15273045b49958de46b9ae9b8ddf8)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:38.152690 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c27b3a-5a92-4fb7-8cc6-7512daecac0f admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:38.293812 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c4c27b3a-5a92-4fb7-8cc6-7512daecac0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cde15273045b49958de46b9ae9b8ddf8'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:38.321121 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c4c27b3a-5a92-4fb7-8cc6-7512daecac0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cde15273045b49958de46b9ae9b8ddf8'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:38.323174 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c4c27b3a-5a92-4fb7-8cc6-7512daecac0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cde15273045b49958de46b9ae9b8ddf8'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:38.348799 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c4c27b3a-5a92-4fb7-8cc6-7512daecac0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cde15273045b49958de46b9ae9b8ddf8'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:38.349678 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c4c27b3a-5a92-4fb7-8cc6-7512daecac0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cde15273045b49958de46b9ae9b8ddf8'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:38.392502 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9eff20-b5a2-47e0-b31c-13351f6fb552 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:38.393098 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9eff20-b5a2-47e0-b31c-13351f6fb552 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:38.393098 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9eff20-b5a2-47e0-b31c-13351f6fb552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:38.397081 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 850/1714] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:25:37 2022] DELETE /identity/v3/users/cde15273045b49958de46b9ae9b8ddf8 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:38.425088 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-dc9eff20-b5a2-47e0-b31c-13351f6fb552 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:38.427173 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-dc9eff20-b5a2-47e0-b31c-13351f6fb552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:38.567885 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 865/1715] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:38.584391 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c27b3a-5a92-4fb7-8cc6-7512daecac0f admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:38.584391 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c4c27b3a-5a92-4fb7-8cc6-7512daecac0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:38.588220 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:38.722369 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c27b3a-5a92-4fb7-8cc6-7512daecac0f admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:38.742637 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa56838-3f33-472b-a3a5-8162cd6217c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:38.743280 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa56838-3f33-472b-a3a5-8162cd6217c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:38.743565 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa56838-3f33-472b-a3a5-8162cd6217c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:38.743841 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa56838-3f33-472b-a3a5-8162cd6217c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:38.761045 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa56838-3f33-472b-a3a5-8162cd6217c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:38.761892 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa56838-3f33-472b-a3a5-8162cd6217c0 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:38.790212 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 851/1716] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:25:39.597027 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9eff20-b5a2-47e0-b31c-13351f6fb552 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:39.599790 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-dc9eff20-b5a2-47e0-b31c-13351f6fb552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:39.623192 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9eff20-b5a2-47e0-b31c-13351f6fb552 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:39.639794 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d7974-0f1b-4651-b715-c7546d0201a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:39.640761 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d7974-0f1b-4651-b715-c7546d0201a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:39.641111 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d7974-0f1b-4651-b715-c7546d0201a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:39.641472 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d7974-0f1b-4651-b715-c7546d0201a6 admin admin] PATH_INFO: `/v3/projects/256264ed8edc48eb97373ab334cb8be8` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:39.642788 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d7974-0f1b-4651-b715-c7546d0201a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=256264ed8edc48eb97373ab334cb8be8)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:39.644645 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d7974-0f1b-4651-b715-c7546d0201a6 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:39.737731 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-162d7974-0f1b-4651-b715-c7546d0201a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '256264ed8edc48eb97373ab334cb8be8', 'request_id': 'req-162d7974-0f1b-4651-b715-c7546d0201a6'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:39.746381 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-162d7974-0f1b-4651-b715-c7546d0201a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '256264ed8edc48eb97373ab334cb8be8', 'request_id': 'req-162d7974-0f1b-4651-b715-c7546d0201a6'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:39.754618 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-162d7974-0f1b-4651-b715-c7546d0201a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '256264ed8edc48eb97373ab334cb8be8', 'request_id': 'req-162d7974-0f1b-4651-b715-c7546d0201a6'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:39.757779 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:39.777500 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-162d7974-0f1b-4651-b715-c7546d0201a6 admin admin] The token cache is being invalidate because project 256264ed8edc48eb97373ab334cb8be8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:25:39.777804 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-162d7974-0f1b-4651-b715-c7546d0201a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:39.779261 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-162d7974-0f1b-4651-b715-c7546d0201a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:39.781533 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 866/1717] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:25:39 2022] DELETE /identity/v3/projects/256264ed8edc48eb97373ab334cb8be8 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:39.785484 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa56838-3f33-472b-a3a5-8162cd6217c0 service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:39.800087 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa56838-3f33-472b-a3a5-8162cd6217c0 service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:39.874383 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967ee6f-1376-4889-a49f-5e61cc36dfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:39.875500 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967ee6f-1376-4889-a49f-5e61cc36dfb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:39.876002 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967ee6f-1376-4889-a49f-5e61cc36dfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:39.876274 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967ee6f-1376-4889-a49f-5e61cc36dfb6 admin admin] PATH_INFO: `/v3/users/14049bb2652e49d5b3abaa984f3f3655` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:39.877966 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967ee6f-1376-4889-a49f-5e61cc36dfb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14049bb2652e49d5b3abaa984f3f3655)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:39.879342 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967ee6f-1376-4889-a49f-5e61cc36dfb6 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:39.928585 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f967ee6f-1376-4889-a49f-5e61cc36dfb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14049bb2652e49d5b3abaa984f3f3655'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:39.941931 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f967ee6f-1376-4889-a49f-5e61cc36dfb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14049bb2652e49d5b3abaa984f3f3655'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:39.948260 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f967ee6f-1376-4889-a49f-5e61cc36dfb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14049bb2652e49d5b3abaa984f3f3655'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:39.960497 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f967ee6f-1376-4889-a49f-5e61cc36dfb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14049bb2652e49d5b3abaa984f3f3655'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:39.962469 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f967ee6f-1376-4889-a49f-5e61cc36dfb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14049bb2652e49d5b3abaa984f3f3655'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:39.975934 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d7974-0f1b-4651-b715-c7546d0201a6 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:39.976511 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 852/1718] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:25:39 2022] DELETE /identity/v3/users/14049bb2652e49d5b3abaa984f3f3655 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:39.980766 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-162d7974-0f1b-4651-b715-c7546d0201a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:39.996007 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d7974-0f1b-4651-b715-c7546d0201a6 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:40.082502 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df68b9c-b2b9-4876-9c4d-47557ab08362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:40.083406 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df68b9c-b2b9-4876-9c4d-47557ab08362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:40.083984 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df68b9c-b2b9-4876-9c4d-47557ab08362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:40.084300 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df68b9c-b2b9-4876-9c4d-47557ab08362 admin admin] PATH_INFO: `/v3/users/dc5c73f4552245e29df14544e6bf62c6` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:40.085475 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df68b9c-b2b9-4876-9c4d-47557ab08362 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc5c73f4552245e29df14544e6bf62c6)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:40.087394 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df68b9c-b2b9-4876-9c4d-47557ab08362 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:40.177357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9df68b9c-b2b9-4876-9c4d-47557ab08362 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc5c73f4552245e29df14544e6bf62c6'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:40.178021 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9df68b9c-b2b9-4876-9c4d-47557ab08362 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc5c73f4552245e29df14544e6bf62c6'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:40.195043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9df68b9c-b2b9-4876-9c4d-47557ab08362 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc5c73f4552245e29df14544e6bf62c6'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:40.206218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9df68b9c-b2b9-4876-9c4d-47557ab08362 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc5c73f4552245e29df14544e6bf62c6'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:40.216471 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9df68b9c-b2b9-4876-9c4d-47557ab08362 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc5c73f4552245e29df14544e6bf62c6'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:40.223438 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 867/1719] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:25:39 2022] DELETE /identity/v3/users/dc5c73f4552245e29df14544e6bf62c6 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:25:40.228640 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01e5a3-1c14-46b4-b2d4-1ae42ea25e1f None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:40.229083 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01e5a3-1c14-46b4-b2d4-1ae42ea25e1f None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:40.229650 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01e5a3-1c14-46b4-b2d4-1ae42ea25e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:40.256441 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-2e01e5a3-1c14-46b4-b2d4-1ae42ea25e1f None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:40.257793 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2e01e5a3-1c14-46b4-b2d4-1ae42ea25e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:40.307854 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:40.371946 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 853/1720] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:40.426375 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df68b9c-b2b9-4876-9c4d-47557ab08362 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:40.427970 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9df68b9c-b2b9-4876-9c4d-47557ab08362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:40.565517 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df68b9c-b2b9-4876-9c4d-47557ab08362 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:40.570135 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e4a95-2253-4768-8c32-e00a765ae9e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:40.571007 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e4a95-2253-4768-8c32-e00a765ae9e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:40.572333 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e4a95-2253-4768-8c32-e00a765ae9e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:40.572618 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e4a95-2253-4768-8c32-e00a765ae9e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:40.588119 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e4a95-2253-4768-8c32-e00a765ae9e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:40.590270 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e4a95-2253-4768-8c32-e00a765ae9e3 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:40.599681 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01e5a3-1c14-46b4-b2d4-1ae42ea25e1f None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:40.601331 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2e01e5a3-1c14-46b4-b2d4-1ae42ea25e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:40.601453 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 868/1721] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:25:40.627754 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01e5a3-1c14-46b4-b2d4-1ae42ea25e1f None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:40.634018 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1148e0-442d-4078-a358-88c73eab6d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:40.634018 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1148e0-442d-4078-a358-88c73eab6d21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:40.634018 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1148e0-442d-4078-a358-88c73eab6d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:40.634018 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1148e0-442d-4078-a358-88c73eab6d21 admin admin] PATH_INFO: `/v3/projects/e4961c38c3ad42d5a9d13edde5c2959c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:40.640807 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1148e0-442d-4078-a358-88c73eab6d21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4961c38c3ad42d5a9d13edde5c2959c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:40.642995 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1148e0-442d-4078-a358-88c73eab6d21 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:40.731554 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3f1148e0-442d-4078-a358-88c73eab6d21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4961c38c3ad42d5a9d13edde5c2959c', 'request_id': 'req-3f1148e0-442d-4078-a358-88c73eab6d21'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:40.741718 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3f1148e0-442d-4078-a358-88c73eab6d21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4961c38c3ad42d5a9d13edde5c2959c', 'request_id': 'req-3f1148e0-442d-4078-a358-88c73eab6d21'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:40.754203 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3f1148e0-442d-4078-a358-88c73eab6d21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4961c38c3ad42d5a9d13edde5c2959c', 'request_id': 'req-3f1148e0-442d-4078-a358-88c73eab6d21'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:40.781806 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3f1148e0-442d-4078-a358-88c73eab6d21 admin admin] The token cache is being invalidate because project e4961c38c3ad42d5a9d13edde5c2959c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:25:40.782223 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3f1148e0-442d-4078-a358-88c73eab6d21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:40.782990 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3f1148e0-442d-4078-a358-88c73eab6d21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:40.787927 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 854/1722] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:25:40 2022] DELETE /identity/v3/projects/e4961c38c3ad42d5a9d13edde5c2959c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:25:40.791833 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee17fd5-14ef-47e6-b0d4-a9067a91cb0a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:40.793059 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee17fd5-14ef-47e6-b0d4-a9067a91cb0a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:40.793333 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee17fd5-14ef-47e6-b0d4-a9067a91cb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:40.822134 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-7ee17fd5-14ef-47e6-b0d4-a9067a91cb0a None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:40.823479 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7ee17fd5-14ef-47e6-b0d4-a9067a91cb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:40.839243 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:40.958280 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 869/1723] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:40.960081 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568192d6-f7fc-4473-9802-a9e1d12e75ad None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:40.960437 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568192d6-f7fc-4473-9802-a9e1d12e75ad None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:40.960803 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568192d6-f7fc-4473-9802-a9e1d12e75ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:40.983690 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-568192d6-f7fc-4473-9802-a9e1d12e75ad None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:40.986516 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-568192d6-f7fc-4473-9802-a9e1d12e75ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:40.995153 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 855/1724] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:40.999464 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee17fd5-14ef-47e6-b0d4-a9067a91cb0a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:41.010560 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee17fd5-14ef-47e6-b0d4-a9067a91cb0a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:41.015659 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a130a0a-d471-4796-9169-48a04ef97c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:41.017177 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a130a0a-d471-4796-9169-48a04ef97c24 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:41.017459 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a130a0a-d471-4796-9169-48a04ef97c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:41.017730 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a130a0a-d471-4796-9169-48a04ef97c24 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:41.018696 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a130a0a-d471-4796-9169-48a04ef97c24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:25:41.018696 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a130a0a-d471-4796-9169-48a04ef97c24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:41.020293 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a130a0a-d471-4796-9169-48a04ef97c24 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:41.039644 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 870/1725] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:25:41.040778 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568192d6-f7fc-4473-9802-a9e1d12e75ad None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:41.051376 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568192d6-f7fc-4473-9802-a9e1d12e75ad None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:41.056094 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2bbd3e-6908-4984-97c1-7eb3731e391e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:41.056704 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bbd3e-6908-4984-97c1-7eb3731e391e admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:41.056979 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bbd3e-6908-4984-97c1-7eb3731e391e admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:41.057248 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bbd3e-6908-4984-97c1-7eb3731e391e admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:41.057909 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2bbd3e-6908-4984-97c1-7eb3731e391e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:41.059786 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2bbd3e-6908-4984-97c1-7eb3731e391e admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:41.095968 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 856/1726] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:25:41 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:25:41.100506 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a130a0a-d471-4796-9169-48a04ef97c24 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:41.142135 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a130a0a-d471-4796-9169-48a04ef97c24 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:41.158030 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2bbd3e-6908-4984-97c1-7eb3731e391e admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:41.160395 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-9d2bbd3e-6908-4984-97c1-7eb3731e391e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:41.268683 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c1ccf-18a8-4a85-a652-03b660dc8b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:41.269314 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c1ccf-18a8-4a85-a652-03b660dc8b03 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:41.269597 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c1ccf-18a8-4a85-a652-03b660dc8b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:41.269875 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c1ccf-18a8-4a85-a652-03b660dc8b03 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:41.270516 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c1ccf-18a8-4a85-a652-03b660dc8b03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:41.273089 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c1ccf-18a8-4a85-a652-03b660dc8b03 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:41.278345 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2bbd3e-6908-4984-97c1-7eb3731e391e admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:41.285140 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407771e2-32c0-434b-8892-05b2d43a1216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:41.286105 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407771e2-32c0-434b-8892-05b2d43a1216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:41.286541 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407771e2-32c0-434b-8892-05b2d43a1216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:41.287010 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407771e2-32c0-434b-8892-05b2d43a1216 admin admin] PATH_INFO: `/v3/projects/67a40a45989844288e18ed71fffb47b3` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:41.288267 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407771e2-32c0-434b-8892-05b2d43a1216 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67a40a45989844288e18ed71fffb47b3)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:41.290424 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407771e2-32c0-434b-8892-05b2d43a1216 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:41.297115 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 871/1727] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:25:41 2022] POST /identity/v3/users => generated 288 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:25:41.301030 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c1ccf-18a8-4a85-a652-03b660dc8b03 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:41.314181 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c1ccf-18a8-4a85-a652-03b660dc8b03 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:41.319440 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef93b73-69ac-477f-91bb-75a6ccae3210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:41.320500 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef93b73-69ac-477f-91bb-75a6ccae3210 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:41.320789 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef93b73-69ac-477f-91bb-75a6ccae3210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:41.321069 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef93b73-69ac-477f-91bb-75a6ccae3210 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:41.321707 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef93b73-69ac-477f-91bb-75a6ccae3210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:41.322821 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:41.324055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef93b73-69ac-477f-91bb-75a6ccae3210 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:41.347397 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 872/1728] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:41.352627 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef93b73-69ac-477f-91bb-75a6ccae3210 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:41.354899 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-407771e2-32c0-434b-8892-05b2d43a1216 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67a40a45989844288e18ed71fffb47b3', 'request_id': 'req-407771e2-32c0-434b-8892-05b2d43a1216'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:41.362577 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-407771e2-32c0-434b-8892-05b2d43a1216 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67a40a45989844288e18ed71fffb47b3', 'request_id': 'req-407771e2-32c0-434b-8892-05b2d43a1216'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:41.364688 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef93b73-69ac-477f-91bb-75a6ccae3210 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:41.372149 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-407771e2-32c0-434b-8892-05b2d43a1216 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67a40a45989844288e18ed71fffb47b3', 'request_id': 'req-407771e2-32c0-434b-8892-05b2d43a1216'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:41.385042 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-407771e2-32c0-434b-8892-05b2d43a1216 admin admin] The token cache is being invalidate because project 67a40a45989844288e18ed71fffb47b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:25:41.385352 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-407771e2-32c0-434b-8892-05b2d43a1216 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:41.386157 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-407771e2-32c0-434b-8892-05b2d43a1216 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:41.391290 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 857/1729] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:25:41 2022] DELETE /identity/v3/projects/67a40a45989844288e18ed71fffb47b3 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:25:41.392502 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407771e2-32c0-434b-8892-05b2d43a1216 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:41.393973 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-407771e2-32c0-434b-8892-05b2d43a1216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:41.435408 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0f897-77ad-4837-ba11-fc42c21f1cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:41.436065 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0f897-77ad-4837-ba11-fc42c21f1cdd admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:41.436352 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0f897-77ad-4837-ba11-fc42c21f1cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:41.436628 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0f897-77ad-4837-ba11-fc42c21f1cdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:41.437305 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf0f897-77ad-4837-ba11-fc42c21f1cdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:41.438916 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf0f897-77ad-4837-ba11-fc42c21f1cdd admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:41.451755 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 873/1730] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:41.456649 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0f897-77ad-4837-ba11-fc42c21f1cdd admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:41.458359 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1bf0f897-77ad-4837-ba11-fc42c21f1cdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:41.472739 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407771e2-32c0-434b-8892-05b2d43a1216 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:41.474627 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0f897-77ad-4837-ba11-fc42c21f1cdd admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:41.477759 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a2293-a194-43c0-b593-3ba58a4384a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:41.478455 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a2293-a194-43c0-b593-3ba58a4384a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:41.478735 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a2293-a194-43c0-b593-3ba58a4384a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:41.479011 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a2293-a194-43c0-b593-3ba58a4384a5 admin admin] PATH_INFO: `/v3/users/f9111c265f2d4175a06826ac77018eec` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:41.480213 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4bffc6-c66a-474a-999e-139eb6546ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:41.480553 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a2293-a194-43c0-b593-3ba58a4384a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9111c265f2d4175a06826ac77018eec)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:41.481000 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4bffc6-c66a-474a-999e-139eb6546ac0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:41.481350 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4bffc6-c66a-474a-999e-139eb6546ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:41.481692 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4bffc6-c66a-474a-999e-139eb6546ac0 admin admin] PATH_INFO: `/v3/projects/aa387a8bda5c42d7b094879670c60c75/users/51a42e88d7124066a9a2ebe41b60a6ea/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:41.482558 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a2293-a194-43c0-b593-3ba58a4384a5 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:41.498379 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4bffc6-c66a-474a-999e-139eb6546ac0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa387a8bda5c42d7b094879670c60c75, user_id=51a42e88d7124066a9a2ebe41b60a6ea, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:41.501408 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4bffc6-c66a-474a-999e-139eb6546ac0 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:41.504495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:41.519623 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 874/1731] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:25:41 2022] PUT /identity/v3/projects/aa387a8bda5c42d7b094879670c60c75/users/51a42e88d7124066a9a2ebe41b60a6ea/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:41.531520 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072fc2c-b546-4c62-aaf2-7e5a2dd7753c None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:41.532165 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072fc2c-b546-4c62-aaf2-7e5a2dd7753c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:41.532539 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072fc2c-b546-4c62-aaf2-7e5a2dd7753c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:41.548664 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2f6a2293-a194-43c0-b593-3ba58a4384a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9111c265f2d4175a06826ac77018eec'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:41.563186 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2f6a2293-a194-43c0-b593-3ba58a4384a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9111c265f2d4175a06826ac77018eec'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:41.563925 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2f6a2293-a194-43c0-b593-3ba58a4384a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9111c265f2d4175a06826ac77018eec'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:41.564571 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e072fc2c-b546-4c62-aaf2-7e5a2dd7753c None None] MFA Rules not processed for user `51a42e88d7124066a9a2ebe41b60a6ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:41.565863 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e072fc2c-b546-4c62-aaf2-7e5a2dd7753c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:41.572558 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2f6a2293-a194-43c0-b593-3ba58a4384a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9111c265f2d4175a06826ac77018eec'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:41.574780 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2f6a2293-a194-43c0-b593-3ba58a4384a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9111c265f2d4175a06826ac77018eec'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:41.589852 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 858/1732] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:25:41 2022] DELETE /identity/v3/users/f9111c265f2d4175a06826ac77018eec => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:25:41.654909 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 875/1733] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:41.664563 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a2293-a194-43c0-b593-3ba58a4384a5 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:41.666136 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2f6a2293-a194-43c0-b593-3ba58a4384a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:41.707961 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:41.769544 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a2293-a194-43c0-b593-3ba58a4384a5 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:41.773815 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609d796-e366-478b-9590-2a3541f14406 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f67d808ffb4641b03f96406b3fe9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:41.774426 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609d796-e366-478b-9590-2a3541f14406 service glance] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:41.774699 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609d796-e366-478b-9590-2a3541f14406 service glance] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:41.776503 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609d796-e366-478b-9590-2a3541f14406 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:41.850812 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6609d796-e366-478b-9590-2a3541f14406 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:41.852571 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6609d796-e366-478b-9590-2a3541f14406 service glance] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:41.865096 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 859/1734] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:25:42.049504 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072fc2c-b546-4c62-aaf2-7e5a2dd7753c None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:42.051371 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e072fc2c-b546-4c62-aaf2-7e5a2dd7753c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:42.133120 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072fc2c-b546-4c62-aaf2-7e5a2dd7753c None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:42.206800 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242cb8f-4693-4b48-a1aa-1a28830c32ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:42.207441 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242cb8f-4693-4b48-a1aa-1a28830c32ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:42.207719 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242cb8f-4693-4b48-a1aa-1a28830c32ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:42.208024 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242cb8f-4693-4b48-a1aa-1a28830c32ef admin admin] PATH_INFO: `/v3/projects/e19a99030c85464c926d7588685f534c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:42.209281 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3242cb8f-4693-4b48-a1aa-1a28830c32ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=e19a99030c85464c926d7588685f534c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:42.211350 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3242cb8f-4693-4b48-a1aa-1a28830c32ef admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:42.264121 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:42.277202 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3242cb8f-4693-4b48-a1aa-1a28830c32ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e19a99030c85464c926d7588685f534c', 'request_id': 'req-3242cb8f-4693-4b48-a1aa-1a28830c32ef'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:42.289711 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3242cb8f-4693-4b48-a1aa-1a28830c32ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e19a99030c85464c926d7588685f534c', 'request_id': 'req-3242cb8f-4693-4b48-a1aa-1a28830c32ef'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:42.311663 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3242cb8f-4693-4b48-a1aa-1a28830c32ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e19a99030c85464c926d7588685f534c', 'request_id': 'req-3242cb8f-4693-4b48-a1aa-1a28830c32ef'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:42.331041 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3242cb8f-4693-4b48-a1aa-1a28830c32ef admin admin] The token cache is being invalidate because project e19a99030c85464c926d7588685f534c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:25:42.332291 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3242cb8f-4693-4b48-a1aa-1a28830c32ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:42.333103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3242cb8f-4693-4b48-a1aa-1a28830c32ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:42.337856 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 876/1735] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:25:42 2022] DELETE /identity/v3/projects/e19a99030c85464c926d7588685f534c => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:42.342475 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089917c-c72e-43ab-a388-6127121d058d None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:42.342767 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089917c-c72e-43ab-a388-6127121d058d None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:42.343047 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089917c-c72e-43ab-a388-6127121d058d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:42.367247 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-5089917c-c72e-43ab-a388-6127121d058d None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:42.368703 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-5089917c-c72e-43ab-a388-6127121d058d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:42.467252 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 860/1736] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:42.476033 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c0fa8-968c-426e-bd67-58aec89efb91 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:42.476447 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c0fa8-968c-426e-bd67-58aec89efb91 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:42.476826 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c0fa8-968c-426e-bd67-58aec89efb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:42.505505 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-7c6c0fa8-968c-426e-bd67-58aec89efb91 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:42.506952 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7c6c0fa8-968c-426e-bd67-58aec89efb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:42.522091 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 877/1737] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:42.526212 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089917c-c72e-43ab-a388-6127121d058d None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:42.537186 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089917c-c72e-43ab-a388-6127121d058d None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:42.542429 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83247b3-d8ef-4e8d-a8c2-533409557617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:42.543064 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83247b3-d8ef-4e8d-a8c2-533409557617 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:42.543344 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83247b3-d8ef-4e8d-a8c2-533409557617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:42.543625 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83247b3-d8ef-4e8d-a8c2-533409557617 admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:42.544299 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83247b3-d8ef-4e8d-a8c2-533409557617 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:25:42.544608 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83247b3-d8ef-4e8d-a8c2-533409557617 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:42.546205 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83247b3-d8ef-4e8d-a8c2-533409557617 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:42.558384 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 861/1738] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:25:42.563679 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c0fa8-968c-426e-bd67-58aec89efb91 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:42.573769 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c0fa8-968c-426e-bd67-58aec89efb91 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:42.579162 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70350c81-2d7b-4481-b574-9b895afef927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:42.579929 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70350c81-2d7b-4481-b574-9b895afef927 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:42.580403 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70350c81-2d7b-4481-b574-9b895afef927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:42.581102 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70350c81-2d7b-4481-b574-9b895afef927 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:42.581765 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70350c81-2d7b-4481-b574-9b895afef927 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:42.583924 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70350c81-2d7b-4481-b574-9b895afef927 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:42.620275 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 878/1739] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:25:42 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:25:42.621256 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83247b3-d8ef-4e8d-a8c2-533409557617 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:42.631595 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83247b3-d8ef-4e8d-a8c2-533409557617 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:42.684595 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:42.695124 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912b1ed-685d-4b58-8222-428f57f20531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:42.695738 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912b1ed-685d-4b58-8222-428f57f20531 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:42.696059 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912b1ed-685d-4b58-8222-428f57f20531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:42.696339 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912b1ed-685d-4b58-8222-428f57f20531 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:42.696971 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0912b1ed-685d-4b58-8222-428f57f20531 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:42.698879 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0912b1ed-685d-4b58-8222-428f57f20531 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:42.726649 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 862/1740] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:25:42 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:25:42.730706 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70350c81-2d7b-4481-b574-9b895afef927 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:42.742297 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70350c81-2d7b-4481-b574-9b895afef927 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:42.747073 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d4ad4-17d0-45a2-ba81-86864e836c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:42.747754 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d4ad4-17d0-45a2-ba81-86864e836c9a admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:42.748138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d4ad4-17d0-45a2-ba81-86864e836c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:42.748500 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d4ad4-17d0-45a2-ba81-86864e836c9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:42.749209 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d4ad4-17d0-45a2-ba81-86864e836c9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:42.750911 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d4ad4-17d0-45a2-ba81-86864e836c9a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:42.807875 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 879/1741] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:42.812346 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912b1ed-685d-4b58-8222-428f57f20531 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:42.834310 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912b1ed-685d-4b58-8222-428f57f20531 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:42.846760 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3e4e7-3a27-4912-8627-b6ec18d7bf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:42.847286 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3e4e7-3a27-4912-8627-b6ec18d7bf35 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:42.847567 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3e4e7-3a27-4912-8627-b6ec18d7bf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:42.848437 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3e4e7-3a27-4912-8627-b6ec18d7bf35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:42.849104 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d3e4e7-3a27-4912-8627-b6ec18d7bf35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:42.850805 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d3e4e7-3a27-4912-8627-b6ec18d7bf35 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:42.865507 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 863/1742] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:42.869442 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d4ad4-17d0-45a2-ba81-86864e836c9a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:42.882566 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d4ad4-17d0-45a2-ba81-86864e836c9a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:42.895717 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1eba9-1743-46d0-a976-9f50f41ac015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:42.897879 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1eba9-1743-46d0-a976-9f50f41ac015 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:42.898594 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1eba9-1743-46d0-a976-9f50f41ac015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:42.900231 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1eba9-1743-46d0-a976-9f50f41ac015 admin admin] PATH_INFO: `/v3/projects/782603a4d7c24c3ca952f42632a66c80/users/40226021df5444efb38e231b0585ffd8/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:42.947126 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1eba9-1743-46d0-a976-9f50f41ac015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=782603a4d7c24c3ca952f42632a66c80, user_id=40226021df5444efb38e231b0585ffd8, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:42.950146 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1eba9-1743-46d0-a976-9f50f41ac015 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:42.982552 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 880/1743] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:25:42 2022] PUT /identity/v3/projects/782603a4d7c24c3ca952f42632a66c80/users/40226021df5444efb38e231b0585ffd8/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:42.994480 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c65f18-00c5-4e7b-b5c4-310da239df42 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:42.995234 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c65f18-00c5-4e7b-b5c4-310da239df42 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:42.995786 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c65f18-00c5-4e7b-b5c4-310da239df42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:43.073930 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-c5c65f18-00c5-4e7b-b5c4-310da239df42 None None] MFA Rules not processed for user `40226021df5444efb38e231b0585ffd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:43.077339 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c5c65f18-00c5-4e7b-b5c4-310da239df42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:43.271502 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 864/1744] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:43.282941 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1eba9-1743-46d0-a976-9f50f41ac015 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:43.284896 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b5e1eba9-1743-46d0-a976-9f50f41ac015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:43.411883 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1eba9-1743-46d0-a976-9f50f41ac015 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:43.418345 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679bd9b-6fd3-4d92-ac19-a9e287be4023 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:43.419218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679bd9b-6fd3-4d92-ac19-a9e287be4023 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:43.420231 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679bd9b-6fd3-4d92-ac19-a9e287be4023 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:43.420688 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679bd9b-6fd3-4d92-ac19-a9e287be4023 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:43.433119 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9679bd9b-6fd3-4d92-ac19-a9e287be4023 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:43.435093 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9679bd9b-6fd3-4d92-ac19-a9e287be4023 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:43.449186 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 881/1745] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:25:43.471011 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c65f18-00c5-4e7b-b5c4-310da239df42 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:43.638223 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c65f18-00c5-4e7b-b5c4-310da239df42 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:43.651778 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa9f4e-98c4-464a-b161-159072954836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:43.652532 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa9f4e-98c4-464a-b161-159072954836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:43.652939 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa9f4e-98c4-464a-b161-159072954836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:43.653274 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa9f4e-98c4-464a-b161-159072954836 admin admin] PATH_INFO: `/v3/users/40226021df5444efb38e231b0585ffd8` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:43.654482 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa9f4e-98c4-464a-b161-159072954836 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40226021df5444efb38e231b0585ffd8)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:43.656480 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa9f4e-98c4-464a-b161-159072954836 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:43.707776 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f1fa9f4e-98c4-464a-b161-159072954836 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40226021df5444efb38e231b0585ffd8'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:43.719743 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:43.725609 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f1fa9f4e-98c4-464a-b161-159072954836 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40226021df5444efb38e231b0585ffd8'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:43.728082 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f1fa9f4e-98c4-464a-b161-159072954836 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40226021df5444efb38e231b0585ffd8'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:43.740206 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f1fa9f4e-98c4-464a-b161-159072954836 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40226021df5444efb38e231b0585ffd8'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:43.740901 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f1fa9f4e-98c4-464a-b161-159072954836 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40226021df5444efb38e231b0585ffd8'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:43.754010 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 865/1746] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:25:43 2022] DELETE /identity/v3/users/40226021df5444efb38e231b0585ffd8 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:43.758436 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92353254-37e1-40c2-b127-2f35ca6582a5 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:43.758902 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92353254-37e1-40c2-b127-2f35ca6582a5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:43.759004 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92353254-37e1-40c2-b127-2f35ca6582a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:43.779717 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-92353254-37e1-40c2-b127-2f35ca6582a5 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:43.781327 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-92353254-37e1-40c2-b127-2f35ca6582a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:43.847586 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 882/1747] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:25:43.856994 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa9f4e-98c4-464a-b161-159072954836 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:43.858352 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-f1fa9f4e-98c4-464a-b161-159072954836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:43.923875 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa9f4e-98c4-464a-b161-159072954836 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:43.927460 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab9787-9489-480d-a0d6-b9c0e89976c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:43.928096 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab9787-9489-480d-a0d6-b9c0e89976c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:43.928375 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab9787-9489-480d-a0d6-b9c0e89976c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:43.928643 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab9787-9489-480d-a0d6-b9c0e89976c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:43.938998 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab9787-9489-480d-a0d6-b9c0e89976c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:43.941132 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab9787-9489-480d-a0d6-b9c0e89976c9 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:43.951719 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 866/1748] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:25:44.340669 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92353254-37e1-40c2-b127-2f35ca6582a5 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:44.342165 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-92353254-37e1-40c2-b127-2f35ca6582a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:44.351347 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:44.359755 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92353254-37e1-40c2-b127-2f35ca6582a5 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:44.365938 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f16ea-eb1f-4f15-b9e9-9ac35518651e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:44.366589 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f16ea-eb1f-4f15-b9e9-9ac35518651e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:44.366867 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f16ea-eb1f-4f15-b9e9-9ac35518651e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:44.367139 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f16ea-eb1f-4f15-b9e9-9ac35518651e admin admin] PATH_INFO: `/v3/projects/782603a4d7c24c3ca952f42632a66c80` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:44.368310 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f16ea-eb1f-4f15-b9e9-9ac35518651e admin admin] RBAC: Authorizing `identity:delete_project(project_id=782603a4d7c24c3ca952f42632a66c80)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:44.370369 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f16ea-eb1f-4f15-b9e9-9ac35518651e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:44.419712 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9a1f16ea-eb1f-4f15-b9e9-9ac35518651e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '782603a4d7c24c3ca952f42632a66c80', 'request_id': 'req-9a1f16ea-eb1f-4f15-b9e9-9ac35518651e'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:44.428248 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9a1f16ea-eb1f-4f15-b9e9-9ac35518651e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '782603a4d7c24c3ca952f42632a66c80', 'request_id': 'req-9a1f16ea-eb1f-4f15-b9e9-9ac35518651e'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:44.434810 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9a1f16ea-eb1f-4f15-b9e9-9ac35518651e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '782603a4d7c24c3ca952f42632a66c80', 'request_id': 'req-9a1f16ea-eb1f-4f15-b9e9-9ac35518651e'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:44.447961 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9a1f16ea-eb1f-4f15-b9e9-9ac35518651e admin admin] The token cache is being invalidate because project 782603a4d7c24c3ca952f42632a66c80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:25:44.448261 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9a1f16ea-eb1f-4f15-b9e9-9ac35518651e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:44.448975 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9a1f16ea-eb1f-4f15-b9e9-9ac35518651e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:44.450770 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 883/1749] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:25:44 2022] DELETE /identity/v3/projects/782603a4d7c24c3ca952f42632a66c80 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:44.455647 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190a3e0-ee21-4d89-99ba-dd7a728cb024 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:44.456196 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190a3e0-ee21-4d89-99ba-dd7a728cb024 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:44.456573 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190a3e0-ee21-4d89-99ba-dd7a728cb024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:44.477281 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-4190a3e0-ee21-4d89-99ba-dd7a728cb024 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:44.478606 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-4190a3e0-ee21-4d89-99ba-dd7a728cb024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:44.550793 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 867/1750] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:44.559605 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12efff-8b64-4e3b-b08c-f832ef586300 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:44.559913 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12efff-8b64-4e3b-b08c-f832ef586300 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:44.560193 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12efff-8b64-4e3b-b08c-f832ef586300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:44.581230 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-3a12efff-8b64-4e3b-b08c-f832ef586300 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:44.582486 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3a12efff-8b64-4e3b-b08c-f832ef586300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:44.591023 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 884/1751] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:44.596781 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190a3e0-ee21-4d89-99ba-dd7a728cb024 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:44.608241 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190a3e0-ee21-4d89-99ba-dd7a728cb024 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:44.613061 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ead4fd-9dce-4c44-8007-81802a61e575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:44.613683 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ead4fd-9dce-4c44-8007-81802a61e575 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:44.613958 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ead4fd-9dce-4c44-8007-81802a61e575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:44.614227 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ead4fd-9dce-4c44-8007-81802a61e575 admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:44.614863 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ead4fd-9dce-4c44-8007-81802a61e575 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:25:44.615164 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ead4fd-9dce-4c44-8007-81802a61e575 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:44.616839 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ead4fd-9dce-4c44-8007-81802a61e575 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:44.628945 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 868/1752] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:25:44.633238 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12efff-8b64-4e3b-b08c-f832ef586300 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:44.642881 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12efff-8b64-4e3b-b08c-f832ef586300 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:44.647531 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce01a9a-64a2-4c8b-aaa3-88a62ffa0a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:44.648153 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce01a9a-64a2-4c8b-aaa3-88a62ffa0a39 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:44.648434 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce01a9a-64a2-4c8b-aaa3-88a62ffa0a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:44.648706 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce01a9a-64a2-4c8b-aaa3-88a62ffa0a39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:44.649358 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce01a9a-64a2-4c8b-aaa3-88a62ffa0a39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:44.651252 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce01a9a-64a2-4c8b-aaa3-88a62ffa0a39 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:44.683450 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 885/1753] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:25:44 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:25:44.684685 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ead4fd-9dce-4c44-8007-81802a61e575 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:44.695915 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ead4fd-9dce-4c44-8007-81802a61e575 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:44.766442 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf22b00-d5f9-467e-bd75-527081b40810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:44.767055 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf22b00-d5f9-467e-bd75-527081b40810 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:44.767333 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf22b00-d5f9-467e-bd75-527081b40810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:44.767606 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf22b00-d5f9-467e-bd75-527081b40810 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:44.768285 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf22b00-d5f9-467e-bd75-527081b40810 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:44.770331 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf22b00-d5f9-467e-bd75-527081b40810 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:44.791260 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:44.798305 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 869/1754] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:25:44 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:25:44.803068 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce01a9a-64a2-4c8b-aaa3-88a62ffa0a39 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:44.813765 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce01a9a-64a2-4c8b-aaa3-88a62ffa0a39 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:44.818737 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3764e70-1fe3-49a8-b8c1-c6b691186759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:44.819359 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3764e70-1fe3-49a8-b8c1-c6b691186759 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:44.819641 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3764e70-1fe3-49a8-b8c1-c6b691186759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:44.819929 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3764e70-1fe3-49a8-b8c1-c6b691186759 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:44.820607 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3764e70-1fe3-49a8-b8c1-c6b691186759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:44.822216 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3764e70-1fe3-49a8-b8c1-c6b691186759 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:44.839884 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 886/1755] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:44.841410 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf22b00-d5f9-467e-bd75-527081b40810 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:44.857176 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf22b00-d5f9-467e-bd75-527081b40810 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:44.862449 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460d1a8-e816-4933-a93d-22dd4ff75766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:44.862888 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460d1a8-e816-4933-a93d-22dd4ff75766 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:44.863171 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460d1a8-e816-4933-a93d-22dd4ff75766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:44.863439 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460d1a8-e816-4933-a93d-22dd4ff75766 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:44.864107 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3460d1a8-e816-4933-a93d-22dd4ff75766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:44.865700 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3460d1a8-e816-4933-a93d-22dd4ff75766 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:44.878122 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 870/1756] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:25:44.882339 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3764e70-1fe3-49a8-b8c1-c6b691186759 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:44.895675 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3764e70-1fe3-49a8-b8c1-c6b691186759 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:44.902632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1cd692-daa9-4057-8039-a203139fcb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:44.903319 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1cd692-daa9-4057-8039-a203139fcb03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:44.903597 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1cd692-daa9-4057-8039-a203139fcb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:44.903871 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1cd692-daa9-4057-8039-a203139fcb03 admin admin] PATH_INFO: `/v3/projects/9495d856894c4db7bb9a7855d5601353/users/0f13f210cd124de09570d34844fd8963/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:44.920567 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1cd692-daa9-4057-8039-a203139fcb03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9495d856894c4db7bb9a7855d5601353, user_id=0f13f210cd124de09570d34844fd8963, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:44.923531 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1cd692-daa9-4057-8039-a203139fcb03 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:44.938338 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 887/1757] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:25:44 2022] PUT /identity/v3/projects/9495d856894c4db7bb9a7855d5601353/users/0f13f210cd124de09570d34844fd8963/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:25:44.948270 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e08cd-c01e-405d-a52e-d5d019f0f2ba None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:44.948711 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e08cd-c01e-405d-a52e-d5d019f0f2ba None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:44.948842 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e08cd-c01e-405d-a52e-d5d019f0f2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:44.977881 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-5d7e08cd-c01e-405d-a52e-d5d019f0f2ba None None] MFA Rules not processed for user `0f13f210cd124de09570d34844fd8963`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:44.979249 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-5d7e08cd-c01e-405d-a52e-d5d019f0f2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:45.052996 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 871/1758] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:45.057496 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1cd692-daa9-4057-8039-a203139fcb03 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:45.121436 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1cd692-daa9-4057-8039-a203139fcb03 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:45.126204 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c1ff5-6734-408b-94d0-85e5a9f9b9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:45.126819 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c1ff5-6734-408b-94d0-85e5a9f9b9a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:45.127104 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c1ff5-6734-408b-94d0-85e5a9f9b9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:45.127377 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c1ff5-6734-408b-94d0-85e5a9f9b9a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:45.128052 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c1ff5-6734-408b-94d0-85e5a9f9b9a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:45.129980 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c1ff5-6734-408b-94d0-85e5a9f9b9a8 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:45.160308 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 888/1759] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:25:45 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:25:45.164100 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e08cd-c01e-405d-a52e-d5d019f0f2ba None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:45.174993 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e08cd-c01e-405d-a52e-d5d019f0f2ba None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:45.230547 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571e729-36fb-4720-9c20-3fc6a61e0bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:45.231131 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571e729-36fb-4720-9c20-3fc6a61e0bd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:45.231410 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571e729-36fb-4720-9c20-3fc6a61e0bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:45.231681 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571e729-36fb-4720-9c20-3fc6a61e0bd4 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:45.232412 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571e729-36fb-4720-9c20-3fc6a61e0bd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:45.234354 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571e729-36fb-4720-9c20-3fc6a61e0bd4 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:45.255181 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 872/1760] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:25:45 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:25:45.259103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c1ff5-6734-408b-94d0-85e5a9f9b9a8 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:45.270727 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c1ff5-6734-408b-94d0-85e5a9f9b9a8 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:45.275443 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44154c33-aebf-4437-b123-9151a10e2148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:45.276096 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44154c33-aebf-4437-b123-9151a10e2148 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:45.276375 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44154c33-aebf-4437-b123-9151a10e2148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:45.276649 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44154c33-aebf-4437-b123-9151a10e2148 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:45.277290 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44154c33-aebf-4437-b123-9151a10e2148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:45.278878 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44154c33-aebf-4437-b123-9151a10e2148 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:45.280375 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:45.295667 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 889/1761] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:45.296976 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571e729-36fb-4720-9c20-3fc6a61e0bd4 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:45.307110 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571e729-36fb-4720-9c20-3fc6a61e0bd4 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:45.311924 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e889e-dad3-465a-908d-371f438e8092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:45.312753 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e889e-dad3-465a-908d-371f438e8092 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:45.313199 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e889e-dad3-465a-908d-371f438e8092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:45.313476 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e889e-dad3-465a-908d-371f438e8092 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:45.314111 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e889e-dad3-465a-908d-371f438e8092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:45.315677 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e889e-dad3-465a-908d-371f438e8092 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:45.329996 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 873/1762] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:45.331174 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44154c33-aebf-4437-b123-9151a10e2148 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:45.342795 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44154c33-aebf-4437-b123-9151a10e2148 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:45.349038 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e355f43-8be8-4752-bd76-821a1aff415c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:45.349827 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e355f43-8be8-4752-bd76-821a1aff415c admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:45.350114 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e355f43-8be8-4752-bd76-821a1aff415c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:45.350472 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e355f43-8be8-4752-bd76-821a1aff415c admin admin] PATH_INFO: `/v3/projects/5a20e878d19f438ea6c3b5bcc998df9e/users/cf8291f00ede4a4598b796adae1b4510/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:45.368639 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e355f43-8be8-4752-bd76-821a1aff415c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a20e878d19f438ea6c3b5bcc998df9e, user_id=cf8291f00ede4a4598b796adae1b4510, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:45.373028 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e355f43-8be8-4752-bd76-821a1aff415c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:45.390090 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 890/1763] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:25:45 2022] PUT /identity/v3/projects/5a20e878d19f438ea6c3b5bcc998df9e/users/cf8291f00ede4a4598b796adae1b4510/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:45.401577 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36663c5-7fe1-42f0-91c8-5aaf999277c3 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:45.402312 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36663c5-7fe1-42f0-91c8-5aaf999277c3 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:45.402647 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36663c5-7fe1-42f0-91c8-5aaf999277c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:45.436782 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-c36663c5-7fe1-42f0-91c8-5aaf999277c3 None None] MFA Rules not processed for user `cf8291f00ede4a4598b796adae1b4510`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:45.438773 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c36663c5-7fe1-42f0-91c8-5aaf999277c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:45.491864 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:45.514949 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 874/1764] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:25:45.520445 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e355f43-8be8-4752-bd76-821a1aff415c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:45.587816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e355f43-8be8-4752-bd76-821a1aff415c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:45.592867 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb461b5b-16cd-4130-b987-a5acaf70408d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:45.594055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb461b5b-16cd-4130-b987-a5acaf70408d admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:45.594338 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb461b5b-16cd-4130-b987-a5acaf70408d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:45.594610 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb461b5b-16cd-4130-b987-a5acaf70408d admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:45.595258 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb461b5b-16cd-4130-b987-a5acaf70408d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:45.597329 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb461b5b-16cd-4130-b987-a5acaf70408d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:45.628222 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 891/1765] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:25:45 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:25:45.632260 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36663c5-7fe1-42f0-91c8-5aaf999277c3 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:45.647184 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36663c5-7fe1-42f0-91c8-5aaf999277c3 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:45.709694 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a83ee17-3b41-48fc-925e-7cce1bbc68d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:45.710513 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83ee17-3b41-48fc-925e-7cce1bbc68d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:45.710802 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83ee17-3b41-48fc-925e-7cce1bbc68d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:45.711076 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83ee17-3b41-48fc-925e-7cce1bbc68d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:45.711723 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a83ee17-3b41-48fc-925e-7cce1bbc68d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:45.714047 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a83ee17-3b41-48fc-925e-7cce1bbc68d8 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:45.746176 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 875/1766] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:25:45 2022] POST /identity/v3/users => generated 299 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:25:45.750145 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb461b5b-16cd-4130-b987-a5acaf70408d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:45.760560 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb461b5b-16cd-4130-b987-a5acaf70408d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:45.766207 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0976050-8620-4f36-be32-3e95aac1c62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:45.776937 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0976050-8620-4f36-be32-3e95aac1c62a admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:45.776937 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0976050-8620-4f36-be32-3e95aac1c62a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:45.776937 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0976050-8620-4f36-be32-3e95aac1c62a admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:45.776937 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0976050-8620-4f36-be32-3e95aac1c62a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:45.776937 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0976050-8620-4f36-be32-3e95aac1c62a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:45.788838 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 892/1767] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:45.793484 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a83ee17-3b41-48fc-925e-7cce1bbc68d8 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:45.805286 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a83ee17-3b41-48fc-925e-7cce1bbc68d8 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:45.810023 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ddbf05-cf49-41b1-b417-62efc10a07c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:45.810669 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddbf05-cf49-41b1-b417-62efc10a07c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:45.810947 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddbf05-cf49-41b1-b417-62efc10a07c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:45.811217 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddbf05-cf49-41b1-b417-62efc10a07c0 admin admin] PATH_INFO: `/v3/projects/da57f7dc033a462188fd75f0a04b7522/users/e3598a422e984d42a1f915c4be0c58b0/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:45.828999 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ddbf05-cf49-41b1-b417-62efc10a07c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da57f7dc033a462188fd75f0a04b7522, user_id=e3598a422e984d42a1f915c4be0c58b0, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:45.831937 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ddbf05-cf49-41b1-b417-62efc10a07c0 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:45.849963 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 876/1768] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:25:45 2022] PUT /identity/v3/projects/da57f7dc033a462188fd75f0a04b7522/users/e3598a422e984d42a1f915c4be0c58b0/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:45.852054 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0976050-8620-4f36-be32-3e95aac1c62a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:45.869755 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0976050-8620-4f36-be32-3e95aac1c62a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:45.929651 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68d98c-dccb-472d-a617-76513fe0bb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:45.930430 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68d98c-dccb-472d-a617-76513fe0bb46 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:45.930789 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68d98c-dccb-472d-a617-76513fe0bb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:45.931130 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68d98c-dccb-472d-a617-76513fe0bb46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:45.931826 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68d98c-dccb-472d-a617-76513fe0bb46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:45.933484 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68d98c-dccb-472d-a617-76513fe0bb46 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:45.944695 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 893/1769] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:45.953699 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ddbf05-cf49-41b1-b417-62efc10a07c0 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:45.964890 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ddbf05-cf49-41b1-b417-62efc10a07c0 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:45.970471 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a3d61-6a46-4d19-a8d4-ae318fd17954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:45.971153 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a3d61-6a46-4d19-a8d4-ae318fd17954 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:45.971433 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a3d61-6a46-4d19-a8d4-ae318fd17954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:45.971708 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a3d61-6a46-4d19-a8d4-ae318fd17954 admin admin] PATH_INFO: `/v3/projects/da57f7dc033a462188fd75f0a04b7522/users/e3598a422e984d42a1f915c4be0c58b0/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:45.973758 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a3d61-6a46-4d19-a8d4-ae318fd17954 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da57f7dc033a462188fd75f0a04b7522, user_id=e3598a422e984d42a1f915c4be0c58b0, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:45.976592 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a3d61-6a46-4d19-a8d4-ae318fd17954 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:45.988171 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 877/1770] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:25:45 2022] PUT /identity/v3/projects/da57f7dc033a462188fd75f0a04b7522/users/e3598a422e984d42a1f915c4be0c58b0/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:46.061226 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4095b-b1c8-46f4-82ba-33b21a2d74f2 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:46.061505 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4095b-b1c8-46f4-82ba-33b21a2d74f2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:46.061917 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4095b-b1c8-46f4-82ba-33b21a2d74f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:46.095680 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-5eb4095b-b1c8-46f4-82ba-33b21a2d74f2 None None] MFA Rules not processed for user `e3598a422e984d42a1f915c4be0c58b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:46.096919 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5eb4095b-b1c8-46f4-82ba-33b21a2d74f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:46.129972 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:46.170780 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 894/1771] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:46 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:46.183055 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a3d61-6a46-4d19-a8d4-ae318fd17954 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:46.184779 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2a1a3d61-6a46-4d19-a8d4-ae318fd17954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:46.246873 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a3d61-6a46-4d19-a8d4-ae318fd17954 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:46.250800 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb58276-edc4-48ec-8694-014c09de5957 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:46.251404 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb58276-edc4-48ec-8694-014c09de5957 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:46.251680 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb58276-edc4-48ec-8694-014c09de5957 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:46.251973 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb58276-edc4-48ec-8694-014c09de5957 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:46.305198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:46.308843 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb58276-edc4-48ec-8694-014c09de5957 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:46.310593 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb58276-edc4-48ec-8694-014c09de5957 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:46.320736 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 878/1772] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:25:46.513036 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4095b-b1c8-46f4-82ba-33b21a2d74f2 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:46.514895 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5eb4095b-b1c8-46f4-82ba-33b21a2d74f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:46.632148 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4095b-b1c8-46f4-82ba-33b21a2d74f2 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:46.638259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7fe30-f936-4bb8-9939-fbf4958ef401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:46.640921 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7fe30-f936-4bb8-9939-fbf4958ef401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:46.641224 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7fe30-f936-4bb8-9939-fbf4958ef401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:46.641496 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7fe30-f936-4bb8-9939-fbf4958ef401 admin admin] PATH_INFO: `/v3/users/b8b20948310d4223bb7945d1ed5f2b22` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:46.642861 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7fe30-f936-4bb8-9939-fbf4958ef401 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8b20948310d4223bb7945d1ed5f2b22)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:46.650105 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7fe30-f936-4bb8-9939-fbf4958ef401 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:46.741731 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-26a7fe30-f936-4bb8-9939-fbf4958ef401 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8b20948310d4223bb7945d1ed5f2b22'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:46.742771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-26a7fe30-f936-4bb8-9939-fbf4958ef401 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8b20948310d4223bb7945d1ed5f2b22'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:46.769105 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-26a7fe30-f936-4bb8-9939-fbf4958ef401 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8b20948310d4223bb7945d1ed5f2b22'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:46.794014 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-26a7fe30-f936-4bb8-9939-fbf4958ef401 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8b20948310d4223bb7945d1ed5f2b22'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:46.812078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-26a7fe30-f936-4bb8-9939-fbf4958ef401 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8b20948310d4223bb7945d1ed5f2b22'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:46.819948 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 895/1773] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:25:46 2022] DELETE /identity/v3/users/b8b20948310d4223bb7945d1ed5f2b22 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:46.824501 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5d1b0-ac71-446e-bcb4-50afb9c60003 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:46.824677 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5d1b0-ac71-446e-bcb4-50afb9c60003 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:46.825055 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5d1b0-ac71-446e-bcb4-50afb9c60003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:46.849080 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-8cc5d1b0-ac71-446e-bcb4-50afb9c60003 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:46.850851 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-8cc5d1b0-ac71-446e-bcb4-50afb9c60003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:46.945098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 879/1774] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:25:46.955171 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7fe30-f936-4bb8-9939-fbf4958ef401 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:46.956982 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-26a7fe30-f936-4bb8-9939-fbf4958ef401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:47.022494 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:47.027774 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7fe30-f936-4bb8-9939-fbf4958ef401 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:47.033037 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99aa40-01cd-4c42-882e-4bf6969bad82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:47.033762 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99aa40-01cd-4c42-882e-4bf6969bad82 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:47.034059 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99aa40-01cd-4c42-882e-4bf6969bad82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:47.034326 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99aa40-01cd-4c42-882e-4bf6969bad82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:47.044211 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e99aa40-01cd-4c42-882e-4bf6969bad82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:47.045646 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e99aa40-01cd-4c42-882e-4bf6969bad82 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:47.055650 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 896/1775] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:25:47.321652 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5d1b0-ac71-446e-bcb4-50afb9c60003 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:47.323548 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-8cc5d1b0-ac71-446e-bcb4-50afb9c60003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:47.340710 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5d1b0-ac71-446e-bcb4-50afb9c60003 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:47.348044 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb36d7-a5f9-4d34-a72a-2e2df5588531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:47.348962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb36d7-a5f9-4d34-a72a-2e2df5588531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:47.349187 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb36d7-a5f9-4d34-a72a-2e2df5588531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:47.349417 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb36d7-a5f9-4d34-a72a-2e2df5588531 admin admin] PATH_INFO: `/v3/projects/9ca3d6149f5a4ecc8194da622d754232` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:47.350642 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb36d7-a5f9-4d34-a72a-2e2df5588531 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ca3d6149f5a4ecc8194da622d754232)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:47.352629 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb36d7-a5f9-4d34-a72a-2e2df5588531 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:47.410216 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-bdbb36d7-a5f9-4d34-a72a-2e2df5588531 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ca3d6149f5a4ecc8194da622d754232', 'request_id': 'req-bdbb36d7-a5f9-4d34-a72a-2e2df5588531'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:47.416344 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-bdbb36d7-a5f9-4d34-a72a-2e2df5588531 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ca3d6149f5a4ecc8194da622d754232', 'request_id': 'req-bdbb36d7-a5f9-4d34-a72a-2e2df5588531'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:47.425003 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-bdbb36d7-a5f9-4d34-a72a-2e2df5588531 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ca3d6149f5a4ecc8194da622d754232', 'request_id': 'req-bdbb36d7-a5f9-4d34-a72a-2e2df5588531'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:47.442976 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-bdbb36d7-a5f9-4d34-a72a-2e2df5588531 admin admin] The token cache is being invalidate because project 9ca3d6149f5a4ecc8194da622d754232 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:25:47.442976 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-bdbb36d7-a5f9-4d34-a72a-2e2df5588531 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:47.442976 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-bdbb36d7-a5f9-4d34-a72a-2e2df5588531 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:47.442976 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 880/1776] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:25:47 2022] DELETE /identity/v3/projects/9ca3d6149f5a4ecc8194da622d754232 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:49.035484 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99aa40-01cd-4c42-882e-4bf6969bad82 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:49.036932 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9e99aa40-01cd-4c42-882e-4bf6969bad82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:49.096444 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99aa40-01cd-4c42-882e-4bf6969bad82 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:49.148028 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a864e4-dc5a-41d2-afef-09d7ab549646 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:49.148654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a864e4-dc5a-41d2-afef-09d7ab549646 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:49.148924 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a864e4-dc5a-41d2-afef-09d7ab549646 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:49.149199 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a864e4-dc5a-41d2-afef-09d7ab549646 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:49.150920 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-36a864e4-dc5a-41d2-afef-09d7ab549646 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:49.217071 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a864e4-dc5a-41d2-afef-09d7ab549646 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:49.218739 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a864e4-dc5a-41d2-afef-09d7ab549646 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:49.228115 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 897/1777] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:25:49.800668 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb36d7-a5f9-4d34-a72a-2e2df5588531 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:49.802138 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-bdbb36d7-a5f9-4d34-a72a-2e2df5588531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:49.815338 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb36d7-a5f9-4d34-a72a-2e2df5588531 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:49.818890 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e18386-2b27-4f40-a298-30fe93922e53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:49.819489 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e18386-2b27-4f40-a298-30fe93922e53 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:49.819769 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e18386-2b27-4f40-a298-30fe93922e53 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:49.820077 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e18386-2b27-4f40-a298-30fe93922e53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:49.821764 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a6e18386-2b27-4f40-a298-30fe93922e53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:49.884064 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e18386-2b27-4f40-a298-30fe93922e53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:49.885423 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e18386-2b27-4f40-a298-30fe93922e53 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:49.895343 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 881/1778] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:49 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:25:53.917917 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a864e4-dc5a-41d2-afef-09d7ab549646 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:53.919370 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-36a864e4-dc5a-41d2-afef-09d7ab549646 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:54.026319 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a864e4-dc5a-41d2-afef-09d7ab549646 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:54.034145 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf6fcb-4fc6-4aed-adb8-d01f7a26926d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:54.034974 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf6fcb-4fc6-4aed-adb8-d01f7a26926d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:54.035220 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf6fcb-4fc6-4aed-adb8-d01f7a26926d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:54.035494 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf6fcb-4fc6-4aed-adb8-d01f7a26926d admin admin] PATH_INFO: `/v3/users/0f13f210cd124de09570d34844fd8963` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:54.037065 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf6fcb-4fc6-4aed-adb8-d01f7a26926d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f13f210cd124de09570d34844fd8963)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:54.039000 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf6fcb-4fc6-4aed-adb8-d01f7a26926d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:54.046465 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:54.126130 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-92cf6fcb-4fc6-4aed-adb8-d01f7a26926d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f13f210cd124de09570d34844fd8963'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:54.127278 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-92cf6fcb-4fc6-4aed-adb8-d01f7a26926d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f13f210cd124de09570d34844fd8963'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:54.147859 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-92cf6fcb-4fc6-4aed-adb8-d01f7a26926d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f13f210cd124de09570d34844fd8963'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:54.161434 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-92cf6fcb-4fc6-4aed-adb8-d01f7a26926d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f13f210cd124de09570d34844fd8963'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:54.173074 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-92cf6fcb-4fc6-4aed-adb8-d01f7a26926d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f13f210cd124de09570d34844fd8963'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:54.184610 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 898/1779] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:25:53 2022] DELETE /identity/v3/users/0f13f210cd124de09570d34844fd8963 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:54.191199 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a2c76-13e3-43b0-8811-6cabd337a296 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:54.191715 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a2c76-13e3-43b0-8811-6cabd337a296 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:54.192269 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a2c76-13e3-43b0-8811-6cabd337a296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:54.258011 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-618a2c76-13e3-43b0-8811-6cabd337a296 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:54.259475 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-618a2c76-13e3-43b0-8811-6cabd337a296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:54.272584 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:54.413934 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 882/1780] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:54.428001 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf6fcb-4fc6-4aed-adb8-d01f7a26926d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:54.430990 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-92cf6fcb-4fc6-4aed-adb8-d01f7a26926d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:54.512761 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf6fcb-4fc6-4aed-adb8-d01f7a26926d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:54.516756 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528853d-2de4-49ef-90c0-175c515fdfbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:54.517457 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528853d-2de4-49ef-90c0-175c515fdfbe service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:54.517744 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528853d-2de4-49ef-90c0-175c515fdfbe service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:54.518159 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528853d-2de4-49ef-90c0-175c515fdfbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:54.528639 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1528853d-2de4-49ef-90c0-175c515fdfbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:54.530207 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1528853d-2de4-49ef-90c0-175c515fdfbe service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:54.546080 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 899/1781] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:25:54.976893 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a2c76-13e3-43b0-8811-6cabd337a296 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:54.978324 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-618a2c76-13e3-43b0-8811-6cabd337a296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:54.993576 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a2c76-13e3-43b0-8811-6cabd337a296 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:54.998450 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563ce9a-a1f1-48c6-b38a-9beb548afed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:54.999134 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563ce9a-a1f1-48c6-b38a-9beb548afed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:54.999407 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563ce9a-a1f1-48c6-b38a-9beb548afed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:54.999680 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563ce9a-a1f1-48c6-b38a-9beb548afed4 admin admin] PATH_INFO: `/v3/projects/9495d856894c4db7bb9a7855d5601353` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:55.001785 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563ce9a-a1f1-48c6-b38a-9beb548afed4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9495d856894c4db7bb9a7855d5601353)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:55.003812 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563ce9a-a1f1-48c6-b38a-9beb548afed4 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:55.060851 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c563ce9a-a1f1-48c6-b38a-9beb548afed4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9495d856894c4db7bb9a7855d5601353', 'request_id': 'req-c563ce9a-a1f1-48c6-b38a-9beb548afed4'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:55.068899 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c563ce9a-a1f1-48c6-b38a-9beb548afed4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9495d856894c4db7bb9a7855d5601353', 'request_id': 'req-c563ce9a-a1f1-48c6-b38a-9beb548afed4'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:55.076575 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c563ce9a-a1f1-48c6-b38a-9beb548afed4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9495d856894c4db7bb9a7855d5601353', 'request_id': 'req-c563ce9a-a1f1-48c6-b38a-9beb548afed4'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:55.088629 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c563ce9a-a1f1-48c6-b38a-9beb548afed4 admin admin] The token cache is being invalidate because project 9495d856894c4db7bb9a7855d5601353 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:25:55.088886 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c563ce9a-a1f1-48c6-b38a-9beb548afed4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:55.089590 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c563ce9a-a1f1-48c6-b38a-9beb548afed4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:55.091273 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 883/1782] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:25:54 2022] DELETE /identity/v3/projects/9495d856894c4db7bb9a7855d5601353 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:55.096031 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528853d-2de4-49ef-90c0-175c515fdfbe service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:55.105700 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528853d-2de4-49ef-90c0-175c515fdfbe service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:55.165378 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f548d7-ba65-41e9-a311-5b970320c61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:55.166046 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f548d7-ba65-41e9-a311-5b970320c61c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:55.166333 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f548d7-ba65-41e9-a311-5b970320c61c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:55.166605 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f548d7-ba65-41e9-a311-5b970320c61c admin admin] PATH_INFO: `/v3/users/cf8291f00ede4a4598b796adae1b4510` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:55.168074 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f548d7-ba65-41e9-a311-5b970320c61c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf8291f00ede4a4598b796adae1b4510)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:55.170070 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f548d7-ba65-41e9-a311-5b970320c61c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:55.202619 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:55.232289 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-05f548d7-ba65-41e9-a311-5b970320c61c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf8291f00ede4a4598b796adae1b4510'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:55.232967 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-05f548d7-ba65-41e9-a311-5b970320c61c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf8291f00ede4a4598b796adae1b4510'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:55.245905 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-05f548d7-ba65-41e9-a311-5b970320c61c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf8291f00ede4a4598b796adae1b4510'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:55.253219 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-05f548d7-ba65-41e9-a311-5b970320c61c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf8291f00ede4a4598b796adae1b4510'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:55.260119 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-05f548d7-ba65-41e9-a311-5b970320c61c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf8291f00ede4a4598b796adae1b4510'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:55.266367 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 900/1783] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:25:55 2022] DELETE /identity/v3/users/cf8291f00ede4a4598b796adae1b4510 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:25:55.625463 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563ce9a-a1f1-48c6-b38a-9beb548afed4 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:55.627190 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c563ce9a-a1f1-48c6-b38a-9beb548afed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:55.642407 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563ce9a-a1f1-48c6-b38a-9beb548afed4 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:55.731085 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd96c5-fb64-4299-bfe2-7b3f696425b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:55.731731 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd96c5-fb64-4299-bfe2-7b3f696425b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:55.732064 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd96c5-fb64-4299-bfe2-7b3f696425b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:55.732342 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd96c5-fb64-4299-bfe2-7b3f696425b5 admin admin] PATH_INFO: `/v3/projects/5a20e878d19f438ea6c3b5bcc998df9e` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:55.733634 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd96c5-fb64-4299-bfe2-7b3f696425b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a20e878d19f438ea6c3b5bcc998df9e)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:55.736101 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd96c5-fb64-4299-bfe2-7b3f696425b5 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:55.788697 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:55.801338 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-8ddd96c5-fb64-4299-bfe2-7b3f696425b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a20e878d19f438ea6c3b5bcc998df9e', 'request_id': 'req-8ddd96c5-fb64-4299-bfe2-7b3f696425b5'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:55.807692 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-8ddd96c5-fb64-4299-bfe2-7b3f696425b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a20e878d19f438ea6c3b5bcc998df9e', 'request_id': 'req-8ddd96c5-fb64-4299-bfe2-7b3f696425b5'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:55.816384 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-8ddd96c5-fb64-4299-bfe2-7b3f696425b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a20e878d19f438ea6c3b5bcc998df9e', 'request_id': 'req-8ddd96c5-fb64-4299-bfe2-7b3f696425b5'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:55.827640 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-8ddd96c5-fb64-4299-bfe2-7b3f696425b5 admin admin] The token cache is being invalidate because project 5a20e878d19f438ea6c3b5bcc998df9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:25:55.828596 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-8ddd96c5-fb64-4299-bfe2-7b3f696425b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:55.829312 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-8ddd96c5-fb64-4299-bfe2-7b3f696425b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:55.830879 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 884/1784] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:25:55 2022] DELETE /identity/v3/projects/5a20e878d19f438ea6c3b5bcc998df9e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:55.835129 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f548d7-ba65-41e9-a311-5b970320c61c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:55.837229 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-05f548d7-ba65-41e9-a311-5b970320c61c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:55.853788 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f548d7-ba65-41e9-a311-5b970320c61c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:55.916887 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028285c-7426-4660-8183-a8beadd043cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:55.917783 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028285c-7426-4660-8183-a8beadd043cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:55.918062 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028285c-7426-4660-8183-a8beadd043cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:55.918331 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028285c-7426-4660-8183-a8beadd043cb admin admin] PATH_INFO: `/v3/users/e3598a422e984d42a1f915c4be0c58b0` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:55.919462 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8028285c-7426-4660-8183-a8beadd043cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3598a422e984d42a1f915c4be0c58b0)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:55.921478 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8028285c-7426-4660-8183-a8beadd043cb admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:55.980291 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8028285c-7426-4660-8183-a8beadd043cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3598a422e984d42a1f915c4be0c58b0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:55.980940 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8028285c-7426-4660-8183-a8beadd043cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3598a422e984d42a1f915c4be0c58b0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:55.993603 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8028285c-7426-4660-8183-a8beadd043cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3598a422e984d42a1f915c4be0c58b0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:56.003416 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8028285c-7426-4660-8183-a8beadd043cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3598a422e984d42a1f915c4be0c58b0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:56.011930 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8028285c-7426-4660-8183-a8beadd043cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3598a422e984d42a1f915c4be0c58b0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:56.021347 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 901/1785] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:25:55 2022] DELETE /identity/v3/users/e3598a422e984d42a1f915c4be0c58b0 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:56.324595 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd96c5-fb64-4299-bfe2-7b3f696425b5 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:56.326120 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-8ddd96c5-fb64-4299-bfe2-7b3f696425b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:56.339552 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd96c5-fb64-4299-bfe2-7b3f696425b5 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:56.407988 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7784c0b-9e41-4bd7-85bf-469e7dc5246e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:56.407988 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7784c0b-9e41-4bd7-85bf-469e7dc5246e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:56.407988 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7784c0b-9e41-4bd7-85bf-469e7dc5246e admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:56.407988 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7784c0b-9e41-4bd7-85bf-469e7dc5246e admin admin] PATH_INFO: `/v3/projects/da57f7dc033a462188fd75f0a04b7522` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:56.409099 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7784c0b-9e41-4bd7-85bf-469e7dc5246e admin admin] RBAC: Authorizing `identity:delete_project(project_id=da57f7dc033a462188fd75f0a04b7522)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:56.411273 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7784c0b-9e41-4bd7-85bf-469e7dc5246e admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:56.474533 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f7784c0b-9e41-4bd7-85bf-469e7dc5246e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da57f7dc033a462188fd75f0a04b7522', 'request_id': 'req-f7784c0b-9e41-4bd7-85bf-469e7dc5246e'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:56.480959 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f7784c0b-9e41-4bd7-85bf-469e7dc5246e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da57f7dc033a462188fd75f0a04b7522', 'request_id': 'req-f7784c0b-9e41-4bd7-85bf-469e7dc5246e'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:56.489029 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f7784c0b-9e41-4bd7-85bf-469e7dc5246e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da57f7dc033a462188fd75f0a04b7522', 'request_id': 'req-f7784c0b-9e41-4bd7-85bf-469e7dc5246e'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:56.501243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f7784c0b-9e41-4bd7-85bf-469e7dc5246e admin admin] The token cache is being invalidate because project da57f7dc033a462188fd75f0a04b7522 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:25:56.501617 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f7784c0b-9e41-4bd7-85bf-469e7dc5246e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:56.502344 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f7784c0b-9e41-4bd7-85bf-469e7dc5246e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:56.503990 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 885/1786] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:25:56 2022] DELETE /identity/v3/projects/da57f7dc033a462188fd75f0a04b7522 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:56.508732 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2a109-2367-4539-b6ee-7905effb7d4f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:56.509186 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2a109-2367-4539-b6ee-7905effb7d4f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:56.509541 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2a109-2367-4539-b6ee-7905effb7d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:56.533651 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-2ec2a109-2367-4539-b6ee-7905effb7d4f None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:56.535309 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2ec2a109-2367-4539-b6ee-7905effb7d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:56.549091 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:56.601741 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 902/1787] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:56.611162 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7c4ec-b0e7-4e60-bacf-5c96815913ee None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:56.611452 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7c4ec-b0e7-4e60-bacf-5c96815913ee None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:56.612154 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7c4ec-b0e7-4e60-bacf-5c96815913ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:56.633155 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-a7a7c4ec-b0e7-4e60-bacf-5c96815913ee None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:56.635238 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a7a7c4ec-b0e7-4e60-bacf-5c96815913ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:56.647501 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 886/1788] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:56.648557 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2a109-2367-4539-b6ee-7905effb7d4f None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:56.663039 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2a109-2367-4539-b6ee-7905effb7d4f None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:56.678459 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1cb6c6-8c48-41b5-ba0c-f651ae30b1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:56.679535 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cb6c6-8c48-41b5-ba0c-f651ae30b1d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:56.680002 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cb6c6-8c48-41b5-ba0c-f651ae30b1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:56.680405 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cb6c6-8c48-41b5-ba0c-f651ae30b1d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:56.682416 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1cb6c6-8c48-41b5-ba0c-f651ae30b1d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:25:56.682416 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1cb6c6-8c48-41b5-ba0c-f651ae30b1d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:56.684912 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1cb6c6-8c48-41b5-ba0c-f651ae30b1d5 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:56.701934 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 903/1789] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:25:56.707682 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7c4ec-b0e7-4e60-bacf-5c96815913ee None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:56.722626 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7c4ec-b0e7-4e60-bacf-5c96815913ee None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:56.733329 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19345a3f-283d-4305-a959-01e84e91af49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:56.735499 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19345a3f-283d-4305-a959-01e84e91af49 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:56.736264 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19345a3f-283d-4305-a959-01e84e91af49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:56.736765 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19345a3f-283d-4305-a959-01e84e91af49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:56.737664 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19345a3f-283d-4305-a959-01e84e91af49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:56.739695 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19345a3f-283d-4305-a959-01e84e91af49 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:56.787586 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 887/1790] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:25:56 2022] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:25:56.791939 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1cb6c6-8c48-41b5-ba0c-f651ae30b1d5 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:56.804326 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1cb6c6-8c48-41b5-ba0c-f651ae30b1d5 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:56.877979 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b08b13-c6f1-4ce5-9c4c-84e2d16fa755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:56.878567 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b08b13-c6f1-4ce5-9c4c-84e2d16fa755 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:56.878877 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b08b13-c6f1-4ce5-9c4c-84e2d16fa755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:56.879177 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b08b13-c6f1-4ce5-9c4c-84e2d16fa755 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:56.879825 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b08b13-c6f1-4ce5-9c4c-84e2d16fa755 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:56.882546 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b08b13-c6f1-4ce5-9c4c-84e2d16fa755 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:56.909680 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 904/1791] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:25:56 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:25:56.913568 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19345a3f-283d-4305-a959-01e84e91af49 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:56.924364 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19345a3f-283d-4305-a959-01e84e91af49 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:56.929823 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac40a2c-64c8-4f66-9fb5-b0bf91909304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:56.931393 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac40a2c-64c8-4f66-9fb5-b0bf91909304 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:56.931811 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac40a2c-64c8-4f66-9fb5-b0bf91909304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:56.932205 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac40a2c-64c8-4f66-9fb5-b0bf91909304 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:56.932987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac40a2c-64c8-4f66-9fb5-b0bf91909304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:56.934656 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac40a2c-64c8-4f66-9fb5-b0bf91909304 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:56.951379 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b08b13-c6f1-4ce5-9c4c-84e2d16fa755 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:56.951704 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 888/1792] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:25:56.963225 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b08b13-c6f1-4ce5-9c4c-84e2d16fa755 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:56.968628 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9577a5d-3c9d-453f-94a3-82978e031f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:56.969458 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9577a5d-3c9d-453f-94a3-82978e031f38 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:56.969887 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9577a5d-3c9d-453f-94a3-82978e031f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:56.970334 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9577a5d-3c9d-453f-94a3-82978e031f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:56.971121 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9577a5d-3c9d-453f-94a3-82978e031f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:56.973188 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9577a5d-3c9d-453f-94a3-82978e031f38 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:56.984604 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 905/1793] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:25:56.989312 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac40a2c-64c8-4f66-9fb5-b0bf91909304 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:57.007764 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac40a2c-64c8-4f66-9fb5-b0bf91909304 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:57.013298 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac27f6f-2785-443f-b65f-30bd4c0fdb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:57.014124 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac27f6f-2785-443f-b65f-30bd4c0fdb76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:57.014405 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac27f6f-2785-443f-b65f-30bd4c0fdb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:57.014677 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac27f6f-2785-443f-b65f-30bd4c0fdb76 admin admin] PATH_INFO: `/v3/projects/0d31503f3b3c4c9c96838678feaac366/users/7be7ad0ab28340f9baebbc58da32586d/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:57.028733 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:57.033592 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac27f6f-2785-443f-b65f-30bd4c0fdb76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d31503f3b3c4c9c96838678feaac366, user_id=7be7ad0ab28340f9baebbc58da32586d, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:57.037836 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac27f6f-2785-443f-b65f-30bd4c0fdb76 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:57.060902 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 889/1794] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:25:56 2022] PUT /identity/v3/projects/0d31503f3b3c4c9c96838678feaac366/users/7be7ad0ab28340f9baebbc58da32586d/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:57.073260 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb9755-3e9e-49a6-91de-d8a3bc9fcd78 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:57.073547 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb9755-3e9e-49a6-91de-d8a3bc9fcd78 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:57.073822 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb9755-3e9e-49a6-91de-d8a3bc9fcd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:57.103799 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e6fb9755-3e9e-49a6-91de-d8a3bc9fcd78 None None] MFA Rules not processed for user `7be7ad0ab28340f9baebbc58da32586d`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:57.105067 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e6fb9755-3e9e-49a6-91de-d8a3bc9fcd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:57.193454 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 906/1795] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:57.206128 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac27f6f-2785-443f-b65f-30bd4c0fdb76 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:57.207943 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-7ac27f6f-2785-443f-b65f-30bd4c0fdb76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:57.300215 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac27f6f-2785-443f-b65f-30bd4c0fdb76 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:57.304764 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b20086-92e9-432d-ac88-92833ab9692f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:57.305608 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b20086-92e9-432d-ac88-92833ab9692f service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:57.306075 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b20086-92e9-432d-ac88-92833ab9692f service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:57.306556 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b20086-92e9-432d-ac88-92833ab9692f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:57.316971 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b20086-92e9-432d-ac88-92833ab9692f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:57.318552 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b20086-92e9-432d-ac88-92833ab9692f service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:57.330512 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 890/1796] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:25:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:25:58.847933 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2fc54-fc65-476d-8052-743e75e9cc53 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:58.848451 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2fc54-fc65-476d-8052-743e75e9cc53 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:58.848561 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2fc54-fc65-476d-8052-743e75e9cc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:58.880180 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-eff2fc54-fc65-476d-8052-743e75e9cc53 None None] MFA Rules not processed for user `7be7ad0ab28340f9baebbc58da32586d`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:58.881430 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-eff2fc54-fc65-476d-8052-743e75e9cc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:58.891233 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 907/1797] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:25:59.360136 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b20086-92e9-432d-ac88-92833ab9692f service cinder] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:59.361599 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-21b20086-92e9-432d-ac88-92833ab9692f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:59.441719 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b20086-92e9-432d-ac88-92833ab9692f service cinder] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:59.448164 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f86724c-eead-472e-b865-d01cc4118536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:59.448835 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86724c-eead-472e-b865-d01cc4118536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:59.449111 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86724c-eead-472e-b865-d01cc4118536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:59.449383 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86724c-eead-472e-b865-d01cc4118536 admin admin] PATH_INFO: `/v3/users/5d6160cc258844f9a7f618b635916f23` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:59.450509 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f86724c-eead-472e-b865-d01cc4118536 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d6160cc258844f9a7f618b635916f23)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:59.452464 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f86724c-eead-472e-b865-d01cc4118536 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:59.520243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3f86724c-eead-472e-b865-d01cc4118536 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d6160cc258844f9a7f618b635916f23'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:59.534030 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3f86724c-eead-472e-b865-d01cc4118536 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d6160cc258844f9a7f618b635916f23'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:59.534919 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3f86724c-eead-472e-b865-d01cc4118536 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d6160cc258844f9a7f618b635916f23'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:59.542887 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3f86724c-eead-472e-b865-d01cc4118536 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d6160cc258844f9a7f618b635916f23'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:59.543517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3f86724c-eead-472e-b865-d01cc4118536 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d6160cc258844f9a7f618b635916f23'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:59.556582 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 891/1798] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:25:59 2022] DELETE /identity/v3/users/5d6160cc258844f9a7f618b635916f23 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:59.770684 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2fc54-fc65-476d-8052-743e75e9cc53 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:25:59.785965 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2fc54-fc65-476d-8052-743e75e9cc53 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:25:59.792904 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:25:59.855330 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda592d-c884-4ebe-95c8-1d328ba0cc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:25:59.856095 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda592d-c884-4ebe-95c8-1d328ba0cc62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:59.856356 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda592d-c884-4ebe-95c8-1d328ba0cc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:59.856545 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda592d-c884-4ebe-95c8-1d328ba0cc62 admin admin] PATH_INFO: `/v3/projects/6e9dc59beb05479a939094a08481bd23` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:59.857664 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda592d-c884-4ebe-95c8-1d328ba0cc62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e9dc59beb05479a939094a08481bd23)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:25:59.860547 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda592d-c884-4ebe-95c8-1d328ba0cc62 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:25:59.910369 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3dda592d-c884-4ebe-95c8-1d328ba0cc62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e9dc59beb05479a939094a08481bd23', 'request_id': 'req-3dda592d-c884-4ebe-95c8-1d328ba0cc62'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:59.919795 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3dda592d-c884-4ebe-95c8-1d328ba0cc62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e9dc59beb05479a939094a08481bd23', 'request_id': 'req-3dda592d-c884-4ebe-95c8-1d328ba0cc62'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:59.926708 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3dda592d-c884-4ebe-95c8-1d328ba0cc62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e9dc59beb05479a939094a08481bd23', 'request_id': 'req-3dda592d-c884-4ebe-95c8-1d328ba0cc62'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:59.939787 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3dda592d-c884-4ebe-95c8-1d328ba0cc62 admin admin] The token cache is being invalidate because project 6e9dc59beb05479a939094a08481bd23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:25:59.940111 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3dda592d-c884-4ebe-95c8-1d328ba0cc62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:59.940771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3dda592d-c884-4ebe-95c8-1d328ba0cc62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:25:59.942419 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 908/1799] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:25:59 2022] DELETE /identity/v3/projects/6e9dc59beb05479a939094a08481bd23 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:25:59.947434 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339ef31-b7f5-44c3-982f-7f441cb455ea None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:25:59.947727 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339ef31-b7f5-44c3-982f-7f441cb455ea None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:25:59.948041 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339ef31-b7f5-44c3-982f-7f441cb455ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:25:59.969403 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-e339ef31-b7f5-44c3-982f-7f441cb455ea None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:25:59.970925 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-e339ef31-b7f5-44c3-982f-7f441cb455ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:25:59.980716 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:26:00.040969 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 892/1800] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:25:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:26:00.049171 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e6381-1874-46aa-ae7c-bdffff9ca6aa None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:00.049452 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e6381-1874-46aa-ae7c-bdffff9ca6aa None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:00.049738 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e6381-1874-46aa-ae7c-bdffff9ca6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:00.072998 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-6d5e6381-1874-46aa-ae7c-bdffff9ca6aa None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:26:00.074306 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6d5e6381-1874-46aa-ae7c-bdffff9ca6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:00.083692 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 909/1801] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:26:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:26:00.088045 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339ef31-b7f5-44c3-982f-7f441cb455ea None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:00.100913 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339ef31-b7f5-44c3-982f-7f441cb455ea None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:00.106954 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43103731-2743-46c5-8ffc-7e116cc7bf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:00.107675 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43103731-2743-46c5-8ffc-7e116cc7bf3b admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:00.108143 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43103731-2743-46c5-8ffc-7e116cc7bf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:00.108542 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43103731-2743-46c5-8ffc-7e116cc7bf3b admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:00.110169 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43103731-2743-46c5-8ffc-7e116cc7bf3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:26:00.110617 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43103731-2743-46c5-8ffc-7e116cc7bf3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:00.112468 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43103731-2743-46c5-8ffc-7e116cc7bf3b admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:00.126044 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 893/1802] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:26:00.130564 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e6381-1874-46aa-ae7c-bdffff9ca6aa None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:00.140203 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e6381-1874-46aa-ae7c-bdffff9ca6aa None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:00.145926 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2de8a5-b0e5-469b-9b83-a574c9368502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:00.146588 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2de8a5-b0e5-469b-9b83-a574c9368502 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:00.146841 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2de8a5-b0e5-469b-9b83-a574c9368502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:00.147091 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2de8a5-b0e5-469b-9b83-a574c9368502 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:00.147833 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2de8a5-b0e5-469b-9b83-a574c9368502 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:00.150833 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2de8a5-b0e5-469b-9b83-a574c9368502 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:00.183753 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 910/1803] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:26:00 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:26:00.187870 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43103731-2743-46c5-8ffc-7e116cc7bf3b admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:00.197788 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43103731-2743-46c5-8ffc-7e116cc7bf3b admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:00.259268 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c851f3-0361-4578-8083-72d3fa990050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:00.259878 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c851f3-0361-4578-8083-72d3fa990050 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:00.260191 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c851f3-0361-4578-8083-72d3fa990050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:00.260480 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c851f3-0361-4578-8083-72d3fa990050 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:00.261094 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c851f3-0361-4578-8083-72d3fa990050 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:00.263007 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c851f3-0361-4578-8083-72d3fa990050 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:00.291516 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 894/1804] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:26:00 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:26:00.295007 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2de8a5-b0e5-469b-9b83-a574c9368502 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:00.305864 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2de8a5-b0e5-469b-9b83-a574c9368502 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:00.310495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897237ad-883e-4c01-8fd7-1643859cc93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:00.311105 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897237ad-883e-4c01-8fd7-1643859cc93c admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:00.311385 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897237ad-883e-4c01-8fd7-1643859cc93c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:00.311657 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897237ad-883e-4c01-8fd7-1643859cc93c admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:00.312377 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897237ad-883e-4c01-8fd7-1643859cc93c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:00.314399 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897237ad-883e-4c01-8fd7-1643859cc93c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:00.328306 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 911/1805] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:26:00.330049 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c851f3-0361-4578-8083-72d3fa990050 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:00.339991 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c851f3-0361-4578-8083-72d3fa990050 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:00.345686 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd8690-5b83-4574-b6cc-376200b1b266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:00.346279 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd8690-5b83-4574-b6cc-376200b1b266 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:00.346558 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd8690-5b83-4574-b6cc-376200b1b266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:00.346832 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd8690-5b83-4574-b6cc-376200b1b266 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:00.347468 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd8690-5b83-4574-b6cc-376200b1b266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:00.349080 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd8690-5b83-4574-b6cc-376200b1b266 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:00.360745 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 895/1806] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:26:00.365043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897237ad-883e-4c01-8fd7-1643859cc93c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:00.375167 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897237ad-883e-4c01-8fd7-1643859cc93c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:00.379966 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471cdaf-63b6-4be4-a3c5-b9414060af1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:00.380924 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471cdaf-63b6-4be4-a3c5-b9414060af1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:00.381287 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471cdaf-63b6-4be4-a3c5-b9414060af1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:00.381715 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471cdaf-63b6-4be4-a3c5-b9414060af1f admin admin] PATH_INFO: `/v3/projects/6506ba22030b443e8ac2a4b7df584642/users/99bbe4f34ab84ef7846e022fe60b2558/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:00.399922 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471cdaf-63b6-4be4-a3c5-b9414060af1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6506ba22030b443e8ac2a4b7df584642, user_id=99bbe4f34ab84ef7846e022fe60b2558, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:00.402887 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471cdaf-63b6-4be4-a3c5-b9414060af1f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:00.417795 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 912/1807] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:26:00 2022] PUT /identity/v3/projects/6506ba22030b443e8ac2a4b7df584642/users/99bbe4f34ab84ef7846e022fe60b2558/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:26:00.428347 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547547ac-7d9b-4c45-96c5-a4f119d43fab None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:00.428634 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547547ac-7d9b-4c45-96c5-a4f119d43fab None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:00.429655 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547547ac-7d9b-4c45-96c5-a4f119d43fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:00.459205 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-547547ac-7d9b-4c45-96c5-a4f119d43fab None None] MFA Rules not processed for user `99bbe4f34ab84ef7846e022fe60b2558`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:26:00.460731 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-547547ac-7d9b-4c45-96c5-a4f119d43fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:00.535080 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 896/1808] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:26:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:26:00.539214 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471cdaf-63b6-4be4-a3c5-b9414060af1f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:00.585054 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:26:00.616427 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471cdaf-63b6-4be4-a3c5-b9414060af1f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:00.622344 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05fbc1-ec79-44f7-b002-205bd2f4b9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:00.623061 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05fbc1-ec79-44f7-b002-205bd2f4b9ec admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:00.623416 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05fbc1-ec79-44f7-b002-205bd2f4b9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:00.623758 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05fbc1-ec79-44f7-b002-205bd2f4b9ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:00.624514 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad05fbc1-ec79-44f7-b002-205bd2f4b9ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:00.626918 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad05fbc1-ec79-44f7-b002-205bd2f4b9ec admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:00.662392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 913/1809] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:26:00 2022] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:26:00.666962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547547ac-7d9b-4c45-96c5-a4f119d43fab None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:00.680789 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547547ac-7d9b-4c45-96c5-a4f119d43fab None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:00.688384 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:26:00.769688 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061ffc5-0a71-4586-98c4-ed5d6a7e711c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:00.770446 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061ffc5-0a71-4586-98c4-ed5d6a7e711c admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:00.770732 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061ffc5-0a71-4586-98c4-ed5d6a7e711c admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:00.771009 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061ffc5-0a71-4586-98c4-ed5d6a7e711c admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:00.771641 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b061ffc5-0a71-4586-98c4-ed5d6a7e711c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:00.773618 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b061ffc5-0a71-4586-98c4-ed5d6a7e711c admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:00.799111 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 897/1810] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:26:00 2022] POST /identity/v3/users => generated 295 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:26:00.803230 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05fbc1-ec79-44f7-b002-205bd2f4b9ec admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:00.814769 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05fbc1-ec79-44f7-b002-205bd2f4b9ec admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:00.819329 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf22858-a810-4f7a-aed3-d2af127634a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:00.819969 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf22858-a810-4f7a-aed3-d2af127634a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:00.820251 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf22858-a810-4f7a-aed3-d2af127634a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:00.820526 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf22858-a810-4f7a-aed3-d2af127634a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:00.821163 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf22858-a810-4f7a-aed3-d2af127634a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:00.822771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf22858-a810-4f7a-aed3-d2af127634a9 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:00.835712 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 914/1811] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:26:00.840357 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061ffc5-0a71-4586-98c4-ed5d6a7e711c admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:00.852142 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061ffc5-0a71-4586-98c4-ed5d6a7e711c admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:00.856554 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65255a-c301-4322-b360-73cd03a887b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:00.857205 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65255a-c301-4322-b360-73cd03a887b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:00.857486 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65255a-c301-4322-b360-73cd03a887b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:00.857761 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65255a-c301-4322-b360-73cd03a887b7 admin admin] PATH_INFO: `/v3/projects/ae724e04902c406a8d6b2343d33c1965/users/687b1e0866a3419997850463262e0da6/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:00.872567 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e65255a-c301-4322-b360-73cd03a887b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae724e04902c406a8d6b2343d33c1965, user_id=687b1e0866a3419997850463262e0da6, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:00.875691 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e65255a-c301-4322-b360-73cd03a887b7 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:00.889178 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 898/1812] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:26:00 2022] PUT /identity/v3/projects/ae724e04902c406a8d6b2343d33c1965/users/687b1e0866a3419997850463262e0da6/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:26:00.893515 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf22858-a810-4f7a-aed3-d2af127634a9 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:00.903436 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf22858-a810-4f7a-aed3-d2af127634a9 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:00.960813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ec7ac-bccf-47da-b025-aa763abbfece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:00.961428 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ec7ac-bccf-47da-b025-aa763abbfece admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:00.961804 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ec7ac-bccf-47da-b025-aa763abbfece admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:00.962088 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ec7ac-bccf-47da-b025-aa763abbfece admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:00.962977 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ec7ac-bccf-47da-b025-aa763abbfece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:00.964894 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ec7ac-bccf-47da-b025-aa763abbfece admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:00.975908 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 915/1813] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:26:00.980012 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65255a-c301-4322-b360-73cd03a887b7 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:00.990179 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65255a-c301-4322-b360-73cd03a887b7 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:00.994683 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50065afb-d814-40d1-be48-948a44162339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:00.995348 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50065afb-d814-40d1-be48-948a44162339 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:00.995631 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50065afb-d814-40d1-be48-948a44162339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:00.995926 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50065afb-d814-40d1-be48-948a44162339 admin admin] PATH_INFO: `/v3/projects/ae724e04902c406a8d6b2343d33c1965/users/687b1e0866a3419997850463262e0da6/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:00.997865 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50065afb-d814-40d1-be48-948a44162339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae724e04902c406a8d6b2343d33c1965, user_id=687b1e0866a3419997850463262e0da6, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:01.000766 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50065afb-d814-40d1-be48-948a44162339 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:01.010673 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 899/1814] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:26:00 2022] PUT /identity/v3/projects/ae724e04902c406a8d6b2343d33c1965/users/687b1e0866a3419997850463262e0da6/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:26:01.022403 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670df335-85f6-4262-b980-639606cc20aa None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:01.022699 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670df335-85f6-4262-b980-639606cc20aa None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:01.023010 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670df335-85f6-4262-b980-639606cc20aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:01.051752 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-670df335-85f6-4262-b980-639606cc20aa None None] MFA Rules not processed for user `687b1e0866a3419997850463262e0da6`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:26:01.053111 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-670df335-85f6-4262-b980-639606cc20aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:01.121592 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 916/1815] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:26:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:26:01.133200 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50065afb-d814-40d1-be48-948a44162339 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:01.134897 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-50065afb-d814-40d1-be48-948a44162339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:01.202242 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50065afb-d814-40d1-be48-948a44162339 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:01.205929 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa0de9-9146-440a-b695-45a6e7e94ea1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:01.206540 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa0de9-9146-440a-b695-45a6e7e94ea1 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:01.206819 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa0de9-9146-440a-b695-45a6e7e94ea1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:01.207093 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa0de9-9146-440a-b695-45a6e7e94ea1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:01.218956 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa0de9-9146-440a-b695-45a6e7e94ea1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:01.220722 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa0de9-9146-440a-b695-45a6e7e94ea1 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:01.231654 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 900/1816] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:26:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:26:01.330797 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670df335-85f6-4262-b980-639606cc20aa None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:01.341267 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670df335-85f6-4262-b980-639606cc20aa None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:01.348602 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f9f572-df14-4169-a063-adc7f32b215c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:01.349381 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9f572-df14-4169-a063-adc7f32b215c service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:01.349669 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9f572-df14-4169-a063-adc7f32b215c service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:01.349949 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9f572-df14-4169-a063-adc7f32b215c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:01.387948 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:26:01.422617 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f9f572-df14-4169-a063-adc7f32b215c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:01.424160 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f9f572-df14-4169-a063-adc7f32b215c service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:01.434007 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 917/1817] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:26:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:26:08.434725 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa0de9-9146-440a-b695-45a6e7e94ea1 service cinder] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:08.506899 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa0de9-9146-440a-b695-45a6e7e94ea1 service cinder] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:08.515409 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728e75a-6577-4a98-82bc-7ca53cd8a8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:08.515409 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728e75a-6577-4a98-82bc-7ca53cd8a8af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:08.515409 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728e75a-6577-4a98-82bc-7ca53cd8a8af admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:08.515409 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728e75a-6577-4a98-82bc-7ca53cd8a8af admin admin] PATH_INFO: `/v3/users/99bbe4f34ab84ef7846e022fe60b2558` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:08.515765 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a728e75a-6577-4a98-82bc-7ca53cd8a8af admin admin] RBAC: Authorizing `identity:delete_user(user_id=99bbe4f34ab84ef7846e022fe60b2558)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:08.516829 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a728e75a-6577-4a98-82bc-7ca53cd8a8af admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:08.521647 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:26:08.565782 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-a728e75a-6577-4a98-82bc-7ca53cd8a8af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99bbe4f34ab84ef7846e022fe60b2558'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:08.577613 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-a728e75a-6577-4a98-82bc-7ca53cd8a8af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99bbe4f34ab84ef7846e022fe60b2558'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:08.578318 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-a728e75a-6577-4a98-82bc-7ca53cd8a8af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99bbe4f34ab84ef7846e022fe60b2558'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:08.585654 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-a728e75a-6577-4a98-82bc-7ca53cd8a8af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99bbe4f34ab84ef7846e022fe60b2558'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:08.586291 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-a728e75a-6577-4a98-82bc-7ca53cd8a8af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99bbe4f34ab84ef7846e022fe60b2558'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:08.598697 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 901/1818] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:26:08 2022] DELETE /identity/v3/users/99bbe4f34ab84ef7846e022fe60b2558 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:26:08.603444 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2467a-15ea-4dbc-9915-3df993834906 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:08.603936 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2467a-15ea-4dbc-9915-3df993834906 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:08.604075 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2467a-15ea-4dbc-9915-3df993834906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:08.624140 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f2c2467a-15ea-4dbc-9915-3df993834906 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:26:08.626055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f2c2467a-15ea-4dbc-9915-3df993834906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:08.689508 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 918/1819] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:26:08.699239 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728e75a-6577-4a98-82bc-7ca53cd8a8af admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:08.700733 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a728e75a-6577-4a98-82bc-7ca53cd8a8af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:08.772080 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728e75a-6577-4a98-82bc-7ca53cd8a8af admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:08.776014 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947a61a-35f6-40b9-a567-e836edfe5310 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:08.776661 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947a61a-35f6-40b9-a567-e836edfe5310 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:08.776936 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947a61a-35f6-40b9-a567-e836edfe5310 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:08.777207 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947a61a-35f6-40b9-a567-e836edfe5310 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:08.787245 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b947a61a-35f6-40b9-a567-e836edfe5310 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:08.788729 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b947a61a-35f6-40b9-a567-e836edfe5310 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:08.799688 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 902/1820] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:26:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:26:09.241712 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2467a-15ea-4dbc-9915-3df993834906 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:09.243518 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f2c2467a-15ea-4dbc-9915-3df993834906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:09.258246 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2467a-15ea-4dbc-9915-3df993834906 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:09.265674 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c1113a-7b7a-49d1-b1ed-b8b884c036ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:09.267770 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1113a-7b7a-49d1-b1ed-b8b884c036ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:09.267996 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1113a-7b7a-49d1-b1ed-b8b884c036ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:09.268410 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1113a-7b7a-49d1-b1ed-b8b884c036ee admin admin] PATH_INFO: `/v3/projects/6506ba22030b443e8ac2a4b7df584642` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:09.269666 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c1113a-7b7a-49d1-b1ed-b8b884c036ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=6506ba22030b443e8ac2a4b7df584642)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:09.271641 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c1113a-7b7a-49d1-b1ed-b8b884c036ee admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:09.326406 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c9c1113a-7b7a-49d1-b1ed-b8b884c036ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6506ba22030b443e8ac2a4b7df584642', 'request_id': 'req-c9c1113a-7b7a-49d1-b1ed-b8b884c036ee'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:09.333397 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c9c1113a-7b7a-49d1-b1ed-b8b884c036ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6506ba22030b443e8ac2a4b7df584642', 'request_id': 'req-c9c1113a-7b7a-49d1-b1ed-b8b884c036ee'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:09.339133 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c9c1113a-7b7a-49d1-b1ed-b8b884c036ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6506ba22030b443e8ac2a4b7df584642', 'request_id': 'req-c9c1113a-7b7a-49d1-b1ed-b8b884c036ee'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:09.351275 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c9c1113a-7b7a-49d1-b1ed-b8b884c036ee admin admin] The token cache is being invalidate because project 6506ba22030b443e8ac2a4b7df584642 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:26:09.351569 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c9c1113a-7b7a-49d1-b1ed-b8b884c036ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:09.352217 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c9c1113a-7b7a-49d1-b1ed-b8b884c036ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:09.353714 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 919/1821] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:26:09 2022] DELETE /identity/v3/projects/6506ba22030b443e8ac2a4b7df584642 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:26:09.357793 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947a61a-35f6-40b9-a567-e836edfe5310 service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:09.367609 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947a61a-35f6-40b9-a567-e836edfe5310 service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:09.425795 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c070a5-aeab-473c-9010-9059399f90e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:09.426416 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c070a5-aeab-473c-9010-9059399f90e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:09.426696 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c070a5-aeab-473c-9010-9059399f90e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:09.426968 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c070a5-aeab-473c-9010-9059399f90e5 admin admin] PATH_INFO: `/v3/users/687b1e0866a3419997850463262e0da6` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:09.428119 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c070a5-aeab-473c-9010-9059399f90e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=687b1e0866a3419997850463262e0da6)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:09.430050 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c070a5-aeab-473c-9010-9059399f90e5 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:09.458911 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:26:09.476420 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-44c070a5-aeab-473c-9010-9059399f90e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '687b1e0866a3419997850463262e0da6'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:09.488105 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-44c070a5-aeab-473c-9010-9059399f90e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '687b1e0866a3419997850463262e0da6'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:09.488754 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-44c070a5-aeab-473c-9010-9059399f90e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '687b1e0866a3419997850463262e0da6'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:09.495529 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-44c070a5-aeab-473c-9010-9059399f90e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '687b1e0866a3419997850463262e0da6'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:09.496176 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-44c070a5-aeab-473c-9010-9059399f90e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '687b1e0866a3419997850463262e0da6'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:09.509601 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 903/1822] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:26:09 2022] DELETE /identity/v3/users/687b1e0866a3419997850463262e0da6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:26:09.549432 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c1113a-7b7a-49d1-b1ed-b8b884c036ee admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:09.550839 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c9c1113a-7b7a-49d1-b1ed-b8b884c036ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:09.565099 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c1113a-7b7a-49d1-b1ed-b8b884c036ee admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:09.617942 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:26:09.629818 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db3b10-5943-4cfd-b15d-45d58225113d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:09.630444 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db3b10-5943-4cfd-b15d-45d58225113d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:09.630776 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db3b10-5943-4cfd-b15d-45d58225113d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:09.631054 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db3b10-5943-4cfd-b15d-45d58225113d admin admin] PATH_INFO: `/v3/users/51a42e88d7124066a9a2ebe41b60a6ea` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:09.632230 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db3b10-5943-4cfd-b15d-45d58225113d admin admin] RBAC: Authorizing `identity:delete_user(user_id=51a42e88d7124066a9a2ebe41b60a6ea)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:09.634184 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db3b10-5943-4cfd-b15d-45d58225113d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:09.695482 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-79db3b10-5943-4cfd-b15d-45d58225113d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51a42e88d7124066a9a2ebe41b60a6ea'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:09.696170 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-79db3b10-5943-4cfd-b15d-45d58225113d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51a42e88d7124066a9a2ebe41b60a6ea'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:09.708906 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-79db3b10-5943-4cfd-b15d-45d58225113d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51a42e88d7124066a9a2ebe41b60a6ea'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:09.717249 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-79db3b10-5943-4cfd-b15d-45d58225113d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51a42e88d7124066a9a2ebe41b60a6ea'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:09.730942 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-79db3b10-5943-4cfd-b15d-45d58225113d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51a42e88d7124066a9a2ebe41b60a6ea'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:09.738148 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 920/1823] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:26:09 2022] DELETE /identity/v3/users/51a42e88d7124066a9a2ebe41b60a6ea => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:26:09.742583 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2f63b-d7bf-4f11-abf8-9e2d4bea5a9d None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:09.742944 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2f63b-d7bf-4f11-abf8-9e2d4bea5a9d None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:09.743289 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2f63b-d7bf-4f11-abf8-9e2d4bea5a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:09.765697 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-8ea2f63b-d7bf-4f11-abf8-9e2d4bea5a9d None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:26:09.767507 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-8ea2f63b-d7bf-4f11-abf8-9e2d4bea5a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:09.807631 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db3b10-5943-4cfd-b15d-45d58225113d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:09.809153 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-79db3b10-5943-4cfd-b15d-45d58225113d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:09.834256 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 904/1824] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:26:09.845014 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2f63b-d7bf-4f11-abf8-9e2d4bea5a9d None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:09.846421 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-8ea2f63b-d7bf-4f11-abf8-9e2d4bea5a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:09.885772 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db3b10-5943-4cfd-b15d-45d58225113d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:09.891255 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6a453-6e54-4613-bea5-712096d680b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:09.892034 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6a453-6e54-4613-bea5-712096d680b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:09.892299 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6a453-6e54-4613-bea5-712096d680b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:09.892580 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6a453-6e54-4613-bea5-712096d680b4 admin admin] PATH_INFO: `/v3/projects/ae724e04902c406a8d6b2343d33c1965` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:09.893726 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc6a453-6e54-4613-bea5-712096d680b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae724e04902c406a8d6b2343d33c1965)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:09.895635 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc6a453-6e54-4613-bea5-712096d680b4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:09.904443 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2f63b-d7bf-4f11-abf8-9e2d4bea5a9d None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:09.908959 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60809eda-4e88-40af-8ad8-bcc19203926e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:09.909572 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60809eda-4e88-40af-8ad8-bcc19203926e service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:09.909851 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60809eda-4e88-40af-8ad8-bcc19203926e service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:09.910126 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60809eda-4e88-40af-8ad8-bcc19203926e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:09.919530 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60809eda-4e88-40af-8ad8-bcc19203926e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:09.921030 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60809eda-4e88-40af-8ad8-bcc19203926e service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:09.931359 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 905/1825] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:26:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:26:09.944598 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9cc6a453-6e54-4613-bea5-712096d680b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae724e04902c406a8d6b2343d33c1965', 'request_id': 'req-9cc6a453-6e54-4613-bea5-712096d680b4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:09.952237 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9cc6a453-6e54-4613-bea5-712096d680b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae724e04902c406a8d6b2343d33c1965', 'request_id': 'req-9cc6a453-6e54-4613-bea5-712096d680b4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:09.958771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9cc6a453-6e54-4613-bea5-712096d680b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae724e04902c406a8d6b2343d33c1965', 'request_id': 'req-9cc6a453-6e54-4613-bea5-712096d680b4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:09.971385 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9cc6a453-6e54-4613-bea5-712096d680b4 admin admin] The token cache is being invalidate because project ae724e04902c406a8d6b2343d33c1965 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:26:09.971687 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9cc6a453-6e54-4613-bea5-712096d680b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:09.972367 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9cc6a453-6e54-4613-bea5-712096d680b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:09.977431 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 921/1826] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:26:09 2022] DELETE /identity/v3/projects/ae724e04902c406a8d6b2343d33c1965 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:26:09.979189 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1bf357-49cf-45bc-891d-2cbe99af44ce None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:09.979530 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1bf357-49cf-45bc-891d-2cbe99af44ce None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:09.979812 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1bf357-49cf-45bc-891d-2cbe99af44ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:10.001326 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-fb1bf357-49cf-45bc-891d-2cbe99af44ce None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:26:10.002656 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-fb1bf357-49cf-45bc-891d-2cbe99af44ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:10.054860 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:26:10.076720 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 906/1827] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:26:10.085759 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f76e3-8dce-475c-a791-5898e2dc7167 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:10.086053 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f76e3-8dce-475c-a791-5898e2dc7167 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:10.086329 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f76e3-8dce-475c-a791-5898e2dc7167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:10.094588 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:26:10.107789 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-668f76e3-8dce-475c-a791-5898e2dc7167 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:26:10.110145 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-668f76e3-8dce-475c-a791-5898e2dc7167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:10.118431 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 922/1828] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:26:10.122871 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1bf357-49cf-45bc-891d-2cbe99af44ce None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:10.133667 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1bf357-49cf-45bc-891d-2cbe99af44ce None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:10.138621 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c5e1c-1a41-4414-894a-f902954fa175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:10.139228 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c5e1c-1a41-4414-894a-f902954fa175 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:10.139506 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c5e1c-1a41-4414-894a-f902954fa175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:10.139780 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c5e1c-1a41-4414-894a-f902954fa175 admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:10.141258 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c5e1c-1a41-4414-894a-f902954fa175 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:26:10.141415 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c5e1c-1a41-4414-894a-f902954fa175 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:10.143138 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c5e1c-1a41-4414-894a-f902954fa175 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:10.156270 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 907/1829] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:26:10.160998 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f76e3-8dce-475c-a791-5898e2dc7167 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:10.170608 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f76e3-8dce-475c-a791-5898e2dc7167 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:10.175628 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d35a7-22fd-4722-a185-c2fae5db752d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:10.176270 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d35a7-22fd-4722-a185-c2fae5db752d admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:10.176548 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d35a7-22fd-4722-a185-c2fae5db752d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:10.176821 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d35a7-22fd-4722-a185-c2fae5db752d admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:10.177462 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d35a7-22fd-4722-a185-c2fae5db752d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:10.179341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d35a7-22fd-4722-a185-c2fae5db752d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:10.209466 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 923/1830] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:26:10 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:26:10.217086 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c5e1c-1a41-4414-894a-f902954fa175 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:10.219836 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d35a7-22fd-4722-a185-c2fae5db752d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:10.222865 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-267d35a7-22fd-4722-a185-c2fae5db752d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:10.231154 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c5e1c-1a41-4414-894a-f902954fa175 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:10.308406 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d35a7-22fd-4722-a185-c2fae5db752d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:10.315066 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2bb17-5bfb-46ac-9485-f7d56c0b90f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:10.315559 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2bb17-5bfb-46ac-9485-f7d56c0b90f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:10.315951 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2bb17-5bfb-46ac-9485-f7d56c0b90f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:10.316134 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2bb17-5bfb-46ac-9485-f7d56c0b90f6 admin admin] PATH_INFO: `/v3/projects/aa387a8bda5c42d7b094879670c60c75` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:10.317373 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb2bb17-5bfb-46ac-9485-f7d56c0b90f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa387a8bda5c42d7b094879670c60c75)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:10.319176 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb2bb17-5bfb-46ac-9485-f7d56c0b90f6 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:10.319460 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780feda-b02d-4f74-867f-dd18383df9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:10.320109 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780feda-b02d-4f74-867f-dd18383df9b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:10.321162 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780feda-b02d-4f74-867f-dd18383df9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:10.321437 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780feda-b02d-4f74-867f-dd18383df9b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:10.322169 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780feda-b02d-4f74-867f-dd18383df9b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:10.324302 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780feda-b02d-4f74-867f-dd18383df9b9 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:10.356733 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 908/1831] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:26:10 2022] POST /identity/v3/users => generated 284 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:26:10.360990 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780feda-b02d-4f74-867f-dd18383df9b9 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:10.373236 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780feda-b02d-4f74-867f-dd18383df9b9 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:10.388340 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-eeb2bb17-5bfb-46ac-9485-f7d56c0b90f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa387a8bda5c42d7b094879670c60c75', 'request_id': 'req-eeb2bb17-5bfb-46ac-9485-f7d56c0b90f6'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:10.405640 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-eeb2bb17-5bfb-46ac-9485-f7d56c0b90f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa387a8bda5c42d7b094879670c60c75', 'request_id': 'req-eeb2bb17-5bfb-46ac-9485-f7d56c0b90f6'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:10.412884 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-eeb2bb17-5bfb-46ac-9485-f7d56c0b90f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa387a8bda5c42d7b094879670c60c75', 'request_id': 'req-eeb2bb17-5bfb-46ac-9485-f7d56c0b90f6'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:10.442299 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-eeb2bb17-5bfb-46ac-9485-f7d56c0b90f6 admin admin] The token cache is being invalidate because project aa387a8bda5c42d7b094879670c60c75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:26:10.442745 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-eeb2bb17-5bfb-46ac-9485-f7d56c0b90f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:10.443814 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-eeb2bb17-5bfb-46ac-9485-f7d56c0b90f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:10.449950 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 924/1832] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:26:10 2022] DELETE /identity/v3/projects/aa387a8bda5c42d7b094879670c60c75 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:26:10.450985 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089717e-1730-46df-8da1-429cea2bf302 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:10.451285 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089717e-1730-46df-8da1-429cea2bf302 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:10.451574 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089717e-1730-46df-8da1-429cea2bf302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:10.462420 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5264e4e4-0c20-4fab-9850-f293f1e55a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:10.464400 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264e4e4-0c20-4fab-9850-f293f1e55a81 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:10.464890 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264e4e4-0c20-4fab-9850-f293f1e55a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:10.465989 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264e4e4-0c20-4fab-9850-f293f1e55a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:10.466877 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5264e4e4-0c20-4fab-9850-f293f1e55a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:10.468649 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5264e4e4-0c20-4fab-9850-f293f1e55a81 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:10.472081 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-8089717e-1730-46df-8da1-429cea2bf302 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:26:10.473306 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8089717e-1730-46df-8da1-429cea2bf302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:10.480994 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 909/1833] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:26:10.481643 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 925/1834] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:26:10.485004 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5264e4e4-0c20-4fab-9850-f293f1e55a81 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:10.487106 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-5264e4e4-0c20-4fab-9850-f293f1e55a81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:10.490568 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a0aa8-9c75-4422-b142-8bca1670d13a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:10.490850 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a0aa8-9c75-4422-b142-8bca1670d13a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:10.491123 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a0aa8-9c75-4422-b142-8bca1670d13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:10.500697 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5264e4e4-0c20-4fab-9850-f293f1e55a81 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:10.505946 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bba801-4ffc-4f2e-a709-b8760907e4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:10.506560 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bba801-4ffc-4f2e-a709-b8760907e4e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:10.506840 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bba801-4ffc-4f2e-a709-b8760907e4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:10.507115 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bba801-4ffc-4f2e-a709-b8760907e4e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:10.507760 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bba801-4ffc-4f2e-a709-b8760907e4e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:10.509393 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bba801-4ffc-4f2e-a709-b8760907e4e7 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:10.514553 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a06a0aa8-9c75-4422-b142-8bca1670d13a None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:26:10.516599 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a06a0aa8-9c75-4422-b142-8bca1670d13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:10.520585 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 910/1835] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:26:10.524514 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 926/1836] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:26:10.524710 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bba801-4ffc-4f2e-a709-b8760907e4e7 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:10.528393 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a0aa8-9c75-4422-b142-8bca1670d13a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:10.535120 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bba801-4ffc-4f2e-a709-b8760907e4e7 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:10.537839 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a0aa8-9c75-4422-b142-8bca1670d13a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:10.539637 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18896f5c-7219-4063-b8d7-99656c16106c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:10.540306 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18896f5c-7219-4063-b8d7-99656c16106c admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:10.540583 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18896f5c-7219-4063-b8d7-99656c16106c admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:10.540856 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18896f5c-7219-4063-b8d7-99656c16106c admin admin] PATH_INFO: `/v3/projects/b2caa70a34be41308f60a061f5d932ee/users/0c7dbfefaaa04c2294812efd397704c9/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:10.542788 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a6198-f4b3-47cd-849a-0e6e2063923b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:10.543371 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a6198-f4b3-47cd-849a-0e6e2063923b admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:10.543677 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a6198-f4b3-47cd-849a-0e6e2063923b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:10.544753 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a6198-f4b3-47cd-849a-0e6e2063923b admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:10.544753 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a6198-f4b3-47cd-849a-0e6e2063923b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:26:10.544943 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a6198-f4b3-47cd-849a-0e6e2063923b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:10.546478 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a6198-f4b3-47cd-849a-0e6e2063923b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:10.556861 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18896f5c-7219-4063-b8d7-99656c16106c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2caa70a34be41308f60a061f5d932ee, user_id=0c7dbfefaaa04c2294812efd397704c9, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:10.558866 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 927/1837] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:26:10.559765 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18896f5c-7219-4063-b8d7-99656c16106c admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:10.563149 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a6198-f4b3-47cd-849a-0e6e2063923b admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:10.573433 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 911/1838] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:26:10 2022] PUT /identity/v3/projects/b2caa70a34be41308f60a061f5d932ee/users/0c7dbfefaaa04c2294812efd397704c9/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:26:10.573577 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a6198-f4b3-47cd-849a-0e6e2063923b admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:10.585571 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11782f-704f-4316-8e61-327995c947d6 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:10.585866 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11782f-704f-4316-8e61-327995c947d6 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:10.586135 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11782f-704f-4316-8e61-327995c947d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:10.608950 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:26:10.614665 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-3f11782f-704f-4316-8e61-327995c947d6 None None] MFA Rules not processed for user `0c7dbfefaaa04c2294812efd397704c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:26:10.616200 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-3f11782f-704f-4316-8e61-327995c947d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:10.629640 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:26:10.635362 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cde787-65ee-46aa-9558-2a9fffe8ca7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:10.636232 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cde787-65ee-46aa-9558-2a9fffe8ca7f admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:10.636566 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cde787-65ee-46aa-9558-2a9fffe8ca7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:10.636844 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cde787-65ee-46aa-9558-2a9fffe8ca7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:10.637492 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cde787-65ee-46aa-9558-2a9fffe8ca7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:10.639418 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cde787-65ee-46aa-9558-2a9fffe8ca7f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:10.671459 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 928/1839] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:26:10 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:26:10.672614 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cde787-65ee-46aa-9558-2a9fffe8ca7f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:10.685587 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 912/1840] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:26:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:26:10.690286 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f11782f-704f-4316-8e61-327995c947d6 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:10.700667 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f11782f-704f-4316-8e61-327995c947d6 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:10.744375 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cde787-65ee-46aa-9558-2a9fffe8ca7f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:10.749130 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11cb2a-56d0-4bfe-a88a-f5de19bdaa87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:10.749749 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11cb2a-56d0-4bfe-a88a-f5de19bdaa87 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:10.750029 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11cb2a-56d0-4bfe-a88a-f5de19bdaa87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:10.750924 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11cb2a-56d0-4bfe-a88a-f5de19bdaa87 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:10.751559 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad11cb2a-56d0-4bfe-a88a-f5de19bdaa87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:10.753640 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad11cb2a-56d0-4bfe-a88a-f5de19bdaa87 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:10.760162 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d68b97-ed69-4dcd-a902-4192ae5367af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:10.760773 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d68b97-ed69-4dcd-a902-4192ae5367af admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:10.761050 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d68b97-ed69-4dcd-a902-4192ae5367af admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:10.761320 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d68b97-ed69-4dcd-a902-4192ae5367af admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:10.762143 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d68b97-ed69-4dcd-a902-4192ae5367af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:10.764529 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d68b97-ed69-4dcd-a902-4192ae5367af admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:10.777188 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 929/1841] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:26:10 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:26:10.781267 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11cb2a-56d0-4bfe-a88a-f5de19bdaa87 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:10.792496 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11cb2a-56d0-4bfe-a88a-f5de19bdaa87 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:10.795910 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 913/1842] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:26:10 2022] POST /identity/v3/projects => generated 367 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:26:10.800450 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d68b97-ed69-4dcd-a902-4192ae5367af admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:10.800793 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2c7c3-3362-4022-994b-53f4863ff00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:10.801404 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2c7c3-3362-4022-994b-53f4863ff00d admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:10.801689 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2c7c3-3362-4022-994b-53f4863ff00d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:10.801965 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2c7c3-3362-4022-994b-53f4863ff00d admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:10.802608 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef2c7c3-3362-4022-994b-53f4863ff00d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:10.804229 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef2c7c3-3362-4022-994b-53f4863ff00d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:10.815669 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 930/1843] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:26:10.819506 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2c7c3-3362-4022-994b-53f4863ff00d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:10.829530 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2c7c3-3362-4022-994b-53f4863ff00d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:10.865767 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d68b97-ed69-4dcd-a902-4192ae5367af admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:10.870549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecb47b-f2b3-4053-ba2c-577ec45e515f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:10.871168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecb47b-f2b3-4053-ba2c-577ec45e515f admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:10.871449 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecb47b-f2b3-4053-ba2c-577ec45e515f admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:10.871722 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecb47b-f2b3-4053-ba2c-577ec45e515f admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:10.872504 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddecb47b-f2b3-4053-ba2c-577ec45e515f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:10.874457 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddecb47b-f2b3-4053-ba2c-577ec45e515f admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:10.892601 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cb9e6-eea4-48fd-8faf-8654dab0fe3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:10.893212 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cb9e6-eea4-48fd-8faf-8654dab0fe3e admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:10.893493 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cb9e6-eea4-48fd-8faf-8654dab0fe3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:10.893765 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cb9e6-eea4-48fd-8faf-8654dab0fe3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:10.894401 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448cb9e6-eea4-48fd-8faf-8654dab0fe3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:10.896077 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448cb9e6-eea4-48fd-8faf-8654dab0fe3e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:10.896385 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 914/1844] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:26:10 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:26:10.900294 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecb47b-f2b3-4053-ba2c-577ec45e515f admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:10.907080 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 931/1845] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:26:10.910494 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cb9e6-eea4-48fd-8faf-8654dab0fe3e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:10.911355 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecb47b-f2b3-4053-ba2c-577ec45e515f admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:10.915992 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b368c4-0dd0-45f8-8ce7-6f6991db406c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:10.916616 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b368c4-0dd0-45f8-8ce7-6f6991db406c admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:10.916894 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b368c4-0dd0-45f8-8ce7-6f6991db406c admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:10.917422 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b368c4-0dd0-45f8-8ce7-6f6991db406c admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:10.918055 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b368c4-0dd0-45f8-8ce7-6f6991db406c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:10.919641 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b368c4-0dd0-45f8-8ce7-6f6991db406c admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:10.921601 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cb9e6-eea4-48fd-8faf-8654dab0fe3e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:10.926710 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f2463-3f89-476b-a706-44dfc6466df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:10.927357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f2463-3f89-476b-a706-44dfc6466df7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:10.927635 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f2463-3f89-476b-a706-44dfc6466df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:10.927949 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f2463-3f89-476b-a706-44dfc6466df7 admin admin] PATH_INFO: `/v3/projects/796bc0e51cd24398bb99ece1257c520a/users/3f2b189e97564fa2b11c9ac15d674e07/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:10.931954 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 915/1846] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:26:10.936015 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b368c4-0dd0-45f8-8ce7-6f6991db406c admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:10.944170 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f2463-3f89-476b-a706-44dfc6466df7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=796bc0e51cd24398bb99ece1257c520a, user_id=3f2b189e97564fa2b11c9ac15d674e07, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:10.946235 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b368c4-0dd0-45f8-8ce7-6f6991db406c admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:10.946973 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f2463-3f89-476b-a706-44dfc6466df7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:10.950774 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8955503-2cbb-4973-b2e2-5adbbcdf164b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:10.951472 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8955503-2cbb-4973-b2e2-5adbbcdf164b admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:10.951825 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8955503-2cbb-4973-b2e2-5adbbcdf164b admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:10.952161 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8955503-2cbb-4973-b2e2-5adbbcdf164b admin admin] PATH_INFO: `/v3/projects/98fbff28490e43af970d7dab52ad7d2d/users/d68d3f3293c14024bbe700fbb4c73386/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:10.960100 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 932/1847] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:26:10 2022] PUT /identity/v3/projects/796bc0e51cd24398bb99ece1257c520a/users/3f2b189e97564fa2b11c9ac15d674e07/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:26:10.972694 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc89878-bff0-46a5-87d7-d8185210e5df None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:10.973201 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc89878-bff0-46a5-87d7-d8185210e5df None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:10.973537 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc89878-bff0-46a5-87d7-d8185210e5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:10.978864 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8955503-2cbb-4973-b2e2-5adbbcdf164b admin admin] RBAC: Authorizing `identity:create_grant(project_id=98fbff28490e43af970d7dab52ad7d2d, user_id=d68d3f3293c14024bbe700fbb4c73386, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:10.982353 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8955503-2cbb-4973-b2e2-5adbbcdf164b admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:10.986543 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:26:10.998059 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 916/1848] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:26:10 2022] PUT /identity/v3/projects/98fbff28490e43af970d7dab52ad7d2d/users/d68d3f3293c14024bbe700fbb4c73386/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:26:10.999979 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:26:11.002593 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8955503-2cbb-4973-b2e2-5adbbcdf164b admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:11.004209 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-bbc89878-bff0-46a5-87d7-d8185210e5df None None] MFA Rules not processed for user `3f2b189e97564fa2b11c9ac15d674e07`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:26:11.006121 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-bbc89878-bff0-46a5-87d7-d8185210e5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:11.068240 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8955503-2cbb-4973-b2e2-5adbbcdf164b admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:11.071923 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 933/1849] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:26:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:26:11.072992 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7688a2-de9d-449a-a314-c0ed78dc4ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:11.073600 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7688a2-de9d-449a-a314-c0ed78dc4ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:11.073879 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7688a2-de9d-449a-a314-c0ed78dc4ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:11.074155 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7688a2-de9d-449a-a314-c0ed78dc4ba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:11.074797 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7688a2-de9d-449a-a314-c0ed78dc4ba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:11.076437 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7688a2-de9d-449a-a314-c0ed78dc4ba3 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:11.083334 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc89878-bff0-46a5-87d7-d8185210e5df None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:11.084829 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-bbc89878-bff0-46a5-87d7-d8185210e5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:11.090302 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 917/1850] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:26:11.091188 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7688a2-de9d-449a-a314-c0ed78dc4ba3 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:11.100800 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7688a2-de9d-449a-a314-c0ed78dc4ba3 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:11.105456 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a67af7e-230e-479a-b472-de029e5f0b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:11.106090 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67af7e-230e-479a-b472-de029e5f0b1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:11.106371 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67af7e-230e-479a-b472-de029e5f0b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:11.106649 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67af7e-230e-479a-b472-de029e5f0b1f admin admin] PATH_INFO: `/v3/projects/98fbff28490e43af970d7dab52ad7d2d/users/d68d3f3293c14024bbe700fbb4c73386/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:11.108564 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a67af7e-230e-479a-b472-de029e5f0b1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=98fbff28490e43af970d7dab52ad7d2d, user_id=d68d3f3293c14024bbe700fbb4c73386, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:11.111244 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a67af7e-230e-479a-b472-de029e5f0b1f admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:11.122198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 918/1851] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:26:11 2022] PUT /identity/v3/projects/98fbff28490e43af970d7dab52ad7d2d/users/d68d3f3293c14024bbe700fbb4c73386/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:26:11.132748 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c93d4-e894-4330-a200-93692698352c None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:11.133039 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c93d4-e894-4330-a200-93692698352c None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:11.133325 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c93d4-e894-4330-a200-93692698352c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:11.146346 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc89878-bff0-46a5-87d7-d8185210e5df None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:11.161674 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-994c93d4-e894-4330-a200-93692698352c None None] MFA Rules not processed for user `d68d3f3293c14024bbe700fbb4c73386`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:26:11.162993 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-994c93d4-e894-4330-a200-93692698352c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:11.196801 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9fe96-e8ea-4d82-880e-d5c6208aea48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:11.197330 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9fe96-e8ea-4d82-880e-d5c6208aea48 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:11.197616 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9fe96-e8ea-4d82-880e-d5c6208aea48 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:11.197904 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9fe96-e8ea-4d82-880e-d5c6208aea48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:11.235176 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 919/1852] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:26:11 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:26:11.245922 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c93d4-e894-4330-a200-93692698352c None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:11.247445 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-994c93d4-e894-4330-a200-93692698352c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:11.256127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e9fe96-e8ea-4d82-880e-d5c6208aea48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:11.257562 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e9fe96-e8ea-4d82-880e-d5c6208aea48 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:11.259743 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c93d4-e894-4330-a200-93692698352c None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:11.263580 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68ba5c-5dce-4d9a-b542-4636721686df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:11.264214 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68ba5c-5dce-4d9a-b542-4636721686df service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:11.264496 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68ba5c-5dce-4d9a-b542-4636721686df service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:11.264772 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68ba5c-5dce-4d9a-b542-4636721686df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:11.266934 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 934/1853] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:26:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 13:26:11.276658 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b68ba5c-5dce-4d9a-b542-4636721686df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:11.278099 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b68ba5c-5dce-4d9a-b542-4636721686df service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:11.289019 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 920/1854] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:26:11 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 13:26:12.779545 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9fe96-e8ea-4d82-880e-d5c6208aea48 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:12.801158 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:26:12.870176 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9fe96-e8ea-4d82-880e-d5c6208aea48 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:12.876548 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe73f84-2a82-4680-a761-f3acdc5f38e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:12.877207 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe73f84-2a82-4680-a761-f3acdc5f38e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:12.877611 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe73f84-2a82-4680-a761-f3acdc5f38e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:12.877892 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe73f84-2a82-4680-a761-f3acdc5f38e0 admin admin] PATH_INFO: `/v3/users/0c7dbfefaaa04c2294812efd397704c9` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:12.879085 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe73f84-2a82-4680-a761-f3acdc5f38e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c7dbfefaaa04c2294812efd397704c9)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:12.881032 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe73f84-2a82-4680-a761-f3acdc5f38e0 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:12.944336 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-dfe73f84-2a82-4680-a761-f3acdc5f38e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c7dbfefaaa04c2294812efd397704c9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:12.945033 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-dfe73f84-2a82-4680-a761-f3acdc5f38e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c7dbfefaaa04c2294812efd397704c9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:12.959269 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-dfe73f84-2a82-4680-a761-f3acdc5f38e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c7dbfefaaa04c2294812efd397704c9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:12.966457 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-dfe73f84-2a82-4680-a761-f3acdc5f38e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c7dbfefaaa04c2294812efd397704c9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:12.975466 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-dfe73f84-2a82-4680-a761-f3acdc5f38e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c7dbfefaaa04c2294812efd397704c9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:12.981783 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 935/1855] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:26:12 2022] DELETE /identity/v3/users/0c7dbfefaaa04c2294812efd397704c9 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:26:12.986196 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea622642-4c4f-4263-b365-cf77e51c58fb None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:12.986689 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea622642-4c4f-4263-b365-cf77e51c58fb None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:12.986790 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea622642-4c4f-4263-b365-cf77e51c58fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:13.005790 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-ea622642-4c4f-4263-b365-cf77e51c58fb None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:26:13.006981 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ea622642-4c4f-4263-b365-cf77e51c58fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:13.054306 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:26:13.070947 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 921/1856] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:26:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:26:13.081215 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe73f84-2a82-4680-a761-f3acdc5f38e0 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:13.082631 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-dfe73f84-2a82-4680-a761-f3acdc5f38e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:13.144164 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe73f84-2a82-4680-a761-f3acdc5f38e0 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:13.147958 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c1315-b323-40d0-aaca-5ac504df64ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:13.148571 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c1315-b323-40d0-aaca-5ac504df64ac service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:13.148859 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c1315-b323-40d0-aaca-5ac504df64ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:13.149166 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c1315-b323-40d0-aaca-5ac504df64ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:13.159268 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1c1315-b323-40d0-aaca-5ac504df64ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:13.160842 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1c1315-b323-40d0-aaca-5ac504df64ac service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:13.178492 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 936/1857] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:26:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:26:13.456641 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea622642-4c4f-4263-b365-cf77e51c58fb None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:13.458077 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ea622642-4c4f-4263-b365-cf77e51c58fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:13.470588 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea622642-4c4f-4263-b365-cf77e51c58fb None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:13.475393 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994608d-0f7a-4d1c-a382-6fc651ff4cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:13.476372 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994608d-0f7a-4d1c-a382-6fc651ff4cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:13.476797 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994608d-0f7a-4d1c-a382-6fc651ff4cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:13.477025 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994608d-0f7a-4d1c-a382-6fc651ff4cc8 admin admin] PATH_INFO: `/v3/projects/b2caa70a34be41308f60a061f5d932ee` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:13.478268 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994608d-0f7a-4d1c-a382-6fc651ff4cc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2caa70a34be41308f60a061f5d932ee)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:13.480427 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994608d-0f7a-4d1c-a382-6fc651ff4cc8 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:13.527745 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5994608d-0f7a-4d1c-a382-6fc651ff4cc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2caa70a34be41308f60a061f5d932ee', 'request_id': 'req-5994608d-0f7a-4d1c-a382-6fc651ff4cc8'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:13.535332 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5994608d-0f7a-4d1c-a382-6fc651ff4cc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2caa70a34be41308f60a061f5d932ee', 'request_id': 'req-5994608d-0f7a-4d1c-a382-6fc651ff4cc8'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:13.543077 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5994608d-0f7a-4d1c-a382-6fc651ff4cc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2caa70a34be41308f60a061f5d932ee', 'request_id': 'req-5994608d-0f7a-4d1c-a382-6fc651ff4cc8'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:13.554340 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5994608d-0f7a-4d1c-a382-6fc651ff4cc8 admin admin] The token cache is being invalidate because project b2caa70a34be41308f60a061f5d932ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:26:13.554627 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5994608d-0f7a-4d1c-a382-6fc651ff4cc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:13.555255 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5994608d-0f7a-4d1c-a382-6fc651ff4cc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:13.556768 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 922/1858] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:26:13 2022] DELETE /identity/v3/projects/b2caa70a34be41308f60a061f5d932ee => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:26:13.560903 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c1315-b323-40d0-aaca-5ac504df64ac service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:13.570526 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c1315-b323-40d0-aaca-5ac504df64ac service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:13.604536 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:26:13.630865 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de36f6-bebd-4e26-99dc-7c1bb19ba959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:13.631492 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de36f6-bebd-4e26-99dc-7c1bb19ba959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:13.631768 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de36f6-bebd-4e26-99dc-7c1bb19ba959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:13.632097 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de36f6-bebd-4e26-99dc-7c1bb19ba959 admin admin] PATH_INFO: `/v3/users/d68d3f3293c14024bbe700fbb4c73386` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:13.633191 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62de36f6-bebd-4e26-99dc-7c1bb19ba959 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d68d3f3293c14024bbe700fbb4c73386)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:13.635095 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62de36f6-bebd-4e26-99dc-7c1bb19ba959 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:13.681723 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-62de36f6-bebd-4e26-99dc-7c1bb19ba959 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd68d3f3293c14024bbe700fbb4c73386'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:13.682478 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-62de36f6-bebd-4e26-99dc-7c1bb19ba959 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd68d3f3293c14024bbe700fbb4c73386'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:13.694835 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-62de36f6-bebd-4e26-99dc-7c1bb19ba959 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd68d3f3293c14024bbe700fbb4c73386'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:13.702259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-62de36f6-bebd-4e26-99dc-7c1bb19ba959 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd68d3f3293c14024bbe700fbb4c73386'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:13.710279 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-62de36f6-bebd-4e26-99dc-7c1bb19ba959 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd68d3f3293c14024bbe700fbb4c73386'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:13.716214 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 937/1859] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:26:13 2022] DELETE /identity/v3/users/d68d3f3293c14024bbe700fbb4c73386 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:26:14.013982 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994608d-0f7a-4d1c-a382-6fc651ff4cc8 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:14.015511 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-5994608d-0f7a-4d1c-a382-6fc651ff4cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:14.029470 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994608d-0f7a-4d1c-a382-6fc651ff4cc8 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:14.103771 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc8142-1deb-417d-bc1f-3d8349297e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:14.104890 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc8142-1deb-417d-bc1f-3d8349297e7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:14.105444 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc8142-1deb-417d-bc1f-3d8349297e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:14.105914 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc8142-1deb-417d-bc1f-3d8349297e7f admin admin] PATH_INFO: `/v3/projects/98fbff28490e43af970d7dab52ad7d2d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:14.107607 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc8142-1deb-417d-bc1f-3d8349297e7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=98fbff28490e43af970d7dab52ad7d2d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:14.110824 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc8142-1deb-417d-bc1f-3d8349297e7f admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:14.170586 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-eabc8142-1deb-417d-bc1f-3d8349297e7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98fbff28490e43af970d7dab52ad7d2d', 'request_id': 'req-eabc8142-1deb-417d-bc1f-3d8349297e7f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:14.177780 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-eabc8142-1deb-417d-bc1f-3d8349297e7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98fbff28490e43af970d7dab52ad7d2d', 'request_id': 'req-eabc8142-1deb-417d-bc1f-3d8349297e7f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:14.186200 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-eabc8142-1deb-417d-bc1f-3d8349297e7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98fbff28490e43af970d7dab52ad7d2d', 'request_id': 'req-eabc8142-1deb-417d-bc1f-3d8349297e7f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:14.197590 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-eabc8142-1deb-417d-bc1f-3d8349297e7f admin admin] The token cache is being invalidate because project 98fbff28490e43af970d7dab52ad7d2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:26:14.197882 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-eabc8142-1deb-417d-bc1f-3d8349297e7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:14.198530 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-eabc8142-1deb-417d-bc1f-3d8349297e7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:14.200110 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 923/1860] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:26:14 2022] DELETE /identity/v3/projects/98fbff28490e43af970d7dab52ad7d2d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:26:14.204955 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c0a44-588c-4b25-952a-0ea6bdafb435 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:14.205404 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c0a44-588c-4b25-952a-0ea6bdafb435 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:14.205510 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c0a44-588c-4b25-952a-0ea6bdafb435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:14.226614 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-de2c0a44-588c-4b25-952a-0ea6bdafb435 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:26:14.227885 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-de2c0a44-588c-4b25-952a-0ea6bdafb435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:14.290746 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 938/1861] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:26:14.299856 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b584c7d-9d72-4d7e-aee5-d84fd60b9ea7 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:14.300176 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b584c7d-9d72-4d7e-aee5-d84fd60b9ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:14.300454 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b584c7d-9d72-4d7e-aee5-d84fd60b9ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:14.310120 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:26:14.324107 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-4b584c7d-9d72-4d7e-aee5-d84fd60b9ea7 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:26:14.325381 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-4b584c7d-9d72-4d7e-aee5-d84fd60b9ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:14.334342 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 924/1862] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:26:14.338578 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c0a44-588c-4b25-952a-0ea6bdafb435 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:14.350855 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c0a44-588c-4b25-952a-0ea6bdafb435 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:14.356688 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b50cf4-667e-465c-ab54-56d4ea1f5ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:14.357345 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b50cf4-667e-465c-ab54-56d4ea1f5ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:14.357684 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b50cf4-667e-465c-ab54-56d4ea1f5ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:14.358043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b50cf4-667e-465c-ab54-56d4ea1f5ad2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:14.359134 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b50cf4-667e-465c-ab54-56d4ea1f5ad2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:26:14.359134 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b50cf4-667e-465c-ab54-56d4ea1f5ad2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:14.361815 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b50cf4-667e-465c-ab54-56d4ea1f5ad2 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:14.375991 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 939/1863] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:26:14.379564 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b584c7d-9d72-4d7e-aee5-d84fd60b9ea7 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:14.390634 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b584c7d-9d72-4d7e-aee5-d84fd60b9ea7 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:14.397662 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198fa71-2639-49b0-bf18-b369374120ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:14.398364 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198fa71-2639-49b0-bf18-b369374120ee admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:14.398753 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198fa71-2639-49b0-bf18-b369374120ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:14.399127 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198fa71-2639-49b0-bf18-b369374120ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:14.399868 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0198fa71-2639-49b0-bf18-b369374120ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:14.401896 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0198fa71-2639-49b0-bf18-b369374120ee admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:14.438294 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 925/1864] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:26:14 2022] POST /identity/v3/projects => generated 369 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:26:14.442035 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b50cf4-667e-465c-ab54-56d4ea1f5ad2 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:14.454240 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b50cf4-667e-465c-ab54-56d4ea1f5ad2 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:14.502216 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:26:14.529236 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f298b-6367-4bd9-8ae5-6bc9d9f2bfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:14.529930 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f298b-6367-4bd9-8ae5-6bc9d9f2bfed admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:14.530345 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f298b-6367-4bd9-8ae5-6bc9d9f2bfed admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:14.530627 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f298b-6367-4bd9-8ae5-6bc9d9f2bfed admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:14.531280 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f298b-6367-4bd9-8ae5-6bc9d9f2bfed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:14.533941 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f298b-6367-4bd9-8ae5-6bc9d9f2bfed admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:14.560005 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 940/1865] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:26:14 2022] POST /identity/v3/users => generated 285 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:26:14.564076 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198fa71-2639-49b0-bf18-b369374120ee admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:14.574291 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198fa71-2639-49b0-bf18-b369374120ee admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:14.579436 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050475c-e029-423b-bfc6-21215789b5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:14.580072 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050475c-e029-423b-bfc6-21215789b5cc admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:14.580353 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050475c-e029-423b-bfc6-21215789b5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:14.580623 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050475c-e029-423b-bfc6-21215789b5cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:14.581266 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5050475c-e029-423b-bfc6-21215789b5cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:14.582847 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5050475c-e029-423b-bfc6-21215789b5cc admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:14.593400 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 926/1866] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:26:14.598855 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f298b-6367-4bd9-8ae5-6bc9d9f2bfed admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:14.612716 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f298b-6367-4bd9-8ae5-6bc9d9f2bfed admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:14.618009 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc027a-9460-4b4a-bf96-1962cad923c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:14.618658 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc027a-9460-4b4a-bf96-1962cad923c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:14.618939 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc027a-9460-4b4a-bf96-1962cad923c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:14.619216 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc027a-9460-4b4a-bf96-1962cad923c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:14.620006 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc027a-9460-4b4a-bf96-1962cad923c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:14.621660 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc027a-9460-4b4a-bf96-1962cad923c6 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:14.632638 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 941/1867] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:26:14.636805 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050475c-e029-423b-bfc6-21215789b5cc admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:14.647701 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050475c-e029-423b-bfc6-21215789b5cc admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:14.652344 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde01249-ef33-43c0-837a-ba8eb1e7416e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:14.652987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde01249-ef33-43c0-837a-ba8eb1e7416e admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:14.653265 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde01249-ef33-43c0-837a-ba8eb1e7416e admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:14.653537 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde01249-ef33-43c0-837a-ba8eb1e7416e admin admin] PATH_INFO: `/v3/projects/0874ea4b291d4f78be19a07aef90062c/users/d1a2b4e7385f495ab4c1c1f82600935f/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:14.668861 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde01249-ef33-43c0-837a-ba8eb1e7416e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0874ea4b291d4f78be19a07aef90062c, user_id=d1a2b4e7385f495ab4c1c1f82600935f, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:14.671519 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde01249-ef33-43c0-837a-ba8eb1e7416e admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:14.683799 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 927/1868] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:26:14 2022] PUT /identity/v3/projects/0874ea4b291d4f78be19a07aef90062c/users/d1a2b4e7385f495ab4c1c1f82600935f/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:26:14.689379 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4556dfa-49cb-4fd7-8d3f-8332501e534f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:14.689734 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4556dfa-49cb-4fd7-8d3f-8332501e534f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:14.690076 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4556dfa-49cb-4fd7-8d3f-8332501e534f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:14.709693 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d4556dfa-49cb-4fd7-8d3f-8332501e534f None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:26:14.710901 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d4556dfa-49cb-4fd7-8d3f-8332501e534f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:14.773166 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 942/1869] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:26:14.782713 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde01249-ef33-43c0-837a-ba8eb1e7416e admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:14.784419 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-cde01249-ef33-43c0-837a-ba8eb1e7416e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:14.841826 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde01249-ef33-43c0-837a-ba8eb1e7416e admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:14.845725 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10cfdb-ac2e-470c-afe9-60bdbbc8f450 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:14.846409 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10cfdb-ac2e-470c-afe9-60bdbbc8f450 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:14.846688 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10cfdb-ac2e-470c-afe9-60bdbbc8f450 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:14.846963 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10cfdb-ac2e-470c-afe9-60bdbbc8f450 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:14.856138 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e10cfdb-ac2e-470c-afe9-60bdbbc8f450 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:14.857550 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e10cfdb-ac2e-470c-afe9-60bdbbc8f450 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:14.866945 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 928/1870] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:26:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:26:15.870347 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed6559-ccd8-48de-9c55-a3586f88f9f2 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:15.870896 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed6559-ccd8-48de-9c55-a3586f88f9f2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:15.870896 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed6559-ccd8-48de-9c55-a3586f88f9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:15.907799 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-39ed6559-ccd8-48de-9c55-a3586f88f9f2 None None] MFA Rules not processed for user `d1a2b4e7385f495ab4c1c1f82600935f`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:26:15.910200 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-39ed6559-ccd8-48de-9c55-a3586f88f9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:16.020628 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 943/1871] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:26:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:26:16.025028 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10cfdb-ac2e-470c-afe9-60bdbbc8f450 service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:16.049853 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10cfdb-ac2e-470c-afe9-60bdbbc8f450 service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:16.059656 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb999be-f139-47c9-880b-09b27efbfce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:16.061108 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb999be-f139-47c9-880b-09b27efbfce6 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:16.061831 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb999be-f139-47c9-880b-09b27efbfce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:16.064604 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb999be-f139-47c9-880b-09b27efbfce6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:16.066746 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb999be-f139-47c9-880b-09b27efbfce6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:16.069714 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb999be-f139-47c9-880b-09b27efbfce6 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:16.114247 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 929/1872] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:26:16 2022] POST /identity/v3/projects => generated 373 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:26:16.118465 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed6559-ccd8-48de-9c55-a3586f88f9f2 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:16.132957 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed6559-ccd8-48de-9c55-a3586f88f9f2 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:16.200154 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:26:16.212481 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4a09e-9acb-42a3-b0fc-a522df1b0906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:16.213186 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4a09e-9acb-42a3-b0fc-a522df1b0906 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:16.213475 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4a09e-9acb-42a3-b0fc-a522df1b0906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:16.213849 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4a09e-9acb-42a3-b0fc-a522df1b0906 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:16.214386 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4a09e-9acb-42a3-b0fc-a522df1b0906 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:16.216477 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4a09e-9acb-42a3-b0fc-a522df1b0906 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:16.243952 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 944/1873] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:26:16 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:26:16.246691 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb999be-f139-47c9-880b-09b27efbfce6 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:16.260518 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb999be-f139-47c9-880b-09b27efbfce6 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:16.265219 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fba34-0d90-46bb-869e-c08ca1451340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:16.265900 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fba34-0d90-46bb-869e-c08ca1451340 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:16.266176 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fba34-0d90-46bb-869e-c08ca1451340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:16.266448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fba34-0d90-46bb-869e-c08ca1451340 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:16.267082 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973fba34-0d90-46bb-869e-c08ca1451340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:16.268704 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973fba34-0d90-46bb-869e-c08ca1451340 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:16.279436 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 930/1874] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:26:16.284435 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4a09e-9acb-42a3-b0fc-a522df1b0906 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:16.295739 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4a09e-9acb-42a3-b0fc-a522df1b0906 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:16.301967 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca35ca-8920-40a1-b38a-008cffdd879c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:16.302640 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca35ca-8920-40a1-b38a-008cffdd879c admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:16.302924 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca35ca-8920-40a1-b38a-008cffdd879c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:16.303203 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca35ca-8920-40a1-b38a-008cffdd879c admin admin] PATH_INFO: `/v3/projects/0c0463efd74345bfb46732f0ede0d718/users/b65934b1c654447fb1ff788dde12da51/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:16.319161 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca35ca-8920-40a1-b38a-008cffdd879c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c0463efd74345bfb46732f0ede0d718, user_id=b65934b1c654447fb1ff788dde12da51, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:16.321927 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca35ca-8920-40a1-b38a-008cffdd879c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:16.336481 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 945/1875] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:26:16 2022] PUT /identity/v3/projects/0c0463efd74345bfb46732f0ede0d718/users/b65934b1c654447fb1ff788dde12da51/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:26:16.340801 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fba34-0d90-46bb-869e-c08ca1451340 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:16.351428 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fba34-0d90-46bb-869e-c08ca1451340 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:16.414590 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e441c-6e6e-49c6-9836-0e5254991520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:16.415195 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e441c-6e6e-49c6-9836-0e5254991520 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:16.415469 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e441c-6e6e-49c6-9836-0e5254991520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:16.415736 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e441c-6e6e-49c6-9836-0e5254991520 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:16.416395 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e441c-6e6e-49c6-9836-0e5254991520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:16.418212 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e441c-6e6e-49c6-9836-0e5254991520 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:16.429075 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 931/1876] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:26:16.433247 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca35ca-8920-40a1-b38a-008cffdd879c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:16.444013 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca35ca-8920-40a1-b38a-008cffdd879c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:16.449547 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb77a7-5f48-4b75-9ddc-d10cae1e3b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:16.450703 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb77a7-5f48-4b75-9ddc-d10cae1e3b02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:16.450821 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb77a7-5f48-4b75-9ddc-d10cae1e3b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:16.451234 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb77a7-5f48-4b75-9ddc-d10cae1e3b02 admin admin] PATH_INFO: `/v3/projects/0c0463efd74345bfb46732f0ede0d718/users/b65934b1c654447fb1ff788dde12da51/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:16.453800 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb77a7-5f48-4b75-9ddc-d10cae1e3b02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c0463efd74345bfb46732f0ede0d718, user_id=b65934b1c654447fb1ff788dde12da51, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:16.457158 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb77a7-5f48-4b75-9ddc-d10cae1e3b02 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:16.468191 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 946/1877] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:26:16 2022] PUT /identity/v3/projects/0c0463efd74345bfb46732f0ede0d718/users/b65934b1c654447fb1ff788dde12da51/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:26:16.841408 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e441c-6e6e-49c6-9836-0e5254991520 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:16.843196 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-981e441c-6e6e-49c6-9836-0e5254991520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:16.856549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e441c-6e6e-49c6-9836-0e5254991520 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:16.861113 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:26:16.946288 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b374f-18b4-4ee4-aeea-b16aecb2e619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:16.946805 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b374f-18b4-4ee4-aeea-b16aecb2e619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:16.947082 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b374f-18b4-4ee4-aeea-b16aecb2e619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:16.947354 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b374f-18b4-4ee4-aeea-b16aecb2e619 admin admin] PATH_INFO: `/v3/users/3f2b189e97564fa2b11c9ac15d674e07` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:16.948504 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b374f-18b4-4ee4-aeea-b16aecb2e619 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f2b189e97564fa2b11c9ac15d674e07)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:16.950425 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b374f-18b4-4ee4-aeea-b16aecb2e619 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:17.006471 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-566b374f-18b4-4ee4-aeea-b16aecb2e619 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f2b189e97564fa2b11c9ac15d674e07'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:17.020988 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-566b374f-18b4-4ee4-aeea-b16aecb2e619 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f2b189e97564fa2b11c9ac15d674e07'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:17.021861 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-566b374f-18b4-4ee4-aeea-b16aecb2e619 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f2b189e97564fa2b11c9ac15d674e07'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:17.033130 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-566b374f-18b4-4ee4-aeea-b16aecb2e619 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f2b189e97564fa2b11c9ac15d674e07'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:17.034197 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-566b374f-18b4-4ee4-aeea-b16aecb2e619 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f2b189e97564fa2b11c9ac15d674e07'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:17.057411 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 932/1878] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:26:16 2022] DELETE /identity/v3/users/3f2b189e97564fa2b11c9ac15d674e07 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:26:17.062423 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72532e7c-60f9-4f4e-9fb2-ac9599dbc3fa None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:17.063071 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72532e7c-60f9-4f4e-9fb2-ac9599dbc3fa None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:17.063560 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72532e7c-60f9-4f4e-9fb2-ac9599dbc3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:17.087014 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-72532e7c-60f9-4f4e-9fb2-ac9599dbc3fa None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:26:17.088219 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-72532e7c-60f9-4f4e-9fb2-ac9599dbc3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:17.168039 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 947/1879] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:26:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:26:17.175103 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f7be2-90e1-482a-9b3f-87d83caedeb3 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:17.175431 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72532e7c-60f9-4f4e-9fb2-ac9599dbc3fa None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:17.175775 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f7be2-90e1-482a-9b3f-87d83caedeb3 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:17.176788 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f7be2-90e1-482a-9b3f-87d83caedeb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:17.177137 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-72532e7c-60f9-4f4e-9fb2-ac9599dbc3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:17.209544 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-c50f7be2-90e1-482a-9b3f-87d83caedeb3 None None] MFA Rules not processed for user `b65934b1c654447fb1ff788dde12da51`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:26:17.210679 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c50f7be2-90e1-482a-9b3f-87d83caedeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:17.244562 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72532e7c-60f9-4f4e-9fb2-ac9599dbc3fa None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:17.249337 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d415755-e6b4-43b1-91de-1e4b0af48e30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:17.249953 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d415755-e6b4-43b1-91de-1e4b0af48e30 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:17.250746 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d415755-e6b4-43b1-91de-1e4b0af48e30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:17.251039 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d415755-e6b4-43b1-91de-1e4b0af48e30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:17.261254 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d415755-e6b4-43b1-91de-1e4b0af48e30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:17.262717 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d415755-e6b4-43b1-91de-1e4b0af48e30 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:17.274273 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 948/1880] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:26:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:26:17.304050 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 933/1881] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:26:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:26:17.312235 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed8cf4-b05a-4bae-8d4a-bb0449500236 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:17.312591 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed8cf4-b05a-4bae-8d4a-bb0449500236 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:17.312938 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed8cf4-b05a-4bae-8d4a-bb0449500236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:17.334661 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-15ed8cf4-b05a-4bae-8d4a-bb0449500236 None None] MFA Rules not processed for user `d1a2b4e7385f495ab4c1c1f82600935f`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:26:17.335957 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-15ed8cf4-b05a-4bae-8d4a-bb0449500236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:17.383722 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:26:17.400819 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 949/1882] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:26:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:26:17.412845 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f7be2-90e1-482a-9b3f-87d83caedeb3 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:17.414365 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c50f7be2-90e1-482a-9b3f-87d83caedeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:17.429784 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:26:17.497698 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f7be2-90e1-482a-9b3f-87d83caedeb3 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:17.503268 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed958c-6b72-4d24-aaac-5ef8ebf01d3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:17.503878 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed958c-6b72-4d24-aaac-5ef8ebf01d3b service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:17.504180 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed958c-6b72-4d24-aaac-5ef8ebf01d3b service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:17.504450 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed958c-6b72-4d24-aaac-5ef8ebf01d3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:17.506258 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-28ed958c-6b72-4d24-aaac-5ef8ebf01d3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:17.517131 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed958c-6b72-4d24-aaac-5ef8ebf01d3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:17.518724 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed958c-6b72-4d24-aaac-5ef8ebf01d3b service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:17.527983 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 934/1883] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:26:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:26:17.581478 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed8cf4-b05a-4bae-8d4a-bb0449500236 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:17.582902 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-15ed8cf4-b05a-4bae-8d4a-bb0449500236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:17.602647 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed8cf4-b05a-4bae-8d4a-bb0449500236 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:17.607533 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d7ae9-004c-45f5-8b16-4c49a597c16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:17.608243 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d7ae9-004c-45f5-8b16-4c49a597c16c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:17.608525 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d7ae9-004c-45f5-8b16-4c49a597c16c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:17.608874 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d7ae9-004c-45f5-8b16-4c49a597c16c admin admin] PATH_INFO: `/v3/projects/796bc0e51cd24398bb99ece1257c520a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:17.609969 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d7ae9-004c-45f5-8b16-4c49a597c16c admin admin] RBAC: Authorizing `identity:delete_project(project_id=796bc0e51cd24398bb99ece1257c520a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:17.611944 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d7ae9-004c-45f5-8b16-4c49a597c16c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:17.660427 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-097d7ae9-004c-45f5-8b16-4c49a597c16c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '796bc0e51cd24398bb99ece1257c520a', 'request_id': 'req-097d7ae9-004c-45f5-8b16-4c49a597c16c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:17.669054 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-097d7ae9-004c-45f5-8b16-4c49a597c16c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '796bc0e51cd24398bb99ece1257c520a', 'request_id': 'req-097d7ae9-004c-45f5-8b16-4c49a597c16c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:17.675131 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-097d7ae9-004c-45f5-8b16-4c49a597c16c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '796bc0e51cd24398bb99ece1257c520a', 'request_id': 'req-097d7ae9-004c-45f5-8b16-4c49a597c16c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:17.686670 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-097d7ae9-004c-45f5-8b16-4c49a597c16c admin admin] The token cache is being invalidate because project 796bc0e51cd24398bb99ece1257c520a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:26:17.686961 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-097d7ae9-004c-45f5-8b16-4c49a597c16c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:17.687621 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-097d7ae9-004c-45f5-8b16-4c49a597c16c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:17.689944 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 950/1884] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:26:17 2022] DELETE /identity/v3/projects/796bc0e51cd24398bb99ece1257c520a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:26:17.695241 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3113112-883b-4755-b56d-7de9ea1deb9c None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:17.695528 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3113112-883b-4755-b56d-7de9ea1deb9c None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:17.695809 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3113112-883b-4755-b56d-7de9ea1deb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:17.716293 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-c3113112-883b-4755-b56d-7de9ea1deb9c None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:26:17.717493 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c3113112-883b-4755-b56d-7de9ea1deb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:17.784427 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 935/1885] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:26:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:26:17.791919 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bb2cb-f16e-4647-8063-a011824a7ec5 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:17.792466 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bb2cb-f16e-4647-8063-a011824a7ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:17.792731 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bb2cb-f16e-4647-8063-a011824a7ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:17.813896 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f79bb2cb-f16e-4647-8063-a011824a7ec5 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:26:17.815099 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f79bb2cb-f16e-4647-8063-a011824a7ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:17.823277 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 951/1886] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:26:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:26:17.827477 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3113112-883b-4755-b56d-7de9ea1deb9c None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:17.837784 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3113112-883b-4755-b56d-7de9ea1deb9c None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:17.843392 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec1857-6770-4d31-9eda-187409b0eb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:17.844709 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec1857-6770-4d31-9eda-187409b0eb74 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:17.845092 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec1857-6770-4d31-9eda-187409b0eb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:17.845597 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec1857-6770-4d31-9eda-187409b0eb74 admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:17.846362 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec1857-6770-4d31-9eda-187409b0eb74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:26:17.846769 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec1857-6770-4d31-9eda-187409b0eb74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:17.849743 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec1857-6770-4d31-9eda-187409b0eb74 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:17.873646 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 936/1887] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:26:17.878688 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bb2cb-f16e-4647-8063-a011824a7ec5 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:17.897460 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bb2cb-f16e-4647-8063-a011824a7ec5 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:17.902977 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf733a-4be4-4596-9e58-664a1ffed92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:17.903597 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf733a-4be4-4596-9e58-664a1ffed92d admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:17.903878 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf733a-4be4-4596-9e58-664a1ffed92d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:17.904180 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf733a-4be4-4596-9e58-664a1ffed92d admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:17.904822 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf733a-4be4-4596-9e58-664a1ffed92d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:17.908028 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf733a-4be4-4596-9e58-664a1ffed92d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:17.948503 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 952/1888] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:26:17 2022] POST /identity/v3/projects => generated 369 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:26:17.949886 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec1857-6770-4d31-9eda-187409b0eb74 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:17.961842 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec1857-6770-4d31-9eda-187409b0eb74 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:18.049975 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069e2d0-7dae-4b18-8253-a5e021228210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:18.050619 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069e2d0-7dae-4b18-8253-a5e021228210 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:18.050913 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069e2d0-7dae-4b18-8253-a5e021228210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:18.051166 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069e2d0-7dae-4b18-8253-a5e021228210 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:18.051757 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069e2d0-7dae-4b18-8253-a5e021228210 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:18.054006 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069e2d0-7dae-4b18-8253-a5e021228210 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:18.081725 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 937/1889] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:26:17 2022] POST /identity/v3/users => generated 285 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:26:18.087997 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf733a-4be4-4596-9e58-664a1ffed92d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:18.100256 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf733a-4be4-4596-9e58-664a1ffed92d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:18.105199 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef97246-33ae-4639-8916-16b6bd58a0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:18.105814 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef97246-33ae-4639-8916-16b6bd58a0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:18.106092 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef97246-33ae-4639-8916-16b6bd58a0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:18.106360 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef97246-33ae-4639-8916-16b6bd58a0f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:18.106999 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef97246-33ae-4639-8916-16b6bd58a0f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:18.108614 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef97246-33ae-4639-8916-16b6bd58a0f2 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:18.121521 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 953/1890] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:26:18.126238 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069e2d0-7dae-4b18-8253-a5e021228210 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:18.138471 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069e2d0-7dae-4b18-8253-a5e021228210 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:18.149073 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7ca3a-d726-44d2-9a5c-0d7ea5027b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:18.149778 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7ca3a-d726-44d2-9a5c-0d7ea5027b75 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:18.150152 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7ca3a-d726-44d2-9a5c-0d7ea5027b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:18.150516 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7ca3a-d726-44d2-9a5c-0d7ea5027b75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:18.151256 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7ca3a-d726-44d2-9a5c-0d7ea5027b75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:18.152956 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7ca3a-d726-44d2-9a5c-0d7ea5027b75 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:18.181365 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 938/1891] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:26:18.185276 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef97246-33ae-4639-8916-16b6bd58a0f2 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:18.186804 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821445bd-1da7-4bc7-a8b8-554b4db69feb None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:18.187106 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821445bd-1da7-4bc7-a8b8-554b4db69feb None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:18.188258 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821445bd-1da7-4bc7-a8b8-554b4db69feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:18.197619 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:26:18.200569 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef97246-33ae-4639-8916-16b6bd58a0f2 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:18.212002 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-821445bd-1da7-4bc7-a8b8-554b4db69feb None None] MFA Rules not processed for user `9d5d4691dca848d58bd280d2fad79fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:26:18.213208 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-821445bd-1da7-4bc7-a8b8-554b4db69feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:18.213472 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a43fc34-9975-4be3-91bb-f22ab5f3bd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:18.214208 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43fc34-9975-4be3-91bb-f22ab5f3bd63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:18.214554 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43fc34-9975-4be3-91bb-f22ab5f3bd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:18.214899 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43fc34-9975-4be3-91bb-f22ab5f3bd63 admin admin] PATH_INFO: `/v3/projects/6c58353832814a34acf83e764d6c47eb/users/725385a5802642a6a7aef22e98d36497/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:18.236845 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a43fc34-9975-4be3-91bb-f22ab5f3bd63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c58353832814a34acf83e764d6c47eb, user_id=725385a5802642a6a7aef22e98d36497, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:18.243374 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a43fc34-9975-4be3-91bb-f22ab5f3bd63 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:18.260613 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 954/1892] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:26:18 2022] PUT /identity/v3/projects/6c58353832814a34acf83e764d6c47eb/users/725385a5802642a6a7aef22e98d36497/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:26:18.272872 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071365bb-8a90-4336-9d5c-ba1aa68a64b4 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:18.273555 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071365bb-8a90-4336-9d5c-ba1aa68a64b4 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:18.273833 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071365bb-8a90-4336-9d5c-ba1aa68a64b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:18.279760 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 939/1893] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 25 13:26:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:26:18.304897 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-071365bb-8a90-4336-9d5c-ba1aa68a64b4 None None] MFA Rules not processed for user `725385a5802642a6a7aef22e98d36497`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:26:18.306154 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-071365bb-8a90-4336-9d5c-ba1aa68a64b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:18.327562 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821445bd-1da7-4bc7-a8b8-554b4db69feb None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:18.329514 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-821445bd-1da7-4bc7-a8b8-554b4db69feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:18.379233 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:26:18.384373 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 955/1894] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:26:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:26:18.399659 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071365bb-8a90-4336-9d5c-ba1aa68a64b4 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:18.401179 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-071365bb-8a90-4336-9d5c-ba1aa68a64b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:18.419502 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821445bd-1da7-4bc7-a8b8-554b4db69feb None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:18.472139 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071365bb-8a90-4336-9d5c-ba1aa68a64b4 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:18.476849 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b23a8-e704-464f-bdde-2a1dd253ea99 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f67d808ffb4641b03f96406b3fe9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:18.477694 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b23a8-e704-464f-bdde-2a1dd253ea99 service glance] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:18.478981 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b23a8-e704-464f-bdde-2a1dd253ea99 service glance] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:18.479309 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b23a8-e704-464f-bdde-2a1dd253ea99 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:18.489629 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b23a8-e704-464f-bdde-2a1dd253ea99 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:18.491218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b23a8-e704-464f-bdde-2a1dd253ea99 service glance] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:18.495590 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53594040-8fc3-4b6f-8bb7-4759ecc7cb1d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07413369b0c14e878d04ee528487801d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:18.496353 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53594040-8fc3-4b6f-8bb7-4759ecc7cb1d service swift] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:18.496804 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53594040-8fc3-4b6f-8bb7-4759ecc7cb1d service swift] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:18.497096 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53594040-8fc3-4b6f-8bb7-4759ecc7cb1d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:18.503816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 956/1895] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:26:18 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 13:26:18.555098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:26:18.565394 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53594040-8fc3-4b6f-8bb7-4759ecc7cb1d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:18.566960 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53594040-8fc3-4b6f-8bb7-4759ecc7cb1d service swift] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:18.577068 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 940/1896] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 25 13:26:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 25 13:26:19.204977 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965fb75-0322-421e-8963-cf9d91d74f10 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:19.205458 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965fb75-0322-421e-8963-cf9d91d74f10 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:19.205565 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965fb75-0322-421e-8963-cf9d91d74f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:19.228551 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e965fb75-0322-421e-8963-cf9d91d74f10 None None] MFA Rules not processed for user `9d5d4691dca848d58bd280d2fad79fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:26:19.229757 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e965fb75-0322-421e-8963-cf9d91d74f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:19.237550 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 957/1897] 10.222.0.25 () {58 vars in 967 bytes} [Tue Oct 25 13:26:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:26:19.252128 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53594040-8fc3-4b6f-8bb7-4759ecc7cb1d service swift] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:19.262500 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53594040-8fc3-4b6f-8bb7-4759ecc7cb1d service swift] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:19.267581 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e563b1f-f6dd-4488-b9b0-fb2411aa45fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07413369b0c14e878d04ee528487801d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:19.268218 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e563b1f-f6dd-4488-b9b0-fb2411aa45fa service swift] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:19.268500 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e563b1f-f6dd-4488-b9b0-fb2411aa45fa service swift] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:19.268773 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e563b1f-f6dd-4488-b9b0-fb2411aa45fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:19.278495 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e563b1f-f6dd-4488-b9b0-fb2411aa45fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:19.280140 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e563b1f-f6dd-4488-b9b0-fb2411aa45fa service swift] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:19.289484 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 941/1898] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 25 13:26:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 25 13:26:19.545604 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a3275-d505-418f-a558-c4f139c34292 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:19.545889 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a3275-d505-418f-a558-c4f139c34292 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:19.546161 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a3275-d505-418f-a558-c4f139c34292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:19.566366 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-677a3275-d505-418f-a558-c4f139c34292 None None] MFA Rules not processed for user `9d5d4691dca848d58bd280d2fad79fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:26:19.567704 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-677a3275-d505-418f-a558-c4f139c34292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:19.574942 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 958/1899] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 25 13:26:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:26:19.587353 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e563b1f-f6dd-4488-b9b0-fb2411aa45fa service swift] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:19.598380 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e563b1f-f6dd-4488-b9b0-fb2411aa45fa service swift] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:19.603310 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4ad4f-b4c9-44a3-95d7-938ad81772f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07413369b0c14e878d04ee528487801d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:19.603909 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4ad4f-b4c9-44a3-95d7-938ad81772f2 service swift] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:19.604201 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4ad4f-b4c9-44a3-95d7-938ad81772f2 service swift] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:19.604470 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4ad4f-b4c9-44a3-95d7-938ad81772f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:19.612871 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa4ad4f-b4c9-44a3-95d7-938ad81772f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:19.614759 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa4ad4f-b4c9-44a3-95d7-938ad81772f2 service swift] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:19.624134 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 942/1900] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 25 13:26:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 25 13:26:19.959082 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96b4f4-abbd-489b-ae8b-8092548c7a55 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:19.959372 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96b4f4-abbd-489b-ae8b-8092548c7a55 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:19.959652 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96b4f4-abbd-489b-ae8b-8092548c7a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:19.979603 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-8b96b4f4-abbd-489b-ae8b-8092548c7a55 None None] MFA Rules not processed for user `9d5d4691dca848d58bd280d2fad79fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:26:19.981238 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8b96b4f4-abbd-489b-ae8b-8092548c7a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:19.989427 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 959/1901] 10.222.0.25 () {58 vars in 967 bytes} [Tue Oct 25 13:26:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:26:20.002388 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4ad4f-b4c9-44a3-95d7-938ad81772f2 service swift] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:20.013156 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4ad4f-b4c9-44a3-95d7-938ad81772f2 service swift] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:20.018323 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723cb7d-a9a2-41db-9537-3210b5fdd528 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07413369b0c14e878d04ee528487801d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:20.018924 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723cb7d-a9a2-41db-9537-3210b5fdd528 service swift] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:20.019202 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723cb7d-a9a2-41db-9537-3210b5fdd528 service swift] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:20.019479 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723cb7d-a9a2-41db-9537-3210b5fdd528 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:20.027662 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5723cb7d-a9a2-41db-9537-3210b5fdd528 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:20.029267 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5723cb7d-a9a2-41db-9537-3210b5fdd528 service swift] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:20.044197 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 943/1902] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 25 13:26:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 25 13:26:22.257086 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96b4f4-abbd-489b-ae8b-8092548c7a55 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:22.258517 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8b96b4f4-abbd-489b-ae8b-8092548c7a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:22.327120 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96b4f4-abbd-489b-ae8b-8092548c7a55 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:22.332673 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812c10f-8108-4c1a-a804-aed772ebbfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:22.333306 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812c10f-8108-4c1a-a804-aed772ebbfc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:22.333586 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812c10f-8108-4c1a-a804-aed772ebbfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:22.333858 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812c10f-8108-4c1a-a804-aed772ebbfc6 admin admin] PATH_INFO: `/v3/users/7be7ad0ab28340f9baebbc58da32586d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:22.334996 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812c10f-8108-4c1a-a804-aed772ebbfc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7be7ad0ab28340f9baebbc58da32586d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:22.336955 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812c10f-8108-4c1a-a804-aed772ebbfc6 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:22.383635 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0812c10f-8108-4c1a-a804-aed772ebbfc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7be7ad0ab28340f9baebbc58da32586d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:22.384671 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0812c10f-8108-4c1a-a804-aed772ebbfc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7be7ad0ab28340f9baebbc58da32586d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:22.399181 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0812c10f-8108-4c1a-a804-aed772ebbfc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7be7ad0ab28340f9baebbc58da32586d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:22.406733 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0812c10f-8108-4c1a-a804-aed772ebbfc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7be7ad0ab28340f9baebbc58da32586d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:22.414311 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0812c10f-8108-4c1a-a804-aed772ebbfc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7be7ad0ab28340f9baebbc58da32586d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:22.420981 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 960/1903] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:26:22 2022] DELETE /identity/v3/users/7be7ad0ab28340f9baebbc58da32586d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:26:22.425543 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfefb5a-313e-4c9f-bb4f-5c6af11a22e8 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:22.426020 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfefb5a-313e-4c9f-bb4f-5c6af11a22e8 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:22.426127 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfefb5a-313e-4c9f-bb4f-5c6af11a22e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:22.445704 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-fbfefb5a-313e-4c9f-bb4f-5c6af11a22e8 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:26:22.446875 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-fbfefb5a-313e-4c9f-bb4f-5c6af11a22e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:22.506767 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 944/1904] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:26:22.517300 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812c10f-8108-4c1a-a804-aed772ebbfc6 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:22.518579 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0812c10f-8108-4c1a-a804-aed772ebbfc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:22.523825 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:26:22.584582 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812c10f-8108-4c1a-a804-aed772ebbfc6 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:22.588129 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ec9cf-2251-482e-93f8-4b05d4fd80d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:22.588737 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ec9cf-2251-482e-93f8-4b05d4fd80d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:22.589016 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ec9cf-2251-482e-93f8-4b05d4fd80d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:22.589287 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ec9cf-2251-482e-93f8-4b05d4fd80d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:22.598483 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ec9cf-2251-482e-93f8-4b05d4fd80d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:22.600143 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ec9cf-2251-482e-93f8-4b05d4fd80d3 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:22.611720 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 961/1905] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:26:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 13:26:22.932467 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfefb5a-313e-4c9f-bb4f-5c6af11a22e8 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:22.934059 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-fbfefb5a-313e-4c9f-bb4f-5c6af11a22e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:22.959053 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfefb5a-313e-4c9f-bb4f-5c6af11a22e8 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:22.967920 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb310f7c-0d0d-40b5-b1b5-313169844b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:22.970380 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb310f7c-0d0d-40b5-b1b5-313169844b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:22.970782 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb310f7c-0d0d-40b5-b1b5-313169844b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:22.971148 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb310f7c-0d0d-40b5-b1b5-313169844b33 admin admin] PATH_INFO: `/v3/projects/0d31503f3b3c4c9c96838678feaac366` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:22.973069 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb310f7c-0d0d-40b5-b1b5-313169844b33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d31503f3b3c4c9c96838678feaac366)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:22.976211 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb310f7c-0d0d-40b5-b1b5-313169844b33 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:23.032664 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-eb310f7c-0d0d-40b5-b1b5-313169844b33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d31503f3b3c4c9c96838678feaac366', 'request_id': 'req-eb310f7c-0d0d-40b5-b1b5-313169844b33'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:23.039203 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-eb310f7c-0d0d-40b5-b1b5-313169844b33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d31503f3b3c4c9c96838678feaac366', 'request_id': 'req-eb310f7c-0d0d-40b5-b1b5-313169844b33'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:23.046524 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-eb310f7c-0d0d-40b5-b1b5-313169844b33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d31503f3b3c4c9c96838678feaac366', 'request_id': 'req-eb310f7c-0d0d-40b5-b1b5-313169844b33'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:23.058539 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-eb310f7c-0d0d-40b5-b1b5-313169844b33 admin admin] The token cache is being invalidate because project 0d31503f3b3c4c9c96838678feaac366 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:26:23.058825 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-eb310f7c-0d0d-40b5-b1b5-313169844b33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:23.059488 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-eb310f7c-0d0d-40b5-b1b5-313169844b33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:23.061016 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 945/1906] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:26:22 2022] DELETE /identity/v3/projects/0d31503f3b3c4c9c96838678feaac366 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:26:32.606758 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=25 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:26:33.055644 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:26:38.881605 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ec9cf-2251-482e-93f8-4b05d4fd80d3 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:38.883007 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d84ec9cf-2251-482e-93f8-4b05d4fd80d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:38.940911 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ec9cf-2251-482e-93f8-4b05d4fd80d3 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:38.993275 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ff1cd-dd1c-467b-a8e0-6bf9b4f2bee9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:38.993797 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ff1cd-dd1c-467b-a8e0-6bf9b4f2bee9 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:38.994072 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ff1cd-dd1c-467b-a8e0-6bf9b4f2bee9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:38.994341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ff1cd-dd1c-467b-a8e0-6bf9b4f2bee9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:38.996107 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c48ff1cd-dd1c-467b-a8e0-6bf9b4f2bee9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:39.066063 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ff1cd-dd1c-467b-a8e0-6bf9b4f2bee9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:39.067715 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ff1cd-dd1c-467b-a8e0-6bf9b4f2bee9 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:39.078098 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 962/1907] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:26:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:26:49.073674 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=70 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:26:51.095936 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb310f7c-0d0d-40b5-b1b5-313169844b33 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:51.097386 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-eb310f7c-0d0d-40b5-b1b5-313169844b33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:51.165506 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb310f7c-0d0d-40b5-b1b5-313169844b33 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:51.170248 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63616db5-13fb-41fd-b58d-d354dbd4f840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:51.170868 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63616db5-13fb-41fd-b58d-d354dbd4f840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:51.171146 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63616db5-13fb-41fd-b58d-d354dbd4f840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:51.171414 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63616db5-13fb-41fd-b58d-d354dbd4f840 admin admin] PATH_INFO: `/v3/users/725385a5802642a6a7aef22e98d36497` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:51.172613 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63616db5-13fb-41fd-b58d-d354dbd4f840 admin admin] RBAC: Authorizing `identity:delete_user(user_id=725385a5802642a6a7aef22e98d36497)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:51.175010 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63616db5-13fb-41fd-b58d-d354dbd4f840 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:51.233349 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-63616db5-13fb-41fd-b58d-d354dbd4f840 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '725385a5802642a6a7aef22e98d36497'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:51.248975 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-63616db5-13fb-41fd-b58d-d354dbd4f840 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '725385a5802642a6a7aef22e98d36497'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:51.250076 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-63616db5-13fb-41fd-b58d-d354dbd4f840 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '725385a5802642a6a7aef22e98d36497'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:51.258304 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-63616db5-13fb-41fd-b58d-d354dbd4f840 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '725385a5802642a6a7aef22e98d36497'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:51.258988 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-63616db5-13fb-41fd-b58d-d354dbd4f840 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '725385a5802642a6a7aef22e98d36497'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:51.272683 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 946/1908] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:26:51 2022] DELETE /identity/v3/users/725385a5802642a6a7aef22e98d36497 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:26:51.276863 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031cd326-f4ea-4295-af23-97174e5b61b2 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:51.277321 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031cd326-f4ea-4295-af23-97174e5b61b2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:51.277430 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031cd326-f4ea-4295-af23-97174e5b61b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:51.306203 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-031cd326-f4ea-4295-af23-97174e5b61b2 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:26:51.307542 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-031cd326-f4ea-4295-af23-97174e5b61b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:51.367932 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 963/1909] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:26:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:26:51.378224 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63616db5-13fb-41fd-b58d-d354dbd4f840 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:51.379668 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-63616db5-13fb-41fd-b58d-d354dbd4f840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:51.441383 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63616db5-13fb-41fd-b58d-d354dbd4f840 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:51.445404 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd43a5-f9b2-4968-9e00-04a83da13edf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:51.446087 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd43a5-f9b2-4968-9e00-04a83da13edf service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:51.446370 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd43a5-f9b2-4968-9e00-04a83da13edf service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:51.446833 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd43a5-f9b2-4968-9e00-04a83da13edf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:51.459708 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd43a5-f9b2-4968-9e00-04a83da13edf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:51.462144 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd43a5-f9b2-4968-9e00-04a83da13edf service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:51.473607 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 947/1910] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:26:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:26:51.751871 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031cd326-f4ea-4295-af23-97174e5b61b2 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:26:51.753916 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-031cd326-f4ea-4295-af23-97174e5b61b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:51.766030 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031cd326-f4ea-4295-af23-97174e5b61b2 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:26:51.772145 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dadb7e-0486-4ab8-95e8-d76316535d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:26:51.773007 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dadb7e-0486-4ab8-95e8-d76316535d21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:51.773390 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dadb7e-0486-4ab8-95e8-d76316535d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:51.773712 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dadb7e-0486-4ab8-95e8-d76316535d21 admin admin] PATH_INFO: `/v3/projects/6c58353832814a34acf83e764d6c47eb` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:51.774866 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dadb7e-0486-4ab8-95e8-d76316535d21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c58353832814a34acf83e764d6c47eb)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:26:51.776885 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dadb7e-0486-4ab8-95e8-d76316535d21 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:26:51.824649 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-45dadb7e-0486-4ab8-95e8-d76316535d21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c58353832814a34acf83e764d6c47eb', 'request_id': 'req-45dadb7e-0486-4ab8-95e8-d76316535d21'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:51.833351 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-45dadb7e-0486-4ab8-95e8-d76316535d21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c58353832814a34acf83e764d6c47eb', 'request_id': 'req-45dadb7e-0486-4ab8-95e8-d76316535d21'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:51.838918 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-45dadb7e-0486-4ab8-95e8-d76316535d21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c58353832814a34acf83e764d6c47eb', 'request_id': 'req-45dadb7e-0486-4ab8-95e8-d76316535d21'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:51.850710 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-45dadb7e-0486-4ab8-95e8-d76316535d21 admin admin] The token cache is being invalidate because project 6c58353832814a34acf83e764d6c47eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:26:51.850993 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-45dadb7e-0486-4ab8-95e8-d76316535d21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:51.851610 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-45dadb7e-0486-4ab8-95e8-d76316535d21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:26:51.853103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 964/1911] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:26:51 2022] DELETE /identity/v3/projects/6c58353832814a34acf83e764d6c47eb => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:26:53.854884 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432ae32-4347-4968-ad5d-078e804c0f9c None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:26:53.855414 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432ae32-4347-4968-ad5d-078e804c0f9c None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:26:53.855414 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432ae32-4347-4968-ad5d-078e804c0f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:26:53.874063 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-d432ae32-4347-4968-ad5d-078e804c0f9c None None] MFA Rules not processed for user `04d684ea21984ff699fea2c637044c3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:26:53.875243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-d432ae32-4347-4968-ad5d-078e804c0f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:26:53.892694 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:26:53.931319 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 948/1912] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:26:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:27:01.847600 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:27:02.178851 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b104e94-a090-49ee-8de7-be5a9bbc876a None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:27:02.179141 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b104e94-a090-49ee-8de7-be5a9bbc876a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:27:02.179419 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b104e94-a090-49ee-8de7-be5a9bbc876a None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:27:02.180821 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 965/1913] 10.222.0.25 () {54 vars in 921 bytes} [Tue Oct 25 13:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:27:02.191437 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e5dbb-ca6b-477a-9da7-11711d937be8 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:27:02.192201 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e5dbb-ca6b-477a-9da7-11711d937be8 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:27:02.192357 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e5dbb-ca6b-477a-9da7-11711d937be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:27:02.214158 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-285e5dbb-ca6b-477a-9da7-11711d937be8 None None] MFA Rules not processed for user `f10c161ef74c4a0d809346a5c4b53aa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:27:02.215466 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-285e5dbb-ca6b-477a-9da7-11711d937be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:27:02.286175 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 949/1914] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Oct 25 13:27:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:27:02.298601 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b104e94-a090-49ee-8de7-be5a9bbc876a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:27:02.300422 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3b104e94-a090-49ee-8de7-be5a9bbc876a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:27:02.317531 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b104e94-a090-49ee-8de7-be5a9bbc876a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:27:02.322732 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd11882-37d3-4dff-84a1-d21b0f770933 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f10c161ef74c4a0d809346a5c4b53aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:27:02.323438 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd11882-37d3-4dff-84a1-d21b0f770933 service placement] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:27:02.323779 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd11882-37d3-4dff-84a1-d21b0f770933 service placement] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:27:02.324143 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd11882-37d3-4dff-84a1-d21b0f770933 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:27:02.333362 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd11882-37d3-4dff-84a1-d21b0f770933 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:27:02.335053 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd11882-37d3-4dff-84a1-d21b0f770933 service placement] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:27:02.345242 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 966/1915] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:27:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:27:02.780981 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e5dbb-ca6b-477a-9da7-11711d937be8 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:27:02.782457 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-285e5dbb-ca6b-477a-9da7-11711d937be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:27:02.853783 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e5dbb-ca6b-477a-9da7-11711d937be8 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:27:02.858303 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973539d3-f41d-48f5-b11d-e6db9a88a9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:27:02.858967 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973539d3-f41d-48f5-b11d-e6db9a88a9ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:27:02.859249 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973539d3-f41d-48f5-b11d-e6db9a88a9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:27:02.859526 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973539d3-f41d-48f5-b11d-e6db9a88a9ec admin admin] PATH_INFO: `/v3/users/d1a2b4e7385f495ab4c1c1f82600935f` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:27:02.860846 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973539d3-f41d-48f5-b11d-e6db9a88a9ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1a2b4e7385f495ab4c1c1f82600935f)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:27:02.862877 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973539d3-f41d-48f5-b11d-e6db9a88a9ec admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:27:02.912244 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-973539d3-f41d-48f5-b11d-e6db9a88a9ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1a2b4e7385f495ab4c1c1f82600935f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:27:02.925385 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-973539d3-f41d-48f5-b11d-e6db9a88a9ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1a2b4e7385f495ab4c1c1f82600935f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:27:02.926286 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-973539d3-f41d-48f5-b11d-e6db9a88a9ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1a2b4e7385f495ab4c1c1f82600935f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:27:02.928130 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:27:02.936365 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-973539d3-f41d-48f5-b11d-e6db9a88a9ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1a2b4e7385f495ab4c1c1f82600935f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:27:02.937426 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-973539d3-f41d-48f5-b11d-e6db9a88a9ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1a2b4e7385f495ab4c1c1f82600935f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:27:02.951145 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 950/1916] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:27:02 2022] DELETE /identity/v3/users/d1a2b4e7385f495ab4c1c1f82600935f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:27:03.120541 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd11882-37d3-4dff-84a1-d21b0f770933 service placement] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:27:03.135841 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd11882-37d3-4dff-84a1-d21b0f770933 service placement] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:27:03.195273 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3d8c5-0b69-4553-be2b-a527609a892a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:27:03.195914 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3d8c5-0b69-4553-be2b-a527609a892a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:27:03.196211 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3d8c5-0b69-4553-be2b-a527609a892a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:27:03.196487 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3d8c5-0b69-4553-be2b-a527609a892a admin admin] PATH_INFO: `/v3/projects/0874ea4b291d4f78be19a07aef90062c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:27:03.197598 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c3d8c5-0b69-4553-be2b-a527609a892a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0874ea4b291d4f78be19a07aef90062c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:27:03.199486 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c3d8c5-0b69-4553-be2b-a527609a892a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:27:03.245441 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-44c3d8c5-0b69-4553-be2b-a527609a892a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0874ea4b291d4f78be19a07aef90062c', 'request_id': 'req-44c3d8c5-0b69-4553-be2b-a527609a892a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:27:03.253691 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-44c3d8c5-0b69-4553-be2b-a527609a892a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0874ea4b291d4f78be19a07aef90062c', 'request_id': 'req-44c3d8c5-0b69-4553-be2b-a527609a892a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:27:03.259861 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-44c3d8c5-0b69-4553-be2b-a527609a892a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0874ea4b291d4f78be19a07aef90062c', 'request_id': 'req-44c3d8c5-0b69-4553-be2b-a527609a892a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:27:03.271389 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-44c3d8c5-0b69-4553-be2b-a527609a892a admin admin] The token cache is being invalidate because project 0874ea4b291d4f78be19a07aef90062c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:27:03.271681 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-44c3d8c5-0b69-4553-be2b-a527609a892a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:27:03.272351 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-44c3d8c5-0b69-4553-be2b-a527609a892a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:27:03.273840 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 967/1917] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:27:03 2022] DELETE /identity/v3/projects/0874ea4b291d4f78be19a07aef90062c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:27:03.277732 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973539d3-f41d-48f5-b11d-e6db9a88a9ec admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:27:03.279180 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-973539d3-f41d-48f5-b11d-e6db9a88a9ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:27:03.292616 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973539d3-f41d-48f5-b11d-e6db9a88a9ec admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:27:03.352727 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d4885-b425-4d18-b742-b8b43d4d8bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:27:03.353366 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d4885-b425-4d18-b742-b8b43d4d8bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:27:03.353653 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d4885-b425-4d18-b742-b8b43d4d8bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:27:03.354052 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d4885-b425-4d18-b742-b8b43d4d8bea admin admin] PATH_INFO: `/v3/users/b65934b1c654447fb1ff788dde12da51` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:27:03.355390 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d4885-b425-4d18-b742-b8b43d4d8bea admin admin] RBAC: Authorizing `identity:delete_user(user_id=b65934b1c654447fb1ff788dde12da51)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:27:03.357411 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d4885-b425-4d18-b742-b8b43d4d8bea admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:27:03.413150 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c59d4885-b425-4d18-b742-b8b43d4d8bea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b65934b1c654447fb1ff788dde12da51'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:27:03.430988 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c59d4885-b425-4d18-b742-b8b43d4d8bea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b65934b1c654447fb1ff788dde12da51'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:27:03.431747 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c59d4885-b425-4d18-b742-b8b43d4d8bea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b65934b1c654447fb1ff788dde12da51'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:27:03.440884 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c59d4885-b425-4d18-b742-b8b43d4d8bea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b65934b1c654447fb1ff788dde12da51'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:27:03.441607 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c59d4885-b425-4d18-b742-b8b43d4d8bea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b65934b1c654447fb1ff788dde12da51'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:27:03.454848 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 951/1918] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:27:03 2022] DELETE /identity/v3/users/b65934b1c654447fb1ff788dde12da51 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:27:03.626008 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3d8c5-0b69-4553-be2b-a527609a892a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:27:03.628446 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-44c3d8c5-0b69-4553-be2b-a527609a892a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:27:03.641271 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3d8c5-0b69-4553-be2b-a527609a892a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:27:03.704471 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28bd2a-5533-4fe6-ac34-5165ecbfcb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:27:03.705270 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28bd2a-5533-4fe6-ac34-5165ecbfcb7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:27:03.705650 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28bd2a-5533-4fe6-ac34-5165ecbfcb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:27:03.706021 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28bd2a-5533-4fe6-ac34-5165ecbfcb7f admin admin] PATH_INFO: `/v3/projects/0c0463efd74345bfb46732f0ede0d718` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:27:03.707264 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28bd2a-5533-4fe6-ac34-5165ecbfcb7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c0463efd74345bfb46732f0ede0d718)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:27:03.709284 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28bd2a-5533-4fe6-ac34-5165ecbfcb7f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:27:03.732020 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:27:03.759484 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4c28bd2a-5533-4fe6-ac34-5165ecbfcb7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c0463efd74345bfb46732f0ede0d718', 'request_id': 'req-4c28bd2a-5533-4fe6-ac34-5165ecbfcb7f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:27:03.767375 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4c28bd2a-5533-4fe6-ac34-5165ecbfcb7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c0463efd74345bfb46732f0ede0d718', 'request_id': 'req-4c28bd2a-5533-4fe6-ac34-5165ecbfcb7f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:27:03.773266 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4c28bd2a-5533-4fe6-ac34-5165ecbfcb7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c0463efd74345bfb46732f0ede0d718', 'request_id': 'req-4c28bd2a-5533-4fe6-ac34-5165ecbfcb7f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:27:03.785201 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4c28bd2a-5533-4fe6-ac34-5165ecbfcb7f admin admin] The token cache is being invalidate because project 0c0463efd74345bfb46732f0ede0d718 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:27:03.785520 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4c28bd2a-5533-4fe6-ac34-5165ecbfcb7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:27:03.786170 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4c28bd2a-5533-4fe6-ac34-5165ecbfcb7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:27:03.787672 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 968/1919] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:27:03 2022] DELETE /identity/v3/projects/0c0463efd74345bfb46732f0ede0d718 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:27:03.793834 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9626510-069a-4e75-868f-150f55a8aadc None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:27:03.794128 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9626510-069a-4e75-868f-150f55a8aadc None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:27:03.794423 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9626510-069a-4e75-868f-150f55a8aadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:27:03.814613 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-e9626510-069a-4e75-868f-150f55a8aadc None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:27:03.815802 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-e9626510-069a-4e75-868f-150f55a8aadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:27:03.875631 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 952/1920] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:27:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:27:03.884086 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b59fb8-3934-47fb-a708-f8c703a58afc None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:27:03.884374 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b59fb8-3934-47fb-a708-f8c703a58afc None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:27:03.884648 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b59fb8-3934-47fb-a708-f8c703a58afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:27:03.904123 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a2b59fb8-3934-47fb-a708-f8c703a58afc None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:27:03.905308 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a2b59fb8-3934-47fb-a708-f8c703a58afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:27:03.913154 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 969/1921] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:27:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:27:03.917545 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9626510-069a-4e75-868f-150f55a8aadc None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:27:03.922459 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:27:03.928905 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9626510-069a-4e75-868f-150f55a8aadc None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:27:03.934250 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b18b72-fb94-47b2-90d1-800281f7eaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:27:03.934848 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b18b72-fb94-47b2-90d1-800281f7eaeb admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:27:03.935125 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b18b72-fb94-47b2-90d1-800281f7eaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:27:03.935399 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b18b72-fb94-47b2-90d1-800281f7eaeb admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:27:03.936079 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b18b72-fb94-47b2-90d1-800281f7eaeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:27:03.936383 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b18b72-fb94-47b2-90d1-800281f7eaeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:27:03.937974 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b18b72-fb94-47b2-90d1-800281f7eaeb admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:27:03.950149 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 953/1922] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:27:03.955130 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b59fb8-3934-47fb-a708-f8c703a58afc None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:27:03.964257 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b59fb8-3934-47fb-a708-f8c703a58afc None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:27:03.968801 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb9dd2-d104-4603-9bb6-b59fd1efa998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:27:03.969392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb9dd2-d104-4603-9bb6-b59fd1efa998 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:27:03.969668 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb9dd2-d104-4603-9bb6-b59fd1efa998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:27:03.970399 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb9dd2-d104-4603-9bb6-b59fd1efa998 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:27:03.971054 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb9dd2-d104-4603-9bb6-b59fd1efa998 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:27:03.972980 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb9dd2-d104-4603-9bb6-b59fd1efa998 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:27:04.007023 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 970/1923] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:27:03 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:27:04.008433 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b18b72-fb94-47b2-90d1-800281f7eaeb admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:27:04.019390 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b18b72-fb94-47b2-90d1-800281f7eaeb admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:27:04.080490 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf839f-200b-4802-b42a-8c1eb5b964a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:27:04.081388 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf839f-200b-4802-b42a-8c1eb5b964a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:27:04.081668 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf839f-200b-4802-b42a-8c1eb5b964a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:27:04.081939 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf839f-200b-4802-b42a-8c1eb5b964a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:27:04.082577 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf839f-200b-4802-b42a-8c1eb5b964a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:27:04.084554 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf839f-200b-4802-b42a-8c1eb5b964a0 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:27:04.108938 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 954/1924] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:27:04 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:27:04.114060 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb9dd2-d104-4603-9bb6-b59fd1efa998 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:27:04.124341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb9dd2-d104-4603-9bb6-b59fd1efa998 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:27:04.129837 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896605d1-b645-4a59-ae86-31997fc84edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:27:04.130392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896605d1-b645-4a59-ae86-31997fc84edd admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:27:04.130671 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896605d1-b645-4a59-ae86-31997fc84edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:27:04.130972 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896605d1-b645-4a59-ae86-31997fc84edd admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:27:04.131603 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896605d1-b645-4a59-ae86-31997fc84edd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:27:04.133221 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896605d1-b645-4a59-ae86-31997fc84edd admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:27:04.143558 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 971/1925] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:27:04.147309 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf839f-200b-4802-b42a-8c1eb5b964a0 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:27:04.157086 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf839f-200b-4802-b42a-8c1eb5b964a0 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:27:04.162273 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e5228-d980-44a4-bd6c-863fedbb43ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:27:04.162861 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e5228-d980-44a4-bd6c-863fedbb43ba admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:27:04.163155 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e5228-d980-44a4-bd6c-863fedbb43ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:27:04.163407 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e5228-d980-44a4-bd6c-863fedbb43ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:27:04.164075 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e5228-d980-44a4-bd6c-863fedbb43ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:27:04.165656 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e5228-d980-44a4-bd6c-863fedbb43ba admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:27:04.177913 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 955/1926] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:27:04.181928 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896605d1-b645-4a59-ae86-31997fc84edd admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:27:04.192422 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896605d1-b645-4a59-ae86-31997fc84edd admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:27:04.197041 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2294c25-6425-4f75-aa51-c7a6d1b1f8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:27:04.197690 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2294c25-6425-4f75-aa51-c7a6d1b1f8c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:27:04.197971 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2294c25-6425-4f75-aa51-c7a6d1b1f8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:27:04.198247 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2294c25-6425-4f75-aa51-c7a6d1b1f8c8 admin admin] PATH_INFO: `/v3/projects/f27c41fb6e184674ad8fe5617a786f14/users/e43e27f0f58948f4b1295ee0e370b64a/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:27:04.213315 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2294c25-6425-4f75-aa51-c7a6d1b1f8c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f27c41fb6e184674ad8fe5617a786f14, user_id=e43e27f0f58948f4b1295ee0e370b64a, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:27:04.215982 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2294c25-6425-4f75-aa51-c7a6d1b1f8c8 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:27:04.228697 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 972/1927] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:27:04 2022] PUT /identity/v3/projects/f27c41fb6e184674ad8fe5617a786f14/users/e43e27f0f58948f4b1295ee0e370b64a/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:27:04.239750 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3998af-57cf-4730-ad90-931e9f0b8310 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:27:04.240077 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3998af-57cf-4730-ad90-931e9f0b8310 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:27:04.240357 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3998af-57cf-4730-ad90-931e9f0b8310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:27:04.268125 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-1e3998af-57cf-4730-ad90-931e9f0b8310 None None] MFA Rules not processed for user `e43e27f0f58948f4b1295ee0e370b64a`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:27:04.269325 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-1e3998af-57cf-4730-ad90-931e9f0b8310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:27:04.333631 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 956/1928] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:27:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:27:04.345543 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2294c25-6425-4f75-aa51-c7a6d1b1f8c8 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:27:04.347304 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a2294c25-6425-4f75-aa51-c7a6d1b1f8c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:27:04.403312 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2294c25-6425-4f75-aa51-c7a6d1b1f8c8 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:27:04.406937 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65dafb4-75dc-4d56-ab64-17cb986ef75e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:27:04.408123 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65dafb4-75dc-4d56-ab64-17cb986ef75e service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:27:04.408400 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65dafb4-75dc-4d56-ab64-17cb986ef75e service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:27:04.408671 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65dafb4-75dc-4d56-ab64-17cb986ef75e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:27:04.416753 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65dafb4-75dc-4d56-ab64-17cb986ef75e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:27:04.418413 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65dafb4-75dc-4d56-ab64-17cb986ef75e service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:27:04.427655 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 973/1929] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:27:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:27:14.330713 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=71,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:27:14.422999 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=69,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:27:17.973276 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3998af-57cf-4730-ad90-931e9f0b8310 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:27:18.033822 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3998af-57cf-4730-ad90-931e9f0b8310 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:27:18.038791 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88baf40-289a-457d-96ff-dcbf1a1ef32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:27:18.039465 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88baf40-289a-457d-96ff-dcbf1a1ef32e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:27:18.039747 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88baf40-289a-457d-96ff-dcbf1a1ef32e admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:27:18.040091 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88baf40-289a-457d-96ff-dcbf1a1ef32e admin admin] PATH_INFO: `/v3/users/e43e27f0f58948f4b1295ee0e370b64a` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:27:18.041198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88baf40-289a-457d-96ff-dcbf1a1ef32e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e43e27f0f58948f4b1295ee0e370b64a)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:27:18.043407 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88baf40-289a-457d-96ff-dcbf1a1ef32e admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:27:18.090790 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b88baf40-289a-457d-96ff-dcbf1a1ef32e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e43e27f0f58948f4b1295ee0e370b64a'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:27:18.103286 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b88baf40-289a-457d-96ff-dcbf1a1ef32e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e43e27f0f58948f4b1295ee0e370b64a'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:27:18.103988 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b88baf40-289a-457d-96ff-dcbf1a1ef32e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e43e27f0f58948f4b1295ee0e370b64a'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:27:18.111238 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b88baf40-289a-457d-96ff-dcbf1a1ef32e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e43e27f0f58948f4b1295ee0e370b64a'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:27:18.111868 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b88baf40-289a-457d-96ff-dcbf1a1ef32e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e43e27f0f58948f4b1295ee0e370b64a'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:27:18.125859 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 957/1930] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:27:17 2022] DELETE /identity/v3/users/e43e27f0f58948f4b1295ee0e370b64a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:27:18.131082 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf042e-8c38-4ee7-ad8b-d552f39e61b3 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:27:18.131542 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf042e-8c38-4ee7-ad8b-d552f39e61b3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:27:18.131647 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf042e-8c38-4ee7-ad8b-d552f39e61b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:27:18.150697 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-37cf042e-8c38-4ee7-ad8b-d552f39e61b3 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:27:18.151874 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-37cf042e-8c38-4ee7-ad8b-d552f39e61b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:27:18.210392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 974/1931] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:27:18.220026 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88baf40-289a-457d-96ff-dcbf1a1ef32e admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:27:18.221393 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b88baf40-289a-457d-96ff-dcbf1a1ef32e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:27:18.278233 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88baf40-289a-457d-96ff-dcbf1a1ef32e admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:27:18.281816 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6cc4dc-feaa-4c14-af10-24cccf4604f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:27:18.282445 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6cc4dc-feaa-4c14-af10-24cccf4604f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:27:18.282725 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6cc4dc-feaa-4c14-af10-24cccf4604f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:27:18.282997 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6cc4dc-feaa-4c14-af10-24cccf4604f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:27:18.292818 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6cc4dc-feaa-4c14-af10-24cccf4604f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:27:18.294182 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6cc4dc-feaa-4c14-af10-24cccf4604f9 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:27:18.304161 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 958/1932] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:27:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:27:18.568056 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf042e-8c38-4ee7-ad8b-d552f39e61b3 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:27:18.569540 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-37cf042e-8c38-4ee7-ad8b-d552f39e61b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:27:18.581266 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf042e-8c38-4ee7-ad8b-d552f39e61b3 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:27:18.586743 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b72154-a032-4eeb-98a5-1001144de31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:27:18.587391 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b72154-a032-4eeb-98a5-1001144de31d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:27:18.587673 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b72154-a032-4eeb-98a5-1001144de31d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:27:18.587988 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b72154-a032-4eeb-98a5-1001144de31d admin admin] PATH_INFO: `/v3/projects/f27c41fb6e184674ad8fe5617a786f14` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:27:18.589125 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b72154-a032-4eeb-98a5-1001144de31d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f27c41fb6e184674ad8fe5617a786f14)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:27:18.591331 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b72154-a032-4eeb-98a5-1001144de31d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:27:18.637422 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-54b72154-a032-4eeb-98a5-1001144de31d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f27c41fb6e184674ad8fe5617a786f14', 'request_id': 'req-54b72154-a032-4eeb-98a5-1001144de31d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:27:18.644169 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-54b72154-a032-4eeb-98a5-1001144de31d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f27c41fb6e184674ad8fe5617a786f14', 'request_id': 'req-54b72154-a032-4eeb-98a5-1001144de31d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:27:18.650253 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-54b72154-a032-4eeb-98a5-1001144de31d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f27c41fb6e184674ad8fe5617a786f14', 'request_id': 'req-54b72154-a032-4eeb-98a5-1001144de31d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:27:18.661639 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-54b72154-a032-4eeb-98a5-1001144de31d admin admin] The token cache is being invalidate because project f27c41fb6e184674ad8fe5617a786f14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:27:18.661961 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-54b72154-a032-4eeb-98a5-1001144de31d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:27:18.662579 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-54b72154-a032-4eeb-98a5-1001144de31d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:27:18.664080 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 975/1933] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:27:18 2022] DELETE /identity/v3/projects/f27c41fb6e184674ad8fe5617a786f14 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:27:18.669148 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9b5cb-9fb5-4da5-8432-2ad743357240 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:27:18.669436 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9b5cb-9fb5-4da5-8432-2ad743357240 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:27:18.669714 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9b5cb-9fb5-4da5-8432-2ad743357240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:27:18.689108 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-c9e9b5cb-9fb5-4da5-8432-2ad743357240 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:27:18.690302 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c9e9b5cb-9fb5-4da5-8432-2ad743357240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:27:18.708819 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:27:18.751835 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 959/1934] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:27:18.760144 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa8886-4d77-4916-ad34-597a1d767f1a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:27:18.760549 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa8886-4d77-4916-ad34-597a1d767f1a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:27:18.760942 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa8886-4d77-4916-ad34-597a1d767f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:27:18.781218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-99fa8886-4d77-4916-ad34-597a1d767f1a None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:27:18.782454 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-99fa8886-4d77-4916-ad34-597a1d767f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:27:18.790248 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 976/1935] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:27:18.794598 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9b5cb-9fb5-4da5-8432-2ad743357240 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:27:18.804394 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9b5cb-9fb5-4da5-8432-2ad743357240 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:27:18.809122 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d191f-4e4a-4b11-b844-a5232b0f05fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:27:18.809752 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d191f-4e4a-4b11-b844-a5232b0f05fb admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:27:18.810034 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d191f-4e4a-4b11-b844-a5232b0f05fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:27:18.810315 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d191f-4e4a-4b11-b844-a5232b0f05fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:27:18.811011 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d191f-4e4a-4b11-b844-a5232b0f05fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:27:18.811263 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d191f-4e4a-4b11-b844-a5232b0f05fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:27:18.812895 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d191f-4e4a-4b11-b844-a5232b0f05fb admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:27:18.824825 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 960/1936] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:27:18.828958 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa8886-4d77-4916-ad34-597a1d767f1a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:27:18.838561 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa8886-4d77-4916-ad34-597a1d767f1a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:27:18.843160 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f40c3e-324a-4d31-a485-2f6096e770b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:27:18.843745 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f40c3e-324a-4d31-a485-2f6096e770b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:27:18.844064 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f40c3e-324a-4d31-a485-2f6096e770b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:27:18.844343 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f40c3e-324a-4d31-a485-2f6096e770b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:27:18.844988 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f40c3e-324a-4d31-a485-2f6096e770b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:27:18.847070 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f40c3e-324a-4d31-a485-2f6096e770b9 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:27:18.875697 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 977/1937] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:27:18 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:27:18.880488 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d191f-4e4a-4b11-b844-a5232b0f05fb admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:27:18.890536 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d191f-4e4a-4b11-b844-a5232b0f05fb admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:27:18.947540 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ec17c-450a-4199-9ad5-be1335134ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:27:18.948192 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ec17c-450a-4199-9ad5-be1335134ae9 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:27:18.948498 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ec17c-450a-4199-9ad5-be1335134ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:27:18.948778 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ec17c-450a-4199-9ad5-be1335134ae9 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:27:18.949406 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ec17c-450a-4199-9ad5-be1335134ae9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:27:18.951323 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ec17c-450a-4199-9ad5-be1335134ae9 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:27:18.972628 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 961/1938] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:27:18 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:27:18.976710 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f40c3e-324a-4d31-a485-2f6096e770b9 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:27:18.987290 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f40c3e-324a-4d31-a485-2f6096e770b9 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:27:18.992421 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f00961-c44d-41ac-baa5-31b74becf2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:27:18.993033 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f00961-c44d-41ac-baa5-31b74becf2a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:27:18.993313 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f00961-c44d-41ac-baa5-31b74becf2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:27:18.993581 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f00961-c44d-41ac-baa5-31b74becf2a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:27:18.994211 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f00961-c44d-41ac-baa5-31b74becf2a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:27:18.995840 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f00961-c44d-41ac-baa5-31b74becf2a0 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:27:19.006624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 978/1939] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:27:19.010747 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ec17c-450a-4199-9ad5-be1335134ae9 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:27:19.021667 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ec17c-450a-4199-9ad5-be1335134ae9 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:27:19.026250 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50d9c0-fb7b-4d0f-bd5a-ba015413f370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:27:19.026841 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50d9c0-fb7b-4d0f-bd5a-ba015413f370 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:27:19.027119 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50d9c0-fb7b-4d0f-bd5a-ba015413f370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:27:19.027390 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50d9c0-fb7b-4d0f-bd5a-ba015413f370 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:27:19.028082 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50d9c0-fb7b-4d0f-bd5a-ba015413f370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:27:19.029660 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50d9c0-fb7b-4d0f-bd5a-ba015413f370 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:27:19.040624 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 962/1940] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:27:19.044907 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f00961-c44d-41ac-baa5-31b74becf2a0 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:27:19.055097 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f00961-c44d-41ac-baa5-31b74becf2a0 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:27:19.059621 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681c52d-2c02-4354-8da7-dfd48b85f5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:27:19.060296 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681c52d-2c02-4354-8da7-dfd48b85f5f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:27:19.060574 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681c52d-2c02-4354-8da7-dfd48b85f5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:27:19.060843 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681c52d-2c02-4354-8da7-dfd48b85f5f2 admin admin] PATH_INFO: `/v3/projects/55c409ecb9c3494aa5eb6357e1c01b9f/users/3cea2695fb2c41c29b05c87b1ef75589/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:27:19.075774 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681c52d-2c02-4354-8da7-dfd48b85f5f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55c409ecb9c3494aa5eb6357e1c01b9f, user_id=3cea2695fb2c41c29b05c87b1ef75589, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:27:19.078345 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681c52d-2c02-4354-8da7-dfd48b85f5f2 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:27:19.090869 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 979/1941] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:27:19 2022] PUT /identity/v3/projects/55c409ecb9c3494aa5eb6357e1c01b9f/users/3cea2695fb2c41c29b05c87b1ef75589/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:27:19.095763 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43d8f5-d448-468e-ab05-5595f19ddbff None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:27:19.096162 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43d8f5-d448-468e-ab05-5595f19ddbff None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:27:19.096448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43d8f5-d448-468e-ab05-5595f19ddbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:27:19.115747 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-8b43d8f5-d448-468e-ab05-5595f19ddbff None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:27:19.116986 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-8b43d8f5-d448-468e-ab05-5595f19ddbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:27:19.177637 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 963/1942] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:27:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:27:19.187143 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681c52d-2c02-4354-8da7-dfd48b85f5f2 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:27:19.188858 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0681c52d-2c02-4354-8da7-dfd48b85f5f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:27:19.211128 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:27:19.248556 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681c52d-2c02-4354-8da7-dfd48b85f5f2 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:27:19.252336 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37219f40-b2a4-4ce0-9fa5-c7be31185ad7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:27:19.252972 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37219f40-b2a4-4ce0-9fa5-c7be31185ad7 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:27:19.253253 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37219f40-b2a4-4ce0-9fa5-c7be31185ad7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:27:19.253527 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37219f40-b2a4-4ce0-9fa5-c7be31185ad7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:27:19.262479 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37219f40-b2a4-4ce0-9fa5-c7be31185ad7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:27:19.263891 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37219f40-b2a4-4ce0-9fa5-c7be31185ad7 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:27:19.273934 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 980/1943] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:27:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:27:19.861117 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df029a51-4dec-4d8e-9db4-d01b21216518 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:27:19.861405 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df029a51-4dec-4d8e-9db4-d01b21216518 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:27:19.861682 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df029a51-4dec-4d8e-9db4-d01b21216518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:27:19.891429 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-df029a51-4dec-4d8e-9db4-d01b21216518 None None] MFA Rules not processed for user `3cea2695fb2c41c29b05c87b1ef75589`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:27:19.892716 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-df029a51-4dec-4d8e-9db4-d01b21216518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:27:19.912352 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:27:19.965273 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 964/1944] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:27:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:27:19.977020 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37219f40-b2a4-4ce0-9fa5-c7be31185ad7 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:27:19.978397 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-37219f40-b2a4-4ce0-9fa5-c7be31185ad7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:27:20.038097 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37219f40-b2a4-4ce0-9fa5-c7be31185ad7 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:27:20.041752 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b03c3-c9c6-4713-9d57-c3f9ba265def service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:27:20.042619 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b03c3-c9c6-4713-9d57-c3f9ba265def service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:27:20.042908 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b03c3-c9c6-4713-9d57-c3f9ba265def service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:27:20.043185 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b03c3-c9c6-4713-9d57-c3f9ba265def service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:27:20.052052 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b03c3-c9c6-4713-9d57-c3f9ba265def service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:27:20.053491 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b03c3-c9c6-4713-9d57-c3f9ba265def service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:27:20.062440 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 981/1945] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:27:19 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:27:21.420831 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03abcc9-9177-44f9-9f27-ecfb942bbda5 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:27:21.421331 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03abcc9-9177-44f9-9f27-ecfb942bbda5 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:27:21.421429 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03abcc9-9177-44f9-9f27-ecfb942bbda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:27:21.440783 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-d03abcc9-9177-44f9-9f27-ecfb942bbda5 None None] MFA Rules not processed for user `3cea2695fb2c41c29b05c87b1ef75589`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:27:21.442061 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-d03abcc9-9177-44f9-9f27-ecfb942bbda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:27:21.449402 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 965/1946] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:27:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:27:30.058339 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=43 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:27:31.435396 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=22 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:27:34.212426 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf94ef-d295-405c-9c4a-6a2b916627d5 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:27:34.212895 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf94ef-d295-405c-9c4a-6a2b916627d5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:27:34.213097 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf94ef-d295-405c-9c4a-6a2b916627d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:27:34.232489 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-03cf94ef-d295-405c-9c4a-6a2b916627d5 None None] MFA Rules not processed for user `b45585ee97774a5fa704eac9e992adcb`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:27:34.233733 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-03cf94ef-d295-405c-9c4a-6a2b916627d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:27:34.289710 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 982/1947] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:27:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:27:35.622876 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03abcc9-9177-44f9-9f27-ecfb942bbda5 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:27:35.624467 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-d03abcc9-9177-44f9-9f27-ecfb942bbda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:27:35.706014 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03abcc9-9177-44f9-9f27-ecfb942bbda5 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:27:35.713516 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b899635-e1d2-42ce-bcf1-a4da86ed337f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f10c161ef74c4a0d809346a5c4b53aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:27:35.714510 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b899635-e1d2-42ce-bcf1-a4da86ed337f service placement] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:27:35.715217 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b899635-e1d2-42ce-bcf1-a4da86ed337f service placement] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:27:35.715877 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b899635-e1d2-42ce-bcf1-a4da86ed337f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:27:35.726805 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-8b899635-e1d2-42ce-bcf1-a4da86ed337f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:27:35.744275 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b899635-e1d2-42ce-bcf1-a4da86ed337f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:27:35.746081 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b899635-e1d2-42ce-bcf1-a4da86ed337f service placement] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:27:35.759400 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 966/1948] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:27:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:27:44.282253 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=25 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:27:45.752306 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=32 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:28:03.460712 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98730e7-0236-473d-a4f3-ba759c91e442 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:28:03.461174 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98730e7-0236-473d-a4f3-ba759c91e442 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:28:03.461264 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98730e7-0236-473d-a4f3-ba759c91e442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:28:03.482378 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c98730e7-0236-473d-a4f3-ba759c91e442 None None] MFA Rules not processed for user `9d5d4691dca848d58bd280d2fad79fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:28:03.483584 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c98730e7-0236-473d-a4f3-ba759c91e442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:28:03.539490 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 983/1949] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 25 13:28:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:28:03.590408 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b899635-e1d2-42ce-bcf1-a4da86ed337f service placement] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:28:03.591786 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-8b899635-e1d2-42ce-bcf1-a4da86ed337f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:28:03.659226 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b899635-e1d2-42ce-bcf1-a4da86ed337f service placement] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:28:03.664331 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01827363-af2d-415f-90cb-37411346f4ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07413369b0c14e878d04ee528487801d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:28:03.664940 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01827363-af2d-415f-90cb-37411346f4ae service swift] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:28:03.665218 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01827363-af2d-415f-90cb-37411346f4ae service swift] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:28:03.665491 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01827363-af2d-415f-90cb-37411346f4ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:28:03.673904 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01827363-af2d-415f-90cb-37411346f4ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:28:03.675475 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01827363-af2d-415f-90cb-37411346f4ae service swift] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:28:03.683546 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 967/1950] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 25 13:28:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 25 13:28:04.528797 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7374a50-deeb-4445-8e15-dd8333995c86 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:28:04.529776 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7374a50-deeb-4445-8e15-dd8333995c86 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:28:04.530070 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7374a50-deeb-4445-8e15-dd8333995c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:28:04.552324 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a7374a50-deeb-4445-8e15-dd8333995c86 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:28:04.554283 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a7374a50-deeb-4445-8e15-dd8333995c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:28:04.564914 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 984/1951] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Oct 25 13:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:28:04.587728 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01827363-af2d-415f-90cb-37411346f4ae service swift] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:28:04.589180 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-01827363-af2d-415f-90cb-37411346f4ae service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:28:04.681790 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01827363-af2d-415f-90cb-37411346f4ae service swift] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:28:04.688686 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecb525-9cd0-42ba-a8d9-4a9e4ae553e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:28:04.689361 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecb525-9cd0-42ba-a8d9-4a9e4ae553e0 service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:28:04.689713 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecb525-9cd0-42ba-a8d9-4a9e4ae553e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:28:04.690050 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecb525-9cd0-42ba-a8d9-4a9e4ae553e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:28:04.702264 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ecb525-9cd0-42ba-a8d9-4a9e4ae553e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:28:04.703923 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ecb525-9cd0-42ba-a8d9-4a9e4ae553e0 service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:28:04.715778 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 968/1952] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:28:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:28:09.723284 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6a687-adc9-4789-bba4-865e01feace0 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:28:09.724206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6a687-adc9-4789-bba4-865e01feace0 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:28:09.724206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6a687-adc9-4789-bba4-865e01feace0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:28:09.765668 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-5bd6a687-adc9-4789-bba4-865e01feace0 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:28:09.767299 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5bd6a687-adc9-4789-bba4-865e01feace0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:28:09.775998 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 985/1953] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Oct 25 13:28:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:28:09.798296 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecb525-9cd0-42ba-a8d9-4a9e4ae553e0 service nova] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:28:09.799784 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-f7ecb525-9cd0-42ba-a8d9-4a9e4ae553e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:28:09.820108 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecb525-9cd0-42ba-a8d9-4a9e4ae553e0 service nova] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:28:09.827668 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6abacb-ffdb-418e-bf35-8dc8735fae52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:28:09.828426 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6abacb-ffdb-418e-bf35-8dc8735fae52 service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:28:09.828775 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6abacb-ffdb-418e-bf35-8dc8735fae52 service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:28:09.829271 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6abacb-ffdb-418e-bf35-8dc8735fae52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:28:09.839565 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6abacb-ffdb-418e-bf35-8dc8735fae52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:28:09.841471 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6abacb-ffdb-418e-bf35-8dc8735fae52 service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:28:09.853151 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 969/1954] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:28:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:28:15.041417 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036c28e-48fd-4af1-b19f-7853e80fb89d None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:28:15.041971 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036c28e-48fd-4af1-b19f-7853e80fb89d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:28:15.041971 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036c28e-48fd-4af1-b19f-7853e80fb89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:28:15.061465 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-2036c28e-48fd-4af1-b19f-7853e80fb89d None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:28:15.062661 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2036c28e-48fd-4af1-b19f-7853e80fb89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:28:15.071102 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 986/1955] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Oct 25 13:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:28:15.095878 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6abacb-ffdb-418e-bf35-8dc8735fae52 service nova] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:28:15.107289 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6abacb-ffdb-418e-bf35-8dc8735fae52 service nova] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:28:15.112811 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e581e87-35cb-40ec-87fd-c9ac2da1b5a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:28:15.113397 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e581e87-35cb-40ec-87fd-c9ac2da1b5a8 service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:28:15.113673 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e581e87-35cb-40ec-87fd-c9ac2da1b5a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:28:15.113938 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e581e87-35cb-40ec-87fd-c9ac2da1b5a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:28:15.122478 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e581e87-35cb-40ec-87fd-c9ac2da1b5a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:28:15.124083 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e581e87-35cb-40ec-87fd-c9ac2da1b5a8 service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:28:15.134230 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 970/1956] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:28:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:28:18.520964 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e7b69-c74b-46bf-b3ee-05b9e0b49275 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:28:18.521531 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e7b69-c74b-46bf-b3ee-05b9e0b49275 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:28:18.521531 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e7b69-c74b-46bf-b3ee-05b9e0b49275 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:28:18.522876 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 987/1957] 10.222.0.25 () {54 vars in 921 bytes} [Tue Oct 25 13:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:28:18.529128 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54d2ca-f64b-4a6d-8f2d-dfc59c6bdb4a None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:28:18.529589 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54d2ca-f64b-4a6d-8f2d-dfc59c6bdb4a None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:28:18.529690 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54d2ca-f64b-4a6d-8f2d-dfc59c6bdb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:28:18.550034 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-fc54d2ca-f64b-4a6d-8f2d-dfc59c6bdb4a None None] MFA Rules not processed for user `63e73c00cadb4deea934db6111ed76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:28:18.551240 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-fc54d2ca-f64b-4a6d-8f2d-dfc59c6bdb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:28:18.561623 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 971/1958] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Oct 25 13:28:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:28:18.573566 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e7b69-c74b-46bf-b3ee-05b9e0b49275 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:28:18.575541 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f97e7b69-c74b-46bf-b3ee-05b9e0b49275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:28:18.652957 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e7b69-c74b-46bf-b3ee-05b9e0b49275 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:28:18.656616 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e962d97-1c09-4527-b3d9-4fd189f3d551 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f67d808ffb4641b03f96406b3fe9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:28:18.657318 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e962d97-1c09-4527-b3d9-4fd189f3d551 service glance] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:28:18.657495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e962d97-1c09-4527-b3d9-4fd189f3d551 service glance] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:28:18.657765 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e962d97-1c09-4527-b3d9-4fd189f3d551 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:28:18.669214 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e962d97-1c09-4527-b3d9-4fd189f3d551 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:28:18.670709 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e962d97-1c09-4527-b3d9-4fd189f3d551 service glance] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:28:18.682092 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 988/1959] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:28:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:28:18.753584 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeeb079-ee4f-428d-ab13-f74b16fa3b76 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:28:18.753870 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeeb079-ee4f-428d-ab13-f74b16fa3b76 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:28:18.754154 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeeb079-ee4f-428d-ab13-f74b16fa3b76 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:28:18.755550 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 972/1960] 10.222.0.25 () {54 vars in 921 bytes} [Tue Oct 25 13:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:28:18.760820 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd205bf6-1eff-4b3b-a745-d4161c86fe13 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:28:18.761128 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd205bf6-1eff-4b3b-a745-d4161c86fe13 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:28:18.761406 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd205bf6-1eff-4b3b-a745-d4161c86fe13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:28:18.782826 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-dd205bf6-1eff-4b3b-a745-d4161c86fe13 None None] MFA Rules not processed for user `cec40e8c81fe4eafb474d40bc7bf38fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:28:18.784064 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-dd205bf6-1eff-4b3b-a745-d4161c86fe13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:28:18.790944 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 989/1961] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Oct 25 13:28:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:28:18.802695 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeeb079-ee4f-428d-ab13-f74b16fa3b76 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:28:18.813760 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeeb079-ee4f-428d-ab13-f74b16fa3b76 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:28:18.817257 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e15c8-a7d1-4660-921c-850ab0d40758 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:28:18.817841 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e15c8-a7d1-4660-921c-850ab0d40758 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:28:18.818117 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e15c8-a7d1-4660-921c-850ab0d40758 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:28:18.818388 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e15c8-a7d1-4660-921c-850ab0d40758 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:28:18.825678 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e15c8-a7d1-4660-921c-850ab0d40758 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:28:18.827093 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e15c8-a7d1-4660-921c-850ab0d40758 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:28:18.835424 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 973/1962] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:28:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:28:18.917462 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e03645-4619-4cf5-95d8-31a96fd880d9 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:28:18.917996 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e03645-4619-4cf5-95d8-31a96fd880d9 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:28:18.918282 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e03645-4619-4cf5-95d8-31a96fd880d9 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:28:18.919626 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 990/1963] 10.222.0.25 () {54 vars in 921 bytes} [Tue Oct 25 13:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:28:18.924975 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4f1d5-5b96-4c28-a15f-eb8d59b6252b None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:28:18.925257 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4f1d5-5b96-4c28-a15f-eb8d59b6252b None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:28:18.925528 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4f1d5-5b96-4c28-a15f-eb8d59b6252b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:28:18.946269 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-26e4f1d5-5b96-4c28-a15f-eb8d59b6252b None None] MFA Rules not processed for user `63e73c00cadb4deea934db6111ed76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:28:18.947707 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-26e4f1d5-5b96-4c28-a15f-eb8d59b6252b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:28:18.956654 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 974/1964] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Oct 25 13:28:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:28:18.967445 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e03645-4619-4cf5-95d8-31a96fd880d9 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:28:18.978535 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e03645-4619-4cf5-95d8-31a96fd880d9 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:28:18.982201 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277946cf-b072-41fd-9540-07368f2897f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:28:18.982806 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277946cf-b072-41fd-9540-07368f2897f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:28:18.983088 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277946cf-b072-41fd-9540-07368f2897f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:28:18.983364 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277946cf-b072-41fd-9540-07368f2897f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:28:18.995565 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277946cf-b072-41fd-9540-07368f2897f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:28:18.997071 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277946cf-b072-41fd-9540-07368f2897f0 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:28:19.010275 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 991/1965] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:28:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 13:28:20.164608 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d90847-d079-44c1-aebf-4aacbe9ddece None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:28:20.165133 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d90847-d079-44c1-aebf-4aacbe9ddece None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:28:20.165230 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d90847-d079-44c1-aebf-4aacbe9ddece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:28:20.185180 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-60d90847-d079-44c1-aebf-4aacbe9ddece None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:28:20.186466 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-60d90847-d079-44c1-aebf-4aacbe9ddece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:28:20.195285 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 975/1966] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Oct 25 13:28:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:28:20.217275 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277946cf-b072-41fd-9540-07368f2897f0 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:28:20.228534 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277946cf-b072-41fd-9540-07368f2897f0 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:28:20.234121 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7bbcb-0654-4442-98d7-50770815b5db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:28:20.234721 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7bbcb-0654-4442-98d7-50770815b5db service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:28:20.235002 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7bbcb-0654-4442-98d7-50770815b5db service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:28:20.235276 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7bbcb-0654-4442-98d7-50770815b5db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:28:20.243518 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d7bbcb-0654-4442-98d7-50770815b5db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:28:20.245198 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d7bbcb-0654-4442-98d7-50770815b5db service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:28:20.254739 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 992/1967] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:28:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:28:23.638527 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187a0ef-a3e1-482e-b280-54144e4bde8c None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:28:23.639024 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187a0ef-a3e1-482e-b280-54144e4bde8c None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:28:23.639164 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187a0ef-a3e1-482e-b280-54144e4bde8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:28:23.658257 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-0187a0ef-a3e1-482e-b280-54144e4bde8c None None] MFA Rules not processed for user `9d5d4691dca848d58bd280d2fad79fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:28:23.659433 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-0187a0ef-a3e1-482e-b280-54144e4bde8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:28:23.666813 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 976/1968] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 25 13:28:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:28:23.679532 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7bbcb-0654-4442-98d7-50770815b5db service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:28:23.690388 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7bbcb-0654-4442-98d7-50770815b5db service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:28:23.696137 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5fe600-1926-49dd-a785-0db4087d095d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07413369b0c14e878d04ee528487801d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:28:23.696727 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fe600-1926-49dd-a785-0db4087d095d service swift] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:28:23.697002 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fe600-1926-49dd-a785-0db4087d095d service swift] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:28:23.697272 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fe600-1926-49dd-a785-0db4087d095d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:28:23.705076 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5fe600-1926-49dd-a785-0db4087d095d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:28:23.706627 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5fe600-1926-49dd-a785-0db4087d095d service swift] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:28:23.714477 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 993/1969] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 25 13:28:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 25 13:28:25.441384 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833ceda-7049-41cc-88e4-078412120fcc None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:28:25.441981 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833ceda-7049-41cc-88e4-078412120fcc None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:28:25.441981 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833ceda-7049-41cc-88e4-078412120fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:28:25.461655 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-0833ceda-7049-41cc-88e4-078412120fcc None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:28:25.462850 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-0833ceda-7049-41cc-88e4-078412120fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:28:25.470622 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 977/1970] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Oct 25 13:28:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:28:25.498063 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5fe600-1926-49dd-a785-0db4087d095d service swift] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:28:25.503993 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=82 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:28:25.510675 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5fe600-1926-49dd-a785-0db4087d095d service swift] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:28:25.517496 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886de66a-7415-4da6-b4d8-1f1dd7d08b3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:28:25.518047 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886de66a-7415-4da6-b4d8-1f1dd7d08b3c service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:28:25.518328 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886de66a-7415-4da6-b4d8-1f1dd7d08b3c service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:28:25.518632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886de66a-7415-4da6-b4d8-1f1dd7d08b3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:28:25.527384 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886de66a-7415-4da6-b4d8-1f1dd7d08b3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:28:25.529009 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886de66a-7415-4da6-b4d8-1f1dd7d08b3c service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:28:25.538341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 994/1971] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:28:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:28:35.456406 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:28:35.534083 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:28:48.118582 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b6266-8b1e-4646-85bc-63093ef8a7a5 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:28:48.119080 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b6266-8b1e-4646-85bc-63093ef8a7a5 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:28:48.119182 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b6266-8b1e-4646-85bc-63093ef8a7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:28:48.140276 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-f50b6266-8b1e-4646-85bc-63093ef8a7a5 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:28:48.141481 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-f50b6266-8b1e-4646-85bc-63093ef8a7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:28:48.149557 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 978/1972] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Oct 25 13:28:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:28:48.170898 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886de66a-7415-4da6-b4d8-1f1dd7d08b3c service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:28:48.182047 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886de66a-7415-4da6-b4d8-1f1dd7d08b3c service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:28:48.188716 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5bc77-7652-4250-b379-ef2522bbb604 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:28:48.189327 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5bc77-7652-4250-b379-ef2522bbb604 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:28:48.189606 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5bc77-7652-4250-b379-ef2522bbb604 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:28:48.189881 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5bc77-7652-4250-b379-ef2522bbb604 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:28:48.198521 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac5bc77-7652-4250-b379-ef2522bbb604 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:28:48.200858 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac5bc77-7652-4250-b379-ef2522bbb604 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:28:48.210536 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 995/1973] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:28:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:28:49.924433 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f761d7e-2ff1-41aa-bd3f-f8973fe74bb6 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:28:49.924889 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f761d7e-2ff1-41aa-bd3f-f8973fe74bb6 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:28:49.924994 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f761d7e-2ff1-41aa-bd3f-f8973fe74bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:28:49.944774 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-2f761d7e-2ff1-41aa-bd3f-f8973fe74bb6 None None] MFA Rules not processed for user `9d5d4691dca848d58bd280d2fad79fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:28:49.945968 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2f761d7e-2ff1-41aa-bd3f-f8973fe74bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:28:49.953648 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 979/1974] 10.222.0.25 () {58 vars in 967 bytes} [Tue Oct 25 13:28:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:28:49.966902 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5bc77-7652-4250-b379-ef2522bbb604 service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:28:49.977964 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5bc77-7652-4250-b379-ef2522bbb604 service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:28:49.982893 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f684b6-4589-4c2d-9a97-103bb34640b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07413369b0c14e878d04ee528487801d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:28:49.983490 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f684b6-4589-4c2d-9a97-103bb34640b7 service swift] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:28:49.983763 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f684b6-4589-4c2d-9a97-103bb34640b7 service swift] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:28:49.984087 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f684b6-4589-4c2d-9a97-103bb34640b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:28:49.991806 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f684b6-4589-4c2d-9a97-103bb34640b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:28:49.993390 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f684b6-4589-4c2d-9a97-103bb34640b7 service swift] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:28:50.001275 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 996/1975] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 25 13:28:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 25 13:28:59.938551 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=6 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:28:59.998293 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=12 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:29:06.660481 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87c07f-ebe9-4bba-8e01-9b865d41ddd1 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:29:06.660955 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87c07f-ebe9-4bba-8e01-9b865d41ddd1 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:29:06.661064 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87c07f-ebe9-4bba-8e01-9b865d41ddd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:29:06.680447 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-6c87c07f-ebe9-4bba-8e01-9b865d41ddd1 None None] MFA Rules not processed for user `3cea2695fb2c41c29b05c87b1ef75589`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:29:06.681639 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-6c87c07f-ebe9-4bba-8e01-9b865d41ddd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:29:06.689187 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 980/1976] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:29:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:29:16.675016 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:29:26.035518 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aee85c-b43a-4a7b-962c-c12a77888026 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:29:26.036073 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aee85c-b43a-4a7b-962c-c12a77888026 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:29:26.036073 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aee85c-b43a-4a7b-962c-c12a77888026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:29:26.055385 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-42aee85c-b43a-4a7b-962c-c12a77888026 None None] MFA Rules not processed for user `04d684ea21984ff699fea2c637044c3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:29:26.056607 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-42aee85c-b43a-4a7b-962c-c12a77888026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:29:26.113995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 997/1977] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:29:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:29:28.004304 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039181e-4743-4501-8b7f-0b4a20052f68 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:29:28.004881 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039181e-4743-4501-8b7f-0b4a20052f68 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:29:28.004881 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039181e-4743-4501-8b7f-0b4a20052f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:29:28.024902 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-3039181e-4743-4501-8b7f-0b4a20052f68 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:29:28.026096 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-3039181e-4743-4501-8b7f-0b4a20052f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:29:28.033760 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 981/1978] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Oct 25 13:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:29:28.056862 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aee85c-b43a-4a7b-962c-c12a77888026 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:29:28.069809 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aee85c-b43a-4a7b-962c-c12a77888026 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:29:28.075181 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df472fa0-5578-436f-b0b0-03e6b2a42318 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:29:28.076369 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df472fa0-5578-436f-b0b0-03e6b2a42318 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:29:28.076654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df472fa0-5578-436f-b0b0-03e6b2a42318 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:29:28.076932 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df472fa0-5578-436f-b0b0-03e6b2a42318 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:29:28.085092 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df472fa0-5578-436f-b0b0-03e6b2a42318 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:29:28.086663 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df472fa0-5578-436f-b0b0-03e6b2a42318 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:29:28.096002 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 998/1979] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:29:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 13:29:28.766054 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039181e-4743-4501-8b7f-0b4a20052f68 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:29:28.775433 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039181e-4743-4501-8b7f-0b4a20052f68 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:29:28.779492 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a84b5-44b8-4766-9432-b24934ec2945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:29:28.780430 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a84b5-44b8-4766-9432-b24934ec2945 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:29:28.780708 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a84b5-44b8-4766-9432-b24934ec2945 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:29:28.780979 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a84b5-44b8-4766-9432-b24934ec2945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:29:28.782640 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-f16a84b5-44b8-4766-9432-b24934ec2945 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:29:28.797021 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a84b5-44b8-4766-9432-b24934ec2945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:29:28.798421 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a84b5-44b8-4766-9432-b24934ec2945 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:29:28.809337 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 982/1980] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:29:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:29:29.933709 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df472fa0-5578-436f-b0b0-03e6b2a42318 service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:29:29.935799 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-df472fa0-5578-436f-b0b0-03e6b2a42318 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:29:29.947516 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df472fa0-5578-436f-b0b0-03e6b2a42318 service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:29:29.951275 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc1655-e344-45b0-b6cb-efc8a650a7a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:29:29.951975 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc1655-e344-45b0-b6cb-efc8a650a7a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:29:29.952260 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc1655-e344-45b0-b6cb-efc8a650a7a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:29:29.952536 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc1655-e344-45b0-b6cb-efc8a650a7a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:29:29.954185 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7ecc1655-e344-45b0-b6cb-efc8a650a7a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:29:29.967097 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc1655-e344-45b0-b6cb-efc8a650a7a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:29:29.968558 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc1655-e344-45b0-b6cb-efc8a650a7a4 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:29:29.979487 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 999/1981] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:29:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 13:29:34.309512 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a4fee-ba97-4686-9e12-73b8c3c39779 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:29:34.310467 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a4fee-ba97-4686-9e12-73b8c3c39779 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:29:34.310467 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a4fee-ba97-4686-9e12-73b8c3c39779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:29:34.333113 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-0f2a4fee-ba97-4686-9e12-73b8c3c39779 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:29:34.334334 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-0f2a4fee-ba97-4686-9e12-73b8c3c39779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:29:34.343157 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 983/1982] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Oct 25 13:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:29:34.363985 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc1655-e344-45b0-b6cb-efc8a650a7a4 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:29:34.375388 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc1655-e344-45b0-b6cb-efc8a650a7a4 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:29:34.383072 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8315c-c21a-441a-8438-c8b39c9f704f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:29:34.383698 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8315c-c21a-441a-8438-c8b39c9f704f service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:29:34.384876 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8315c-c21a-441a-8438-c8b39c9f704f service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:29:34.384876 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8315c-c21a-441a-8438-c8b39c9f704f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:29:34.394894 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8315c-c21a-441a-8438-c8b39c9f704f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:29:34.397555 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8315c-c21a-441a-8438-c8b39c9f704f service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:29:34.410382 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1000/1983] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:29:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:29:40.501988 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee644edb-245c-4dda-abe9-15bb26e30480 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:29:40.503297 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee644edb-245c-4dda-abe9-15bb26e30480 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:29:40.503806 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee644edb-245c-4dda-abe9-15bb26e30480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:29:40.572988 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-ee644edb-245c-4dda-abe9-15bb26e30480 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:29:40.575201 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ee644edb-245c-4dda-abe9-15bb26e30480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:29:40.598198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 984/1984] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Oct 25 13:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:29:40.621286 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8315c-c21a-441a-8438-c8b39c9f704f service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:29:40.634311 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8315c-c21a-441a-8438-c8b39c9f704f service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:29:40.641663 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab66c4-9ddd-429a-94bb-f7fcd60be983 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:29:40.642368 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab66c4-9ddd-429a-94bb-f7fcd60be983 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:29:40.642735 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab66c4-9ddd-429a-94bb-f7fcd60be983 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:29:40.643080 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab66c4-9ddd-429a-94bb-f7fcd60be983 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:29:40.652382 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab66c4-9ddd-429a-94bb-f7fcd60be983 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:29:40.654162 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab66c4-9ddd-429a-94bb-f7fcd60be983 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:29:40.665286 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1001/1985] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:29:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:29:44.701855 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40e2d7-aa2a-4f0d-9dad-19dbfffbc83b None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:29:44.702357 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40e2d7-aa2a-4f0d-9dad-19dbfffbc83b None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:29:44.702449 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40e2d7-aa2a-4f0d-9dad-19dbfffbc83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:29:44.721849 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-ef40e2d7-aa2a-4f0d-9dad-19dbfffbc83b None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:29:44.723050 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ef40e2d7-aa2a-4f0d-9dad-19dbfffbc83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:29:44.730830 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 985/1986] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Oct 25 13:29:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:29:44.752067 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab66c4-9ddd-429a-94bb-f7fcd60be983 service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:29:44.762889 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab66c4-9ddd-429a-94bb-f7fcd60be983 service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:29:44.768860 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ca332-7475-4a57-b51e-7c95c0af76c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:29:44.769448 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ca332-7475-4a57-b51e-7c95c0af76c9 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:29:44.769726 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ca332-7475-4a57-b51e-7c95c0af76c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:29:44.769997 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ca332-7475-4a57-b51e-7c95c0af76c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:29:44.779929 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ca332-7475-4a57-b51e-7c95c0af76c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:29:44.781516 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ca332-7475-4a57-b51e-7c95c0af76c9 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:29:44.791113 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1002/1987] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:29:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:29:45.988449 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40e2d7-aa2a-4f0d-9dad-19dbfffbc83b None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:29:45.998408 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40e2d7-aa2a-4f0d-9dad-19dbfffbc83b None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:29:46.001926 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030df78e-b75e-4ca1-ab73-eb61a9095bd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:29:46.002519 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030df78e-b75e-4ca1-ab73-eb61a9095bd7 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:29:46.002792 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030df78e-b75e-4ca1-ab73-eb61a9095bd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:29:46.003058 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030df78e-b75e-4ca1-ab73-eb61a9095bd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:29:46.004770 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-030df78e-b75e-4ca1-ab73-eb61a9095bd7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:29:46.015630 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030df78e-b75e-4ca1-ab73-eb61a9095bd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:29:46.017107 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030df78e-b75e-4ca1-ab73-eb61a9095bd7 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:29:46.026142 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 986/1988] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:29:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:29:49.958380 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6def37d-2738-4d03-8912-1f0aab86ba7c None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:29:49.959219 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6def37d-2738-4d03-8912-1f0aab86ba7c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:29:49.959498 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6def37d-2738-4d03-8912-1f0aab86ba7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:29:49.991176 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d6def37d-2738-4d03-8912-1f0aab86ba7c None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:29:49.992565 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d6def37d-2738-4d03-8912-1f0aab86ba7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:29:50.000736 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1003/1989] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Oct 25 13:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:29:50.022402 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030df78e-b75e-4ca1-ab73-eb61a9095bd7 service cinder] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:29:50.036129 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030df78e-b75e-4ca1-ab73-eb61a9095bd7 service cinder] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:29:50.041751 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c91e93-0f62-4834-bad1-ccba04407bf7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:29:50.042358 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c91e93-0f62-4834-bad1-ccba04407bf7 service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:29:50.042646 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c91e93-0f62-4834-bad1-ccba04407bf7 service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:29:50.042908 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c91e93-0f62-4834-bad1-ccba04407bf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:29:50.051966 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c91e93-0f62-4834-bad1-ccba04407bf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:29:50.053750 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c91e93-0f62-4834-bad1-ccba04407bf7 service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:29:50.064548 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 987/1990] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:29:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:29:54.545767 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6def37d-2738-4d03-8912-1f0aab86ba7c None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:29:54.553315 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=59 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:29:54.560741 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6def37d-2738-4d03-8912-1f0aab86ba7c None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:29:54.566109 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511d998-d567-4e46-a10f-f769aaec58d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:29:54.566722 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511d998-d567-4e46-a10f-f769aaec58d5 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:29:54.566996 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511d998-d567-4e46-a10f-f769aaec58d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:29:54.567267 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511d998-d567-4e46-a10f-f769aaec58d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:29:54.568985 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4511d998-d567-4e46-a10f-f769aaec58d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:29:54.630489 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511d998-d567-4e46-a10f-f769aaec58d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:29:54.632113 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511d998-d567-4e46-a10f-f769aaec58d5 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:29:54.641651 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1004/1991] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:29:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:29:55.381361 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572d89a-ecbf-4446-ad27-c3751a7fbcc9 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:29:55.381864 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572d89a-ecbf-4446-ad27-c3751a7fbcc9 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:29:55.382000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572d89a-ecbf-4446-ad27-c3751a7fbcc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:29:55.401283 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-c572d89a-ecbf-4446-ad27-c3751a7fbcc9 None None] MFA Rules not processed for user `b45585ee97774a5fa704eac9e992adcb`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:29:55.402904 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c572d89a-ecbf-4446-ad27-c3751a7fbcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:29:55.412191 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 988/1992] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:29:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:29:55.729724 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511d998-d567-4e46-a10f-f769aaec58d5 service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:29:55.739774 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511d998-d567-4e46-a10f-f769aaec58d5 service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:29:55.743362 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634efc9b-880f-47ed-94d3-55886edcd4a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:29:55.744005 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634efc9b-880f-47ed-94d3-55886edcd4a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:29:55.744284 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634efc9b-880f-47ed-94d3-55886edcd4a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:29:55.744555 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634efc9b-880f-47ed-94d3-55886edcd4a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:29:55.746237 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-634efc9b-880f-47ed-94d3-55886edcd4a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:29:55.755537 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634efc9b-880f-47ed-94d3-55886edcd4a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:29:55.756983 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634efc9b-880f-47ed-94d3-55886edcd4a5 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:29:55.764746 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1005/1993] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:29:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:29:56.090478 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572d89a-ecbf-4446-ad27-c3751a7fbcc9 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:29:56.105043 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572d89a-ecbf-4446-ad27-c3751a7fbcc9 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:29:56.113244 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913134b-479f-4ecb-9624-ee4bc4b3a649 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f10c161ef74c4a0d809346a5c4b53aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:29:56.113244 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913134b-479f-4ecb-9624-ee4bc4b3a649 service placement] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:29:56.113244 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913134b-479f-4ecb-9624-ee4bc4b3a649 service placement] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:29:56.113244 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913134b-479f-4ecb-9624-ee4bc4b3a649 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:29:56.114946 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-1913134b-479f-4ecb-9624-ee4bc4b3a649 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:29:56.130702 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1913134b-479f-4ecb-9624-ee4bc4b3a649 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:29:56.132890 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1913134b-479f-4ecb-9624-ee4bc4b3a649 service placement] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:29:56.145821 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 989/1994] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:29:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:30:05.761318 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=33 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:30:06.139698 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=39 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:30:07.484830 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634efc9b-880f-47ed-94d3-55886edcd4a5 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:30:07.499998 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634efc9b-880f-47ed-94d3-55886edcd4a5 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:30:07.505600 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0aeb7-5a9d-4e37-9de3-7427fe70958e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:30:07.506221 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0aeb7-5a9d-4e37-9de3-7427fe70958e service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:30:07.506503 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0aeb7-5a9d-4e37-9de3-7427fe70958e service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:30:07.506781 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0aeb7-5a9d-4e37-9de3-7427fe70958e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:30:07.508742 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-81e0aeb7-5a9d-4e37-9de3-7427fe70958e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:30:07.579682 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e0aeb7-5a9d-4e37-9de3-7427fe70958e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:30:07.581353 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e0aeb7-5a9d-4e37-9de3-7427fe70958e service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:30:07.593313 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1006/1995] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:30:07 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:30:09.232614 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913134b-479f-4ecb-9624-ee4bc4b3a649 service placement] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:30:09.242266 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913134b-479f-4ecb-9624-ee4bc4b3a649 service placement] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:30:09.245823 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b962d-53aa-4336-9698-4ce1eb64dedb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:30:09.246408 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b962d-53aa-4336-9698-4ce1eb64dedb service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:30:09.247164 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b962d-53aa-4336-9698-4ce1eb64dedb service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:30:09.247456 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b962d-53aa-4336-9698-4ce1eb64dedb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:30:09.249139 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-e85b962d-53aa-4336-9698-4ce1eb64dedb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:30:09.258265 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b962d-53aa-4336-9698-4ce1eb64dedb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:30:09.259663 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b962d-53aa-4336-9698-4ce1eb64dedb service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:30:09.268393 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 990/1996] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:30:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:30:13.976569 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0aeb7-5a9d-4e37-9de3-7427fe70958e service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:30:13.995362 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0aeb7-5a9d-4e37-9de3-7427fe70958e service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:30:14.003106 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253755d2-ba88-41a8-9b2e-51c667a20e46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:30:14.004212 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253755d2-ba88-41a8-9b2e-51c667a20e46 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:30:14.004761 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253755d2-ba88-41a8-9b2e-51c667a20e46 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:30:14.005347 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253755d2-ba88-41a8-9b2e-51c667a20e46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:30:14.007715 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-253755d2-ba88-41a8-9b2e-51c667a20e46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:30:14.025316 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253755d2-ba88-41a8-9b2e-51c667a20e46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:30:14.027301 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253755d2-ba88-41a8-9b2e-51c667a20e46 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:30:14.048738 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1007/1997] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:30:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:30:17.198302 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece4917-8967-4f22-86a1-6d75d3a560af None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:30:17.198787 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece4917-8967-4f22-86a1-6d75d3a560af None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:30:17.198972 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece4917-8967-4f22-86a1-6d75d3a560af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:30:17.218461 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-2ece4917-8967-4f22-86a1-6d75d3a560af None None] MFA Rules not processed for user `b59b96a78db44099838e00f6614052bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:30:17.219675 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2ece4917-8967-4f22-86a1-6d75d3a560af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:30:17.232232 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 991/1998] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:30:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:30:17.540345 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253755d2-ba88-41a8-9b2e-51c667a20e46 service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:30:17.550829 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253755d2-ba88-41a8-9b2e-51c667a20e46 service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:30:17.554489 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df491e-eb72-4098-9ade-4c453ca907d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:30:17.555087 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df491e-eb72-4098-9ade-4c453ca907d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:30:17.555362 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df491e-eb72-4098-9ade-4c453ca907d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:30:17.555661 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df491e-eb72-4098-9ade-4c453ca907d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:30:17.557355 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-43df491e-eb72-4098-9ade-4c453ca907d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:30:17.567360 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df491e-eb72-4098-9ade-4c453ca907d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:30:17.568850 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df491e-eb72-4098-9ade-4c453ca907d8 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:30:17.576870 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1008/1999] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:30:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:30:20.648994 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece4917-8967-4f22-86a1-6d75d3a560af None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:30:20.667869 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece4917-8967-4f22-86a1-6d75d3a560af None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:30:20.679427 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd8a663-ae77-47b5-b0ec-5312b6942207 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:30:20.680109 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8a663-ae77-47b5-b0ec-5312b6942207 service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:30:20.680391 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8a663-ae77-47b5-b0ec-5312b6942207 service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:30:20.680664 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8a663-ae77-47b5-b0ec-5312b6942207 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:30:20.682532 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-9cd8a663-ae77-47b5-b0ec-5312b6942207 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:30:20.706462 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd8a663-ae77-47b5-b0ec-5312b6942207 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:30:20.708066 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd8a663-ae77-47b5-b0ec-5312b6942207 service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:30:20.728269 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 992/2000] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:30:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:30:23.523548 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df491e-eb72-4098-9ade-4c453ca907d8 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:30:23.536864 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df491e-eb72-4098-9ade-4c453ca907d8 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:30:23.541820 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460aeb9-2754-4516-856c-27c5e7eeef2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:30:23.542446 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460aeb9-2754-4516-856c-27c5e7eeef2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:30:23.542862 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460aeb9-2754-4516-856c-27c5e7eeef2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:30:23.543142 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460aeb9-2754-4516-856c-27c5e7eeef2d admin admin] PATH_INFO: `/v3/users/3cea2695fb2c41c29b05c87b1ef75589` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:30:23.545187 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460aeb9-2754-4516-856c-27c5e7eeef2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cea2695fb2c41c29b05c87b1ef75589)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:30:23.547086 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460aeb9-2754-4516-856c-27c5e7eeef2d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:30:23.594033 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1460aeb9-2754-4516-856c-27c5e7eeef2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cea2695fb2c41c29b05c87b1ef75589'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:30:23.594612 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1460aeb9-2754-4516-856c-27c5e7eeef2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cea2695fb2c41c29b05c87b1ef75589'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:30:23.606778 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1460aeb9-2754-4516-856c-27c5e7eeef2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cea2695fb2c41c29b05c87b1ef75589'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:30:23.614210 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1460aeb9-2754-4516-856c-27c5e7eeef2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cea2695fb2c41c29b05c87b1ef75589'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:30:23.621478 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1460aeb9-2754-4516-856c-27c5e7eeef2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cea2695fb2c41c29b05c87b1ef75589'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:30:23.627623 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1009/2001] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:30:23 2022] DELETE /identity/v3/users/3cea2695fb2c41c29b05c87b1ef75589 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:30:23.814251 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd8a663-ae77-47b5-b0ec-5312b6942207 service nova] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:30:23.825899 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd8a663-ae77-47b5-b0ec-5312b6942207 service nova] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:30:23.883984 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40881d-9a0e-4c97-92bf-079fb1100ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:30:23.884623 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40881d-9a0e-4c97-92bf-079fb1100ffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:30:23.884897 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40881d-9a0e-4c97-92bf-079fb1100ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:30:23.885168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40881d-9a0e-4c97-92bf-079fb1100ffa admin admin] PATH_INFO: `/v3/projects/55c409ecb9c3494aa5eb6357e1c01b9f` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:30:23.886278 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab40881d-9a0e-4c97-92bf-079fb1100ffa admin admin] RBAC: Authorizing `identity:delete_project(project_id=55c409ecb9c3494aa5eb6357e1c01b9f)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:30:23.888919 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab40881d-9a0e-4c97-92bf-079fb1100ffa admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:30:23.938548 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ab40881d-9a0e-4c97-92bf-079fb1100ffa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55c409ecb9c3494aa5eb6357e1c01b9f', 'request_id': 'req-ab40881d-9a0e-4c97-92bf-079fb1100ffa'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:30:23.944789 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ab40881d-9a0e-4c97-92bf-079fb1100ffa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55c409ecb9c3494aa5eb6357e1c01b9f', 'request_id': 'req-ab40881d-9a0e-4c97-92bf-079fb1100ffa'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:30:23.953421 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ab40881d-9a0e-4c97-92bf-079fb1100ffa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55c409ecb9c3494aa5eb6357e1c01b9f', 'request_id': 'req-ab40881d-9a0e-4c97-92bf-079fb1100ffa'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:30:23.964974 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ab40881d-9a0e-4c97-92bf-079fb1100ffa admin admin] The token cache is being invalidate because project 55c409ecb9c3494aa5eb6357e1c01b9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:30:23.965669 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ab40881d-9a0e-4c97-92bf-079fb1100ffa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:30:23.966352 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ab40881d-9a0e-4c97-92bf-079fb1100ffa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:30:23.967851 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 993/2002] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:30:23 2022] DELETE /identity/v3/projects/55c409ecb9c3494aa5eb6357e1c01b9f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:30:23.972828 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11a441-4a0a-4562-ba0d-8f11614d708f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:30:23.973113 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11a441-4a0a-4562-ba0d-8f11614d708f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:30:23.973387 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11a441-4a0a-4562-ba0d-8f11614d708f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:30:23.993976 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-ab11a441-4a0a-4562-ba0d-8f11614d708f None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:30:23.995182 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ab11a441-4a0a-4562-ba0d-8f11614d708f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:30:24.037556 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:30:24.059521 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1010/2003] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:30:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:30:24.124629 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf11e6-d2c2-48f3-ae92-9523b9a3671d None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:30:24.124918 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf11e6-d2c2-48f3-ae92-9523b9a3671d None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:30:24.125194 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf11e6-d2c2-48f3-ae92-9523b9a3671d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:30:24.145407 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-cbdf11e6-d2c2-48f3-ae92-9523b9a3671d None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:30:24.146615 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-cbdf11e6-d2c2-48f3-ae92-9523b9a3671d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:30:24.154929 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 994/2004] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:30:24.158766 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11a441-4a0a-4562-ba0d-8f11614d708f None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:30:24.168428 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11a441-4a0a-4562-ba0d-8f11614d708f None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:30:24.173761 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c48516-3c00-4d86-a67b-1b1ad8d82c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:30:24.174388 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c48516-3c00-4d86-a67b-1b1ad8d82c0f admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:30:24.174668 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c48516-3c00-4d86-a67b-1b1ad8d82c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:30:24.174943 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c48516-3c00-4d86-a67b-1b1ad8d82c0f admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:30:24.175593 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c48516-3c00-4d86-a67b-1b1ad8d82c0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:30:24.175914 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c48516-3c00-4d86-a67b-1b1ad8d82c0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:30:24.177519 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c48516-3c00-4d86-a67b-1b1ad8d82c0f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:30:24.190639 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1011/2005] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:30:24.194888 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf11e6-d2c2-48f3-ae92-9523b9a3671d None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:30:24.204608 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf11e6-d2c2-48f3-ae92-9523b9a3671d None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:30:24.209294 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79547b-08fb-41de-9205-a1f5871c33b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:30:24.209897 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79547b-08fb-41de-9205-a1f5871c33b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:30:24.210176 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79547b-08fb-41de-9205-a1f5871c33b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:30:24.210447 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79547b-08fb-41de-9205-a1f5871c33b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:30:24.211072 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79547b-08fb-41de-9205-a1f5871c33b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:30:24.213040 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79547b-08fb-41de-9205-a1f5871c33b6 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:30:24.243313 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 995/2006] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:30:24 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:30:24.248811 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c48516-3c00-4d86-a67b-1b1ad8d82c0f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:30:24.258792 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c48516-3c00-4d86-a67b-1b1ad8d82c0f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:30:24.317312 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393b563-53a1-4dcf-ba68-7ba93ace562d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:30:24.317922 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393b563-53a1-4dcf-ba68-7ba93ace562d admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:30:24.318203 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393b563-53a1-4dcf-ba68-7ba93ace562d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:30:24.318477 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393b563-53a1-4dcf-ba68-7ba93ace562d admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:30:24.319118 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c393b563-53a1-4dcf-ba68-7ba93ace562d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:30:24.321061 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c393b563-53a1-4dcf-ba68-7ba93ace562d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:30:24.344658 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1012/2007] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:30:24 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:30:24.348946 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79547b-08fb-41de-9205-a1f5871c33b6 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:30:24.359737 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79547b-08fb-41de-9205-a1f5871c33b6 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:30:24.364400 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290da09-f419-4f63-97c9-244fe1e4d393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:30:24.365001 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290da09-f419-4f63-97c9-244fe1e4d393 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:30:24.365277 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290da09-f419-4f63-97c9-244fe1e4d393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:30:24.365547 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290da09-f419-4f63-97c9-244fe1e4d393 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:30:24.366192 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290da09-f419-4f63-97c9-244fe1e4d393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:30:24.367799 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290da09-f419-4f63-97c9-244fe1e4d393 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:30:24.379436 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 996/2008] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:30:24.383560 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393b563-53a1-4dcf-ba68-7ba93ace562d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:30:24.395185 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393b563-53a1-4dcf-ba68-7ba93ace562d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:30:24.400015 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35508d-57db-4094-a079-904bfd0748ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:30:24.400645 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35508d-57db-4094-a079-904bfd0748ee admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:30:24.400934 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35508d-57db-4094-a079-904bfd0748ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:30:24.401243 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35508d-57db-4094-a079-904bfd0748ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:30:24.402236 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35508d-57db-4094-a079-904bfd0748ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:30:24.404749 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35508d-57db-4094-a079-904bfd0748ee admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:30:24.417168 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1013/2009] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:30:24.422570 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290da09-f419-4f63-97c9-244fe1e4d393 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:30:24.432907 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290da09-f419-4f63-97c9-244fe1e4d393 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:30:24.438390 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8091f-a177-464c-8638-46859f610a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:30:24.439069 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8091f-a177-464c-8638-46859f610a0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:30:24.439373 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8091f-a177-464c-8638-46859f610a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:30:24.439647 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8091f-a177-464c-8638-46859f610a0d admin admin] PATH_INFO: `/v3/projects/b5d86fcd003b4061a0789ebfe2c10509/users/74f1fc245d3a4e80a4a3aaf079e9c4e3/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:30:24.456895 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8091f-a177-464c-8638-46859f610a0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5d86fcd003b4061a0789ebfe2c10509, user_id=74f1fc245d3a4e80a4a3aaf079e9c4e3, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:30:24.459547 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8091f-a177-464c-8638-46859f610a0d admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:30:24.461979 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:30:24.476005 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 997/2010] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:30:24 2022] PUT /identity/v3/projects/b5d86fcd003b4061a0789ebfe2c10509/users/74f1fc245d3a4e80a4a3aaf079e9c4e3/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:30:24.481542 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1032165-2eb8-4077-9907-8d0d3bee76fe None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:30:24.481830 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1032165-2eb8-4077-9907-8d0d3bee76fe None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:30:24.482107 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1032165-2eb8-4077-9907-8d0d3bee76fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:30:24.501796 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f1032165-2eb8-4077-9907-8d0d3bee76fe None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:30:24.503036 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f1032165-2eb8-4077-9907-8d0d3bee76fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:30:24.570328 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1014/2011] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:30:24.580755 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8091f-a177-464c-8638-46859f610a0d admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:30:24.582602 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-83b8091f-a177-464c-8638-46859f610a0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:30:24.641586 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8091f-a177-464c-8638-46859f610a0d admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:30:24.645345 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e9690-6f15-411b-9416-8da4b1e72d38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:30:24.645950 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e9690-6f15-411b-9416-8da4b1e72d38 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:30:24.646225 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e9690-6f15-411b-9416-8da4b1e72d38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:30:24.646493 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e9690-6f15-411b-9416-8da4b1e72d38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:30:24.656648 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e9690-6f15-411b-9416-8da4b1e72d38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:30:24.658067 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e9690-6f15-411b-9416-8da4b1e72d38 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:30:24.667463 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 998/2012] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:30:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:30:27.467643 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1032165-2eb8-4077-9907-8d0d3bee76fe None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:30:27.471817 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f1032165-2eb8-4077-9907-8d0d3bee76fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:30:27.597067 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:30:27.629341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1032165-2eb8-4077-9907-8d0d3bee76fe None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:30:27.646095 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead77e5-ff19-441e-b91a-579bb8952379 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:30:27.656235 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead77e5-ff19-441e-b91a-579bb8952379 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:30:27.657805 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead77e5-ff19-441e-b91a-579bb8952379 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:30:27.662139 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead77e5-ff19-441e-b91a-579bb8952379 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:30:27.669310 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-eead77e5-ff19-441e-b91a-579bb8952379 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:30:27.690432 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead77e5-ff19-441e-b91a-579bb8952379 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:30:27.692520 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead77e5-ff19-441e-b91a-579bb8952379 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:30:27.706977 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1015/2013] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:30:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:30:29.087844 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d79d6e-c0fe-4b82-b42a-be4e5ad1171c None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:30:29.088351 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d79d6e-c0fe-4b82-b42a-be4e5ad1171c None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:30:29.088448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d79d6e-c0fe-4b82-b42a-be4e5ad1171c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:30:29.126419 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-78d79d6e-c0fe-4b82-b42a-be4e5ad1171c None None] MFA Rules not processed for user `74f1fc245d3a4e80a4a3aaf079e9c4e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:30:29.128807 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-78d79d6e-c0fe-4b82-b42a-be4e5ad1171c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:30:29.206884 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 999/2014] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:30:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:30:29.211530 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead77e5-ff19-441e-b91a-579bb8952379 service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:30:29.223029 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead77e5-ff19-441e-b91a-579bb8952379 service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:30:29.228461 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8877805-f577-40a7-a6ac-02fa48b3ce9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:30:29.229090 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8877805-f577-40a7-a6ac-02fa48b3ce9b admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:30:29.229375 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8877805-f577-40a7-a6ac-02fa48b3ce9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:30:29.229653 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8877805-f577-40a7-a6ac-02fa48b3ce9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:30:29.230343 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8877805-f577-40a7-a6ac-02fa48b3ce9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:30:29.233808 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8877805-f577-40a7-a6ac-02fa48b3ce9b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:30:29.266495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1016/2015] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:30:29 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:30:29.270591 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d79d6e-c0fe-4b82-b42a-be4e5ad1171c None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:30:29.282624 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d79d6e-c0fe-4b82-b42a-be4e5ad1171c None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:30:29.350151 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359db5c4-c619-4fca-9a02-cfb773a359b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:30:29.350789 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359db5c4-c619-4fca-9a02-cfb773a359b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:30:29.351066 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359db5c4-c619-4fca-9a02-cfb773a359b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:30:29.351336 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359db5c4-c619-4fca-9a02-cfb773a359b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:30:29.352033 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359db5c4-c619-4fca-9a02-cfb773a359b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:30:29.353961 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359db5c4-c619-4fca-9a02-cfb773a359b7 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:30:29.376311 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1000/2016] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:30:29 2022] POST /identity/v3/users => generated 298 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:30:29.380315 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8877805-f577-40a7-a6ac-02fa48b3ce9b admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:30:29.391204 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8877805-f577-40a7-a6ac-02fa48b3ce9b admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:30:29.395956 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4185b9a-7971-421d-8259-96581a2d5f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:30:29.396824 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4185b9a-7971-421d-8259-96581a2d5f14 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:30:29.397237 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4185b9a-7971-421d-8259-96581a2d5f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:30:29.397518 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4185b9a-7971-421d-8259-96581a2d5f14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:30:29.398165 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4185b9a-7971-421d-8259-96581a2d5f14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:30:29.399793 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4185b9a-7971-421d-8259-96581a2d5f14 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:30:29.412111 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1017/2017] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:30:29.416302 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359db5c4-c619-4fca-9a02-cfb773a359b7 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:30:29.427046 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359db5c4-c619-4fca-9a02-cfb773a359b7 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:30:29.431787 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e6108-cab1-4da7-8676-fe055b5a6c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:30:29.432486 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e6108-cab1-4da7-8676-fe055b5a6c11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:30:29.432760 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e6108-cab1-4da7-8676-fe055b5a6c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:30:29.433038 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e6108-cab1-4da7-8676-fe055b5a6c11 admin admin] PATH_INFO: `/v3/projects/f859bac32708481e9a76e304f30e12eb/users/d1922277b8934630888d03e9161d8d64/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:30:29.447344 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:30:29.452228 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e6108-cab1-4da7-8676-fe055b5a6c11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f859bac32708481e9a76e304f30e12eb, user_id=d1922277b8934630888d03e9161d8d64, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:30:29.455514 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e6108-cab1-4da7-8676-fe055b5a6c11 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:30:29.472586 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1001/2018] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:30:29 2022] PUT /identity/v3/projects/f859bac32708481e9a76e304f30e12eb/users/d1922277b8934630888d03e9161d8d64/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:30:29.476854 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4185b9a-7971-421d-8259-96581a2d5f14 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:30:29.488210 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4185b9a-7971-421d-8259-96581a2d5f14 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:30:29.548459 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425c823-b3ec-45dc-a2f6-cab1ce348cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:30:29.549072 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425c823-b3ec-45dc-a2f6-cab1ce348cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:30:29.549722 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425c823-b3ec-45dc-a2f6-cab1ce348cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:30:29.550011 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425c823-b3ec-45dc-a2f6-cab1ce348cc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:30:29.550649 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2425c823-b3ec-45dc-a2f6-cab1ce348cc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:30:29.552285 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2425c823-b3ec-45dc-a2f6-cab1ce348cc9 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:30:29.563461 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1018/2019] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:30:29.567370 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e6108-cab1-4da7-8676-fe055b5a6c11 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:30:29.578006 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e6108-cab1-4da7-8676-fe055b5a6c11 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:30:29.582750 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4df3e-e131-434a-a284-bb547a50319f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:30:29.583413 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4df3e-e131-434a-a284-bb547a50319f admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:30:29.583708 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4df3e-e131-434a-a284-bb547a50319f admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:30:29.584037 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4df3e-e131-434a-a284-bb547a50319f admin admin] PATH_INFO: `/v3/projects/f859bac32708481e9a76e304f30e12eb/users/d1922277b8934630888d03e9161d8d64/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:30:29.585988 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4df3e-e131-434a-a284-bb547a50319f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f859bac32708481e9a76e304f30e12eb, user_id=d1922277b8934630888d03e9161d8d64, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:30:29.588677 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4df3e-e131-434a-a284-bb547a50319f admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:30:29.599970 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1002/2020] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:30:29 2022] PUT /identity/v3/projects/f859bac32708481e9a76e304f30e12eb/users/d1922277b8934630888d03e9161d8d64/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:30:35.368488 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ddbda7-9fb7-4049-aa8e-2252e31cc154 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:30:35.368989 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ddbda7-9fb7-4049-aa8e-2252e31cc154 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:30:35.369092 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ddbda7-9fb7-4049-aa8e-2252e31cc154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:30:35.399169 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a1ddbda7-9fb7-4049-aa8e-2252e31cc154 None None] MFA Rules not processed for user `d1922277b8934630888d03e9161d8d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:30:35.400420 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a1ddbda7-9fb7-4049-aa8e-2252e31cc154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:30:35.472946 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1019/2021] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:30:35 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:30:35.485541 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4df3e-e131-434a-a284-bb547a50319f admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:30:35.488109 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-75f4df3e-e131-434a-a284-bb547a50319f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:30:35.556605 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4df3e-e131-434a-a284-bb547a50319f admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:30:35.561269 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea60ba-58c3-4662-9e95-3c0a83eef27b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f67d808ffb4641b03f96406b3fe9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:30:35.561967 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea60ba-58c3-4662-9e95-3c0a83eef27b service glance] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:30:35.562929 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea60ba-58c3-4662-9e95-3c0a83eef27b service glance] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:30:35.563405 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea60ba-58c3-4662-9e95-3c0a83eef27b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:30:35.633982 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea60ba-58c3-4662-9e95-3c0a83eef27b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:30:35.635563 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea60ba-58c3-4662-9e95-3c0a83eef27b service glance] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:30:35.647636 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1003/2022] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:30:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:30:35.791500 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd45824-b67b-4931-9b79-2601cbf39657 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:30:35.791795 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd45824-b67b-4931-9b79-2601cbf39657 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:30:35.792130 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd45824-b67b-4931-9b79-2601cbf39657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:30:35.814253 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-bbd45824-b67b-4931-9b79-2601cbf39657 None None] MFA Rules not processed for user `9d5d4691dca848d58bd280d2fad79fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:30:35.815474 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-bbd45824-b67b-4931-9b79-2601cbf39657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:30:35.835725 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:30:35.876606 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1020/2023] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 25 13:30:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:30:35.942884 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea60ba-58c3-4662-9e95-3c0a83eef27b service glance] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:30:35.943788 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-efea60ba-58c3-4662-9e95-3c0a83eef27b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:30:36.026140 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea60ba-58c3-4662-9e95-3c0a83eef27b service glance] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:30:36.032026 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd2839-d823-4918-b928-8dfba70224ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07413369b0c14e878d04ee528487801d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:30:36.032653 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd2839-d823-4918-b928-8dfba70224ef service swift] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:30:36.032936 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd2839-d823-4918-b928-8dfba70224ef service swift] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:30:36.033205 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd2839-d823-4918-b928-8dfba70224ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:30:36.042202 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd2839-d823-4918-b928-8dfba70224ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:30:36.044552 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd2839-d823-4918-b928-8dfba70224ef service swift] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:30:36.055122 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1004/2024] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 25 13:30:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 25 13:30:40.365886 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd45824-b67b-4931-9b79-2601cbf39657 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:30:40.367365 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-bbd45824-b67b-4931-9b79-2601cbf39657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:30:40.458778 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd45824-b67b-4931-9b79-2601cbf39657 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:30:40.464157 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06ed17-277b-4d55-b43c-07c7ba704c54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:30:40.465016 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06ed17-277b-4d55-b43c-07c7ba704c54 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:30:40.465468 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06ed17-277b-4d55-b43c-07c7ba704c54 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:30:40.465813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06ed17-277b-4d55-b43c-07c7ba704c54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:30:40.468751 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cb06ed17-277b-4d55-b43c-07c7ba704c54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:30:40.556103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb06ed17-277b-4d55-b43c-07c7ba704c54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:30:40.558089 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb06ed17-277b-4d55-b43c-07c7ba704c54 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:30:40.574115 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1021/2025] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:30:40 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:30:45.329491 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4dcce-90c9-442c-9ba5-4b9b12acce12 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:30:45.329969 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4dcce-90c9-442c-9ba5-4b9b12acce12 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:30:45.330062 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4dcce-90c9-442c-9ba5-4b9b12acce12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:30:45.349885 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-5ea4dcce-90c9-442c-9ba5-4b9b12acce12 None None] MFA Rules not processed for user `74f1fc245d3a4e80a4a3aaf079e9c4e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:30:45.351088 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-5ea4dcce-90c9-442c-9ba5-4b9b12acce12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:30:45.358578 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1005/2026] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:30:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:30:47.923755 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217428f7-e6f1-4dfd-82bc-a0502f328cb6 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:30:47.925690 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217428f7-e6f1-4dfd-82bc-a0502f328cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:30:47.926179 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217428f7-e6f1-4dfd-82bc-a0502f328cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:30:47.948826 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-217428f7-e6f1-4dfd-82bc-a0502f328cb6 None None] MFA Rules not processed for user `9d5d4691dca848d58bd280d2fad79fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:30:47.950833 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-217428f7-e6f1-4dfd-82bc-a0502f328cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:30:47.958993 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1022/2027] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 25 13:30:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:30:47.972068 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4dcce-90c9-442c-9ba5-4b9b12acce12 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:30:47.985165 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4dcce-90c9-442c-9ba5-4b9b12acce12 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:30:47.991308 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eac0f9-494b-4f2a-a3c9-367670f7b57c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07413369b0c14e878d04ee528487801d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:30:47.992104 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eac0f9-494b-4f2a-a3c9-367670f7b57c service swift] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:30:47.992639 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eac0f9-494b-4f2a-a3c9-367670f7b57c service swift] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:30:47.993004 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eac0f9-494b-4f2a-a3c9-367670f7b57c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:30:48.004694 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eac0f9-494b-4f2a-a3c9-367670f7b57c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:30:48.006473 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eac0f9-494b-4f2a-a3c9-367670f7b57c service swift] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:30:48.015792 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1006/2028] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 25 13:30:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 25 13:30:57.941970 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=65 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:30:58.011827 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:31:17.216591 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217428f7-e6f1-4dfd-82bc-a0502f328cb6 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:17.217988 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-217428f7-e6f1-4dfd-82bc-a0502f328cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:17.274293 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217428f7-e6f1-4dfd-82bc-a0502f328cb6 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:17.277944 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceaa608-769f-444d-aa7c-904f19497594 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:17.278552 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceaa608-769f-444d-aa7c-904f19497594 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:17.278834 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceaa608-769f-444d-aa7c-904f19497594 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:17.279110 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceaa608-769f-444d-aa7c-904f19497594 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:17.280863 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-eceaa608-769f-444d-aa7c-904f19497594 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:17.349563 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceaa608-769f-444d-aa7c-904f19497594 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:17.351004 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceaa608-769f-444d-aa7c-904f19497594 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:17.361000 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1023/2029] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:31:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:31:20.130477 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ee8b9-b793-45cb-9eb2-9cabc8a525bf None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:20.130477 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ee8b9-b793-45cb-9eb2-9cabc8a525bf None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:20.130477 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ee8b9-b793-45cb-9eb2-9cabc8a525bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:20.152976 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-289ee8b9-b793-45cb-9eb2-9cabc8a525bf None None] MFA Rules not processed for user `2a2ed118a399479ab355bfd5734d04d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:31:20.154245 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-289ee8b9-b793-45cb-9eb2-9cabc8a525bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:20.232112 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1007/2030] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:31:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:31:21.039264 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceaa608-769f-444d-aa7c-904f19497594 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:21.040766 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-eceaa608-769f-444d-aa7c-904f19497594 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:21.060518 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ee8b9-b793-45cb-9eb2-9cabc8a525bf None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:21.062123 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceaa608-769f-444d-aa7c-904f19497594 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:21.070962 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088c702-7985-4071-8a24-01ce3d81d36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:21.071629 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088c702-7985-4071-8a24-01ce3d81d36f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:21.072132 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088c702-7985-4071-8a24-01ce3d81d36f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:21.072791 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088c702-7985-4071-8a24-01ce3d81d36f admin admin] PATH_INFO: `/v3/users/04d684ea21984ff699fea2c637044c3d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:21.075134 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e088c702-7985-4071-8a24-01ce3d81d36f admin admin] RBAC: Authorizing `identity:delete_user(user_id=04d684ea21984ff699fea2c637044c3d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:21.077669 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e088c702-7985-4071-8a24-01ce3d81d36f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:21.078562 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ee8b9-b793-45cb-9eb2-9cabc8a525bf None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:21.085570 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3e52f-43e8-4a9e-a8e6-9514255670df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:21.086316 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3e52f-43e8-4a9e-a8e6-9514255670df service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:21.086600 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3e52f-43e8-4a9e-a8e6-9514255670df service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:21.086869 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3e52f-43e8-4a9e-a8e6-9514255670df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:21.098978 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3e52f-43e8-4a9e-a8e6-9514255670df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:21.100682 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3e52f-43e8-4a9e-a8e6-9514255670df service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:21.116417 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1008/2031] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:31:21 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 13:31:21.144794 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e088c702-7985-4071-8a24-01ce3d81d36f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04d684ea21984ff699fea2c637044c3d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:21.145534 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e088c702-7985-4071-8a24-01ce3d81d36f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04d684ea21984ff699fea2c637044c3d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:21.159161 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e088c702-7985-4071-8a24-01ce3d81d36f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04d684ea21984ff699fea2c637044c3d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:21.167759 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e088c702-7985-4071-8a24-01ce3d81d36f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04d684ea21984ff699fea2c637044c3d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:21.196138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e088c702-7985-4071-8a24-01ce3d81d36f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04d684ea21984ff699fea2c637044c3d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:21.206111 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1024/2032] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:31:21 2022] DELETE /identity/v3/users/04d684ea21984ff699fea2c637044c3d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:31:21.395260 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3e52f-43e8-4a9e-a8e6-9514255670df service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:21.434900 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3e52f-43e8-4a9e-a8e6-9514255670df service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:21.507224 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c53a8-9bf6-4a29-a201-c8d5eed4364a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:21.508220 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c53a8-9bf6-4a29-a201-c8d5eed4364a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:21.508675 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c53a8-9bf6-4a29-a201-c8d5eed4364a admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:21.508957 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c53a8-9bf6-4a29-a201-c8d5eed4364a admin admin] PATH_INFO: `/v3/projects/6708288a01964a62b8e86bf5988837d2` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:21.510145 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c53a8-9bf6-4a29-a201-c8d5eed4364a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6708288a01964a62b8e86bf5988837d2)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:21.512058 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c53a8-9bf6-4a29-a201-c8d5eed4364a admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:21.565826 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b42c53a8-9bf6-4a29-a201-c8d5eed4364a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6708288a01964a62b8e86bf5988837d2', 'request_id': 'req-b42c53a8-9bf6-4a29-a201-c8d5eed4364a'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:21.572180 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b42c53a8-9bf6-4a29-a201-c8d5eed4364a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6708288a01964a62b8e86bf5988837d2', 'request_id': 'req-b42c53a8-9bf6-4a29-a201-c8d5eed4364a'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:21.582915 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b42c53a8-9bf6-4a29-a201-c8d5eed4364a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6708288a01964a62b8e86bf5988837d2', 'request_id': 'req-b42c53a8-9bf6-4a29-a201-c8d5eed4364a'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:21.595845 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b42c53a8-9bf6-4a29-a201-c8d5eed4364a admin admin] The token cache is being invalidate because project 6708288a01964a62b8e86bf5988837d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:31:21.596223 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b42c53a8-9bf6-4a29-a201-c8d5eed4364a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:21.596976 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b42c53a8-9bf6-4a29-a201-c8d5eed4364a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:21.599028 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1009/2033] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:31:21 2022] DELETE /identity/v3/projects/6708288a01964a62b8e86bf5988837d2 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:31:21.603681 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb1f1d-fed3-412c-a081-4199451c62e3 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:21.603998 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb1f1d-fed3-412c-a081-4199451c62e3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:21.604276 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb1f1d-fed3-412c-a081-4199451c62e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:21.632710 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c5fb1f1d-fed3-412c-a081-4199451c62e3 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:31:21.635028 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c5fb1f1d-fed3-412c-a081-4199451c62e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:21.662440 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:31:21.710606 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1025/2034] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:31:21.722331 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9a7e4-1eb9-4aa5-8d27-3ea6377c6144 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:21.725687 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9a7e4-1eb9-4aa5-8d27-3ea6377c6144 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:21.726338 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9a7e4-1eb9-4aa5-8d27-3ea6377c6144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:21.747277 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-77f9a7e4-1eb9-4aa5-8d27-3ea6377c6144 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:31:21.748556 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-77f9a7e4-1eb9-4aa5-8d27-3ea6377c6144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:21.757608 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1010/2035] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:31:21.761587 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb1f1d-fed3-412c-a081-4199451c62e3 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:21.773200 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb1f1d-fed3-412c-a081-4199451c62e3 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:21.778695 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29640f4-510b-4d53-87f8-bb328b7a2888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:21.779357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29640f4-510b-4d53-87f8-bb328b7a2888 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:21.779826 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29640f4-510b-4d53-87f8-bb328b7a2888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:21.780322 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29640f4-510b-4d53-87f8-bb328b7a2888 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:21.780973 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29640f4-510b-4d53-87f8-bb328b7a2888 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:31:21.781305 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29640f4-510b-4d53-87f8-bb328b7a2888 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:21.783536 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29640f4-510b-4d53-87f8-bb328b7a2888 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:21.796705 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1026/2036] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:31:21.801436 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9a7e4-1eb9-4aa5-8d27-3ea6377c6144 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:21.811135 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9a7e4-1eb9-4aa5-8d27-3ea6377c6144 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:21.817569 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba230f2-ffce-4586-9bae-83c0662c50c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:21.818356 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba230f2-ffce-4586-9bae-83c0662c50c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:21.818648 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba230f2-ffce-4586-9bae-83c0662c50c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:21.818922 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba230f2-ffce-4586-9bae-83c0662c50c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:21.819575 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba230f2-ffce-4586-9bae-83c0662c50c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:21.821559 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba230f2-ffce-4586-9bae-83c0662c50c4 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:21.840925 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:31:21.860082 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1011/2037] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:31:21 2022] POST /identity/v3/projects => generated 365 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:31:21.862377 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29640f4-510b-4d53-87f8-bb328b7a2888 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:21.873864 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29640f4-510b-4d53-87f8-bb328b7a2888 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:21.944498 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053084e5-bcfe-4066-85cd-13efd7854813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:21.945118 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053084e5-bcfe-4066-85cd-13efd7854813 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:21.945404 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053084e5-bcfe-4066-85cd-13efd7854813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:21.945757 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053084e5-bcfe-4066-85cd-13efd7854813 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:21.946322 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053084e5-bcfe-4066-85cd-13efd7854813 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:21.948472 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053084e5-bcfe-4066-85cd-13efd7854813 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:21.976373 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1027/2038] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:31:21 2022] POST /identity/v3/users => generated 283 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:31:21.978008 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba230f2-ffce-4586-9bae-83c0662c50c4 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:21.995943 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba230f2-ffce-4586-9bae-83c0662c50c4 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:22.000705 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b1ca1-6ce9-4920-ad3c-ec1558ff1795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:22.001346 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b1ca1-6ce9-4920-ad3c-ec1558ff1795 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:22.001700 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b1ca1-6ce9-4920-ad3c-ec1558ff1795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:22.002004 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b1ca1-6ce9-4920-ad3c-ec1558ff1795 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:22.002657 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11b1ca1-6ce9-4920-ad3c-ec1558ff1795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:22.004336 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11b1ca1-6ce9-4920-ad3c-ec1558ff1795 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:22.015116 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1012/2039] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:31:22.020007 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053084e5-bcfe-4066-85cd-13efd7854813 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:22.030737 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053084e5-bcfe-4066-85cd-13efd7854813 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:22.036182 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60a9c3-8148-432e-883f-77b7d90f7bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:22.036801 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60a9c3-8148-432e-883f-77b7d90f7bbe admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:22.037087 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60a9c3-8148-432e-883f-77b7d90f7bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:22.037364 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60a9c3-8148-432e-883f-77b7d90f7bbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:22.038012 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60a9c3-8148-432e-883f-77b7d90f7bbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:22.039619 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60a9c3-8148-432e-883f-77b7d90f7bbe admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:22.051889 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1028/2040] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:31:22.056069 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b1ca1-6ce9-4920-ad3c-ec1558ff1795 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:22.067461 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b1ca1-6ce9-4920-ad3c-ec1558ff1795 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:22.072244 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f44ef5-5fb4-45f0-9d59-26db970e47ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:22.072935 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f44ef5-5fb4-45f0-9d59-26db970e47ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:22.073214 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f44ef5-5fb4-45f0-9d59-26db970e47ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:22.073490 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f44ef5-5fb4-45f0-9d59-26db970e47ab admin admin] PATH_INFO: `/v3/projects/b2cb6444b85741f7b75e9456ec30c274/users/dc513bd44cd9453faa9f06af3046902d/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:22.089382 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f44ef5-5fb4-45f0-9d59-26db970e47ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2cb6444b85741f7b75e9456ec30c274, user_id=dc513bd44cd9453faa9f06af3046902d, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:22.092092 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f44ef5-5fb4-45f0-9d59-26db970e47ab admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:22.107532 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1013/2041] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:31:22 2022] PUT /identity/v3/projects/b2cb6444b85741f7b75e9456ec30c274/users/dc513bd44cd9453faa9f06af3046902d/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:31:22.118969 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a430f0c-8e3c-4c85-b8b7-9e7fc5e6a362 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:22.119407 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a430f0c-8e3c-4c85-b8b7-9e7fc5e6a362 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:22.119689 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a430f0c-8e3c-4c85-b8b7-9e7fc5e6a362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:22.150815 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-4a430f0c-8e3c-4c85-b8b7-9e7fc5e6a362 None None] MFA Rules not processed for user `dc513bd44cd9453faa9f06af3046902d`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:31:22.152070 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4a430f0c-8e3c-4c85-b8b7-9e7fc5e6a362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:22.226249 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1029/2042] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:31:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:31:22.230396 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f44ef5-5fb4-45f0-9d59-26db970e47ab admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:22.320992 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f44ef5-5fb4-45f0-9d59-26db970e47ab admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:22.326812 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd448a-3524-4eb4-bbde-643ace353aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:22.327441 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd448a-3524-4eb4-bbde-643ace353aaf admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:22.327724 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd448a-3524-4eb4-bbde-643ace353aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:22.328069 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd448a-3524-4eb4-bbde-643ace353aaf admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:22.328971 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd448a-3524-4eb4-bbde-643ace353aaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:22.330941 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd448a-3524-4eb4-bbde-643ace353aaf admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:22.378897 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1014/2043] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:31:22 2022] POST /identity/v3/projects => generated 365 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:31:22.383036 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a430f0c-8e3c-4c85-b8b7-9e7fc5e6a362 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:22.395415 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a430f0c-8e3c-4c85-b8b7-9e7fc5e6a362 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:22.426484 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:31:22.494649 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a252993-71e9-48e9-9ccc-6ead6d563e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:22.495765 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a252993-71e9-48e9-9ccc-6ead6d563e30 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:22.496288 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a252993-71e9-48e9-9ccc-6ead6d563e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:22.497530 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a252993-71e9-48e9-9ccc-6ead6d563e30 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:22.498354 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a252993-71e9-48e9-9ccc-6ead6d563e30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:22.502334 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a252993-71e9-48e9-9ccc-6ead6d563e30 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:22.527363 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1030/2044] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:31:22 2022] POST /identity/v3/users => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:31:22.531437 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd448a-3524-4eb4-bbde-643ace353aaf admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:22.550399 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd448a-3524-4eb4-bbde-643ace353aaf admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:22.558670 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48f982-7f73-4a82-aa06-c85daaca3056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:22.559686 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48f982-7f73-4a82-aa06-c85daaca3056 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:22.560068 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48f982-7f73-4a82-aa06-c85daaca3056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:22.561244 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48f982-7f73-4a82-aa06-c85daaca3056 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:22.562517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48f982-7f73-4a82-aa06-c85daaca3056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:22.564777 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48f982-7f73-4a82-aa06-c85daaca3056 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:22.576310 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1015/2045] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:31:22.581046 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a252993-71e9-48e9-9ccc-6ead6d563e30 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:22.591246 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a252993-71e9-48e9-9ccc-6ead6d563e30 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:22.596202 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795c079-97d1-4ec5-86e8-7e154da6f83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:22.596982 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795c079-97d1-4ec5-86e8-7e154da6f83f admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:22.597268 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795c079-97d1-4ec5-86e8-7e154da6f83f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:22.597549 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795c079-97d1-4ec5-86e8-7e154da6f83f admin admin] PATH_INFO: `/v3/projects/5956be747fec48e5bc75ddc018e6087e/users/a27457fd06e6498d842004a0c949c625/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:22.615526 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b795c079-97d1-4ec5-86e8-7e154da6f83f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5956be747fec48e5bc75ddc018e6087e, user_id=a27457fd06e6498d842004a0c949c625, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:22.618254 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b795c079-97d1-4ec5-86e8-7e154da6f83f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:22.635765 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1031/2046] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:31:22 2022] PUT /identity/v3/projects/5956be747fec48e5bc75ddc018e6087e/users/a27457fd06e6498d842004a0c949c625/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:31:22.636994 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48f982-7f73-4a82-aa06-c85daaca3056 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:22.647040 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48f982-7f73-4a82-aa06-c85daaca3056 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:22.708894 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183e0e4-6fe7-45ff-a785-b7da829d377b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:22.709879 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183e0e4-6fe7-45ff-a785-b7da829d377b admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:22.710160 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183e0e4-6fe7-45ff-a785-b7da829d377b admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:22.710612 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183e0e4-6fe7-45ff-a785-b7da829d377b admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:22.711400 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183e0e4-6fe7-45ff-a785-b7da829d377b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:22.713043 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183e0e4-6fe7-45ff-a785-b7da829d377b admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:22.734706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1016/2047] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:31:22.739912 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795c079-97d1-4ec5-86e8-7e154da6f83f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:22.752511 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795c079-97d1-4ec5-86e8-7e154da6f83f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:22.757556 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bbcbbf-793d-4470-9b68-c64b4c6a9330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:22.758420 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbcbbf-793d-4470-9b68-c64b4c6a9330 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:22.758550 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbcbbf-793d-4470-9b68-c64b4c6a9330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:22.758823 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbcbbf-793d-4470-9b68-c64b4c6a9330 admin admin] PATH_INFO: `/v3/projects/5956be747fec48e5bc75ddc018e6087e/users/a27457fd06e6498d842004a0c949c625/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:22.760811 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bbcbbf-793d-4470-9b68-c64b4c6a9330 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5956be747fec48e5bc75ddc018e6087e, user_id=a27457fd06e6498d842004a0c949c625, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:22.763591 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bbcbbf-793d-4470-9b68-c64b4c6a9330 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:22.775623 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1032/2048] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:31:22 2022] PUT /identity/v3/projects/5956be747fec48e5bc75ddc018e6087e/users/a27457fd06e6498d842004a0c949c625/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:31:22.787031 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513ff6b-2fc9-4ef9-9757-a8774fc5da9b None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:22.788400 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513ff6b-2fc9-4ef9-9757-a8774fc5da9b None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:22.788717 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513ff6b-2fc9-4ef9-9757-a8774fc5da9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:22.824258 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-b513ff6b-2fc9-4ef9-9757-a8774fc5da9b None None] MFA Rules not processed for user `a27457fd06e6498d842004a0c949c625`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:31:22.825752 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b513ff6b-2fc9-4ef9-9757-a8774fc5da9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:22.846701 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:31:22.915261 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1017/2049] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:31:22 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:31:22.927262 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bbcbbf-793d-4470-9b68-c64b4c6a9330 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:22.929284 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f6bbcbbf-793d-4470-9b68-c64b4c6a9330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:23.002879 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bbcbbf-793d-4470-9b68-c64b4c6a9330 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:23.007553 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e0b713-2879-40d5-907a-465da2190660 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:23.008410 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0b713-2879-40d5-907a-465da2190660 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:23.008762 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0b713-2879-40d5-907a-465da2190660 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:23.009103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0b713-2879-40d5-907a-465da2190660 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:23.020891 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e0b713-2879-40d5-907a-465da2190660 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:23.023148 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e0b713-2879-40d5-907a-465da2190660 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:23.036152 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1033/2050] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:31:22 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:31:23.692998 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513ff6b-2fc9-4ef9-9757-a8774fc5da9b None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:23.785341 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513ff6b-2fc9-4ef9-9757-a8774fc5da9b None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:23.790430 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1524a3c-3a68-498d-82c5-07756e4ff393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:23.791404 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1524a3c-3a68-498d-82c5-07756e4ff393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:23.791936 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1524a3c-3a68-498d-82c5-07756e4ff393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:23.792473 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1524a3c-3a68-498d-82c5-07756e4ff393 admin admin] PATH_INFO: `/v3/users/dc513bd44cd9453faa9f06af3046902d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:23.793893 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1524a3c-3a68-498d-82c5-07756e4ff393 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc513bd44cd9453faa9f06af3046902d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:23.796832 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1524a3c-3a68-498d-82c5-07756e4ff393 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:23.860757 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f1524a3c-3a68-498d-82c5-07756e4ff393 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc513bd44cd9453faa9f06af3046902d'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:23.891408 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f1524a3c-3a68-498d-82c5-07756e4ff393 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc513bd44cd9453faa9f06af3046902d'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:23.895354 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f1524a3c-3a68-498d-82c5-07756e4ff393 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc513bd44cd9453faa9f06af3046902d'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:23.943003 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f1524a3c-3a68-498d-82c5-07756e4ff393 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc513bd44cd9453faa9f06af3046902d'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:23.943600 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f1524a3c-3a68-498d-82c5-07756e4ff393 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc513bd44cd9453faa9f06af3046902d'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:23.967269 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1018/2051] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:31:23 2022] DELETE /identity/v3/users/dc513bd44cd9453faa9f06af3046902d => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:31:23.973960 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804e79a-964f-428b-83e5-4db8851f35e2 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:23.974542 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804e79a-964f-428b-83e5-4db8851f35e2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:23.974542 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804e79a-964f-428b-83e5-4db8851f35e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:23.997849 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-b804e79a-964f-428b-83e5-4db8851f35e2 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:31:23.999292 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b804e79a-964f-428b-83e5-4db8851f35e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:24.092939 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1034/2052] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:31:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:31:24.131441 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1524a3c-3a68-498d-82c5-07756e4ff393 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:24.132932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-f1524a3c-3a68-498d-82c5-07756e4ff393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:24.184906 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:31:24.219765 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1524a3c-3a68-498d-82c5-07756e4ff393 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:24.223850 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b088674-767c-4117-bdaa-010edd8b6712 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:24.224501 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b088674-767c-4117-bdaa-010edd8b6712 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:24.224781 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b088674-767c-4117-bdaa-010edd8b6712 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:24.225057 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b088674-767c-4117-bdaa-010edd8b6712 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:24.239771 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b088674-767c-4117-bdaa-010edd8b6712 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:24.242594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b088674-767c-4117-bdaa-010edd8b6712 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:24.254239 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1019/2053] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:31:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:31:24.969841 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804e79a-964f-428b-83e5-4db8851f35e2 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:24.972967 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b804e79a-964f-428b-83e5-4db8851f35e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:24.996498 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804e79a-964f-428b-83e5-4db8851f35e2 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:25.003767 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af7d25b-f300-4a0a-8b34-e0e93446923b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:25.004452 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7d25b-f300-4a0a-8b34-e0e93446923b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:25.004732 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7d25b-f300-4a0a-8b34-e0e93446923b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:25.005004 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7d25b-f300-4a0a-8b34-e0e93446923b admin admin] PATH_INFO: `/v3/projects/b2cb6444b85741f7b75e9456ec30c274` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:25.006343 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af7d25b-f300-4a0a-8b34-e0e93446923b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2cb6444b85741f7b75e9456ec30c274)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:25.008741 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af7d25b-f300-4a0a-8b34-e0e93446923b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:25.020859 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:31:25.067744 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5af7d25b-f300-4a0a-8b34-e0e93446923b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2cb6444b85741f7b75e9456ec30c274', 'request_id': 'req-5af7d25b-f300-4a0a-8b34-e0e93446923b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:25.075886 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5af7d25b-f300-4a0a-8b34-e0e93446923b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2cb6444b85741f7b75e9456ec30c274', 'request_id': 'req-5af7d25b-f300-4a0a-8b34-e0e93446923b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:25.082845 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5af7d25b-f300-4a0a-8b34-e0e93446923b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2cb6444b85741f7b75e9456ec30c274', 'request_id': 'req-5af7d25b-f300-4a0a-8b34-e0e93446923b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:25.096621 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5af7d25b-f300-4a0a-8b34-e0e93446923b admin admin] The token cache is being invalidate because project b2cb6444b85741f7b75e9456ec30c274 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:31:25.096922 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5af7d25b-f300-4a0a-8b34-e0e93446923b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:25.097584 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5af7d25b-f300-4a0a-8b34-e0e93446923b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:25.099104 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1035/2054] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:31:24 2022] DELETE /identity/v3/projects/b2cb6444b85741f7b75e9456ec30c274 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:31:25.103152 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b088674-767c-4117-bdaa-010edd8b6712 service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:25.113242 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b088674-767c-4117-bdaa-010edd8b6712 service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:25.174863 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c112c4-533d-4f4f-8d02-66ac6789b111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:25.175497 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c112c4-533d-4f4f-8d02-66ac6789b111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:25.175774 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c112c4-533d-4f4f-8d02-66ac6789b111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:25.176095 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c112c4-533d-4f4f-8d02-66ac6789b111 admin admin] PATH_INFO: `/v3/users/a27457fd06e6498d842004a0c949c625` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:25.177225 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c112c4-533d-4f4f-8d02-66ac6789b111 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a27457fd06e6498d842004a0c949c625)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:25.179278 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c112c4-533d-4f4f-8d02-66ac6789b111 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:25.301265 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-77c112c4-533d-4f4f-8d02-66ac6789b111 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a27457fd06e6498d842004a0c949c625'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:25.323975 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-77c112c4-533d-4f4f-8d02-66ac6789b111 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a27457fd06e6498d842004a0c949c625'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:25.325242 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-77c112c4-533d-4f4f-8d02-66ac6789b111 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a27457fd06e6498d842004a0c949c625'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:25.334049 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-77c112c4-533d-4f4f-8d02-66ac6789b111 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a27457fd06e6498d842004a0c949c625'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:25.334707 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-77c112c4-533d-4f4f-8d02-66ac6789b111 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a27457fd06e6498d842004a0c949c625'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:25.351302 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1020/2055] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:31:25 2022] DELETE /identity/v3/users/a27457fd06e6498d842004a0c949c625 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:31:25.753571 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af7d25b-f300-4a0a-8b34-e0e93446923b admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:25.755021 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5af7d25b-f300-4a0a-8b34-e0e93446923b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:25.784475 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af7d25b-f300-4a0a-8b34-e0e93446923b admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:25.843143 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6453d65-2134-4190-926d-a9dc069a787e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:25.843772 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6453d65-2134-4190-926d-a9dc069a787e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:25.844081 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6453d65-2134-4190-926d-a9dc069a787e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:25.844356 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6453d65-2134-4190-926d-a9dc069a787e admin admin] PATH_INFO: `/v3/projects/5956be747fec48e5bc75ddc018e6087e` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:25.846219 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6453d65-2134-4190-926d-a9dc069a787e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5956be747fec48e5bc75ddc018e6087e)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:25.848204 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6453d65-2134-4190-926d-a9dc069a787e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:25.897145 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b6453d65-2134-4190-926d-a9dc069a787e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5956be747fec48e5bc75ddc018e6087e', 'request_id': 'req-b6453d65-2134-4190-926d-a9dc069a787e'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:25.906239 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b6453d65-2134-4190-926d-a9dc069a787e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5956be747fec48e5bc75ddc018e6087e', 'request_id': 'req-b6453d65-2134-4190-926d-a9dc069a787e'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:25.912959 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b6453d65-2134-4190-926d-a9dc069a787e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5956be747fec48e5bc75ddc018e6087e', 'request_id': 'req-b6453d65-2134-4190-926d-a9dc069a787e'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:25.926256 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b6453d65-2134-4190-926d-a9dc069a787e admin admin] The token cache is being invalidate because project 5956be747fec48e5bc75ddc018e6087e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:31:25.926256 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b6453d65-2134-4190-926d-a9dc069a787e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:25.926495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b6453d65-2134-4190-926d-a9dc069a787e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:25.928474 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1036/2056] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:31:25 2022] DELETE /identity/v3/projects/5956be747fec48e5bc75ddc018e6087e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:31:25.932779 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5e6b5-13dd-40db-b667-3ca0a7763b28 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:25.933076 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5e6b5-13dd-40db-b667-3ca0a7763b28 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:25.933455 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5e6b5-13dd-40db-b667-3ca0a7763b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:25.978354 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-28c5e6b5-13dd-40db-b667-3ca0a7763b28 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:31:25.979493 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-28c5e6b5-13dd-40db-b667-3ca0a7763b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:26.041407 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:31:26.059950 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1021/2057] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:31:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:31:26.066978 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db360ee1-c5b4-47ae-87ae-5ded6c22c2d9 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:26.067499 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db360ee1-c5b4-47ae-87ae-5ded6c22c2d9 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:26.067694 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db360ee1-c5b4-47ae-87ae-5ded6c22c2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:26.088192 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-db360ee1-c5b4-47ae-87ae-5ded6c22c2d9 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:31:26.089427 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-db360ee1-c5b4-47ae-87ae-5ded6c22c2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:26.102648 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5e6b5-13dd-40db-b667-3ca0a7763b28 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:26.103165 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1037/2058] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:31:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:31:26.112488 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5e6b5-13dd-40db-b667-3ca0a7763b28 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:26.117461 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe592b-2742-42b0-acef-122df9bca851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:26.118082 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe592b-2742-42b0-acef-122df9bca851 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:26.124718 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe592b-2742-42b0-acef-122df9bca851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:26.125009 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe592b-2742-42b0-acef-122df9bca851 admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:26.125691 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe592b-2742-42b0-acef-122df9bca851 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:31:26.125996 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe592b-2742-42b0-acef-122df9bca851 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:26.129138 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe592b-2742-42b0-acef-122df9bca851 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:26.152857 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1022/2059] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:31:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:31:26.157318 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db360ee1-c5b4-47ae-87ae-5ded6c22c2d9 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:26.166515 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db360ee1-c5b4-47ae-87ae-5ded6c22c2d9 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:26.171439 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abd491-a114-4968-88c4-0064eeaeb9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:26.172073 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abd491-a114-4968-88c4-0064eeaeb9a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:26.172356 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abd491-a114-4968-88c4-0064eeaeb9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:26.172629 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abd491-a114-4968-88c4-0064eeaeb9a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:26.173788 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29abd491-a114-4968-88c4-0064eeaeb9a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:26.175864 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29abd491-a114-4968-88c4-0064eeaeb9a3 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:26.203391 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:31:26.218469 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1038/2060] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:31:26 2022] POST /identity/v3/projects => generated 363 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:31:26.219452 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe592b-2742-42b0-acef-122df9bca851 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:26.230439 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe592b-2742-42b0-acef-122df9bca851 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:26.290625 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ab8a4-8fec-4ee9-ab2f-f729a09908f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:26.291233 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ab8a4-8fec-4ee9-ab2f-f729a09908f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:26.291513 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ab8a4-8fec-4ee9-ab2f-f729a09908f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:26.291786 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ab8a4-8fec-4ee9-ab2f-f729a09908f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:26.292454 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ab8a4-8fec-4ee9-ab2f-f729a09908f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:26.294373 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ab8a4-8fec-4ee9-ab2f-f729a09908f4 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:26.316388 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1023/2061] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:31:26 2022] POST /identity/v3/users => generated 282 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:31:26.320479 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abd491-a114-4968-88c4-0064eeaeb9a3 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:26.331842 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abd491-a114-4968-88c4-0064eeaeb9a3 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:26.337060 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63edf8ad-17e5-4271-9fd2-a923ed226ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:26.337590 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edf8ad-17e5-4271-9fd2-a923ed226ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:26.337868 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edf8ad-17e5-4271-9fd2-a923ed226ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:26.338147 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edf8ad-17e5-4271-9fd2-a923ed226ee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:26.338792 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63edf8ad-17e5-4271-9fd2-a923ed226ee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:26.340579 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63edf8ad-17e5-4271-9fd2-a923ed226ee4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:26.355464 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1039/2062] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:31:26.356569 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ab8a4-8fec-4ee9-ab2f-f729a09908f4 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:26.367844 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ab8a4-8fec-4ee9-ab2f-f729a09908f4 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:26.373599 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0948d-da92-45a7-9d4c-b472cdaa398f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:26.374218 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0948d-da92-45a7-9d4c-b472cdaa398f admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:26.374661 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0948d-da92-45a7-9d4c-b472cdaa398f admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:26.374944 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0948d-da92-45a7-9d4c-b472cdaa398f admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:26.375608 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0948d-da92-45a7-9d4c-b472cdaa398f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:26.378179 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0948d-da92-45a7-9d4c-b472cdaa398f admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:26.393897 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1024/2063] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:31:26.395007 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63edf8ad-17e5-4271-9fd2-a923ed226ee4 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:26.405183 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63edf8ad-17e5-4271-9fd2-a923ed226ee4 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:26.410719 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5245e-605b-40b5-843b-fafe40db30d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:26.411521 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5245e-605b-40b5-843b-fafe40db30d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:26.412011 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5245e-605b-40b5-843b-fafe40db30d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:26.412203 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5245e-605b-40b5-843b-fafe40db30d0 admin admin] PATH_INFO: `/v3/projects/3f6d7d01c7594b5b95bd53b30df4b0da/users/01c3fef7a95743d293b9e43bd7f90623/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:26.431067 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5245e-605b-40b5-843b-fafe40db30d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f6d7d01c7594b5b95bd53b30df4b0da, user_id=01c3fef7a95743d293b9e43bd7f90623, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:26.433974 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5245e-605b-40b5-843b-fafe40db30d0 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:26.449308 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1040/2064] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:31:26 2022] PUT /identity/v3/projects/3f6d7d01c7594b5b95bd53b30df4b0da/users/01c3fef7a95743d293b9e43bd7f90623/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:31:26.461962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ccf916-ae1f-4ccc-89d8-c09d7ef5fd1c None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:26.462198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ccf916-ae1f-4ccc-89d8-c09d7ef5fd1c None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:26.462447 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ccf916-ae1f-4ccc-89d8-c09d7ef5fd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:26.523925 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-52ccf916-ae1f-4ccc-89d8-c09d7ef5fd1c None None] MFA Rules not processed for user `01c3fef7a95743d293b9e43bd7f90623`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:31:26.525149 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-52ccf916-ae1f-4ccc-89d8-c09d7ef5fd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:26.593551 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1025/2065] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:31:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:31:26.598437 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5245e-605b-40b5-843b-fafe40db30d0 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:26.662909 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5245e-605b-40b5-843b-fafe40db30d0 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:26.667647 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42741001-47f6-4dbd-a5df-a2961f00b751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:26.668282 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42741001-47f6-4dbd-a5df-a2961f00b751 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:26.668559 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42741001-47f6-4dbd-a5df-a2961f00b751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:26.668833 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42741001-47f6-4dbd-a5df-a2961f00b751 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:26.669708 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42741001-47f6-4dbd-a5df-a2961f00b751 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:26.671646 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42741001-47f6-4dbd-a5df-a2961f00b751 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:26.698294 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1041/2066] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:31:26 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:31:26.702321 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ccf916-ae1f-4ccc-89d8-c09d7ef5fd1c None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:26.713671 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ccf916-ae1f-4ccc-89d8-c09d7ef5fd1c None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:26.759887 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:31:26.771498 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46ae69-049c-4db8-b106-a0320a3d1ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:26.772134 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46ae69-049c-4db8-b106-a0320a3d1ebd admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:26.772453 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46ae69-049c-4db8-b106-a0320a3d1ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:26.772729 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46ae69-049c-4db8-b106-a0320a3d1ebd admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:26.773349 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f46ae69-049c-4db8-b106-a0320a3d1ebd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:26.775284 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f46ae69-049c-4db8-b106-a0320a3d1ebd admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:26.797372 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1026/2067] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:31:26 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:31:26.801800 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42741001-47f6-4dbd-a5df-a2961f00b751 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:26.811767 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42741001-47f6-4dbd-a5df-a2961f00b751 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:26.817406 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3028a-c4f3-4a24-b111-a5ca0aacd6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:26.818018 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3028a-c4f3-4a24-b111-a5ca0aacd6ba admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:26.818294 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3028a-c4f3-4a24-b111-a5ca0aacd6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:26.818564 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3028a-c4f3-4a24-b111-a5ca0aacd6ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:26.819193 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad3028a-c4f3-4a24-b111-a5ca0aacd6ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:26.820804 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad3028a-c4f3-4a24-b111-a5ca0aacd6ba admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:26.832276 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1042/2068] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:31:26.836504 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46ae69-049c-4db8-b106-a0320a3d1ebd admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:26.846744 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46ae69-049c-4db8-b106-a0320a3d1ebd admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:26.851274 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd092b-973b-4160-902d-15e7dfa5ab41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:26.851928 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd092b-973b-4160-902d-15e7dfa5ab41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:26.852213 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd092b-973b-4160-902d-15e7dfa5ab41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:26.852483 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd092b-973b-4160-902d-15e7dfa5ab41 admin admin] PATH_INFO: `/v3/projects/c0efd872a1c845d084c31db321f37a4d/users/d0bb9781d05d4ad88d44da4ec71c9be6/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:26.866819 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cd092b-973b-4160-902d-15e7dfa5ab41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0efd872a1c845d084c31db321f37a4d, user_id=d0bb9781d05d4ad88d44da4ec71c9be6, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:26.869474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cd092b-973b-4160-902d-15e7dfa5ab41 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:26.882270 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1027/2069] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:31:26 2022] PUT /identity/v3/projects/c0efd872a1c845d084c31db321f37a4d/users/d0bb9781d05d4ad88d44da4ec71c9be6/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:31:26.886139 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3028a-c4f3-4a24-b111-a5ca0aacd6ba admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:26.896996 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3028a-c4f3-4a24-b111-a5ca0aacd6ba admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:26.953652 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf870a-4b54-4903-b460-ea0612f523c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:26.954245 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf870a-4b54-4903-b460-ea0612f523c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:26.954582 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf870a-4b54-4903-b460-ea0612f523c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:26.954582 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf870a-4b54-4903-b460-ea0612f523c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:26.955486 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf870a-4b54-4903-b460-ea0612f523c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:26.957096 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf870a-4b54-4903-b460-ea0612f523c6 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:26.966579 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1043/2070] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:31:26.970915 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd092b-973b-4160-902d-15e7dfa5ab41 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:26.980873 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd092b-973b-4160-902d-15e7dfa5ab41 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:26.985353 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f8a49-009d-4c34-b5d8-0471d2fdd4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:26.986529 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f8a49-009d-4c34-b5d8-0471d2fdd4b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:26.986880 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f8a49-009d-4c34-b5d8-0471d2fdd4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:26.987152 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f8a49-009d-4c34-b5d8-0471d2fdd4b1 admin admin] PATH_INFO: `/v3/projects/c0efd872a1c845d084c31db321f37a4d/users/d0bb9781d05d4ad88d44da4ec71c9be6/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:26.989042 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f8a49-009d-4c34-b5d8-0471d2fdd4b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0efd872a1c845d084c31db321f37a4d, user_id=d0bb9781d05d4ad88d44da4ec71c9be6, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:26.991677 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f8a49-009d-4c34-b5d8-0471d2fdd4b1 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:27.002169 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1028/2071] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:31:26 2022] PUT /identity/v3/projects/c0efd872a1c845d084c31db321f37a4d/users/d0bb9781d05d4ad88d44da4ec71c9be6/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:31:27.012386 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15fef8-67aa-49fd-99de-3dbe53f993bd None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:27.012610 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15fef8-67aa-49fd-99de-3dbe53f993bd None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:27.012894 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15fef8-67aa-49fd-99de-3dbe53f993bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:27.041109 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-6a15fef8-67aa-49fd-99de-3dbe53f993bd None None] MFA Rules not processed for user `d0bb9781d05d4ad88d44da4ec71c9be6`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:31:27.042309 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6a15fef8-67aa-49fd-99de-3dbe53f993bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:27.063466 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:31:27.112559 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1044/2072] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:31:27 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:31:27.123560 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f8a49-009d-4c34-b5d8-0471d2fdd4b1 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:27.125310 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-e02f8a49-009d-4c34-b5d8-0471d2fdd4b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:27.184175 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f8a49-009d-4c34-b5d8-0471d2fdd4b1 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:27.187714 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee29e57-da2d-4b4f-86cd-9170a234c298 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:27.188335 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee29e57-da2d-4b4f-86cd-9170a234c298 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:27.188610 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee29e57-da2d-4b4f-86cd-9170a234c298 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:27.189297 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee29e57-da2d-4b4f-86cd-9170a234c298 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:27.197963 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee29e57-da2d-4b4f-86cd-9170a234c298 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:27.199370 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee29e57-da2d-4b4f-86cd-9170a234c298 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:27.209155 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1029/2073] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:31:27 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:31:27.281754 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15fef8-67aa-49fd-99de-3dbe53f993bd None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:27.291717 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15fef8-67aa-49fd-99de-3dbe53f993bd None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:27.295535 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412bd4e-86c6-446d-bfa4-355379c38d45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:27.296164 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412bd4e-86c6-446d-bfa4-355379c38d45 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:27.296440 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412bd4e-86c6-446d-bfa4-355379c38d45 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:27.296710 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412bd4e-86c6-446d-bfa4-355379c38d45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:27.352796 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9412bd4e-86c6-446d-bfa4-355379c38d45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:27.354286 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9412bd4e-86c6-446d-bfa4-355379c38d45 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:27.363251 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1045/2074] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:31:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:31:33.547502 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee29e57-da2d-4b4f-86cd-9170a234c298 service cinder] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:33.611144 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee29e57-da2d-4b4f-86cd-9170a234c298 service cinder] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:33.616935 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf2f53-0bca-42f6-b003-a9f033cc2cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:33.617673 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf2f53-0bca-42f6-b003-a9f033cc2cb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:33.618050 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf2f53-0bca-42f6-b003-a9f033cc2cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:33.618424 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf2f53-0bca-42f6-b003-a9f033cc2cb0 admin admin] PATH_INFO: `/v3/users/01c3fef7a95743d293b9e43bd7f90623` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:33.619666 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf2f53-0bca-42f6-b003-a9f033cc2cb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01c3fef7a95743d293b9e43bd7f90623)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:33.621760 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf2f53-0bca-42f6-b003-a9f033cc2cb0 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:33.669027 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-e6cf2f53-0bca-42f6-b003-a9f033cc2cb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01c3fef7a95743d293b9e43bd7f90623'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:33.670393 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:31:33.683737 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-e6cf2f53-0bca-42f6-b003-a9f033cc2cb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01c3fef7a95743d293b9e43bd7f90623'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:33.684511 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-e6cf2f53-0bca-42f6-b003-a9f033cc2cb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01c3fef7a95743d293b9e43bd7f90623'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:33.694085 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-e6cf2f53-0bca-42f6-b003-a9f033cc2cb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01c3fef7a95743d293b9e43bd7f90623'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:33.694762 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-e6cf2f53-0bca-42f6-b003-a9f033cc2cb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01c3fef7a95743d293b9e43bd7f90623'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:33.711930 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1030/2075] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:31:33 2022] DELETE /identity/v3/users/01c3fef7a95743d293b9e43bd7f90623 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:31:33.713164 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d472497-413c-4851-a6eb-e77419342759 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:33.713618 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d472497-413c-4851-a6eb-e77419342759 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:33.713745 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d472497-413c-4851-a6eb-e77419342759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:33.747150 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-2d472497-413c-4851-a6eb-e77419342759 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:31:33.748490 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2d472497-413c-4851-a6eb-e77419342759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:33.819831 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1046/2076] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:31:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:31:33.826830 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf2f53-0bca-42f6-b003-a9f033cc2cb0 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:33.828266 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-e6cf2f53-0bca-42f6-b003-a9f033cc2cb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:33.891736 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf2f53-0bca-42f6-b003-a9f033cc2cb0 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:33.896591 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558b482-1d52-4567-b816-65257dd0b206 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:33.897334 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558b482-1d52-4567-b816-65257dd0b206 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:33.897675 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558b482-1d52-4567-b816-65257dd0b206 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:33.898022 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558b482-1d52-4567-b816-65257dd0b206 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:33.907528 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a558b482-1d52-4567-b816-65257dd0b206 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:33.909094 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a558b482-1d52-4567-b816-65257dd0b206 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:33.918784 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1031/2077] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:31:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:31:34.231774 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d472497-413c-4851-a6eb-e77419342759 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:34.233544 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2d472497-413c-4851-a6eb-e77419342759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:34.249459 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d472497-413c-4851-a6eb-e77419342759 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:34.255464 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b954e551-9126-49c9-a783-bd95aa80785f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:34.256231 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954e551-9126-49c9-a783-bd95aa80785f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:34.256580 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954e551-9126-49c9-a783-bd95aa80785f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:34.256930 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954e551-9126-49c9-a783-bd95aa80785f admin admin] PATH_INFO: `/v3/projects/3f6d7d01c7594b5b95bd53b30df4b0da` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:34.258135 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b954e551-9126-49c9-a783-bd95aa80785f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f6d7d01c7594b5b95bd53b30df4b0da)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:34.260477 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b954e551-9126-49c9-a783-bd95aa80785f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:34.317466 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b954e551-9126-49c9-a783-bd95aa80785f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f6d7d01c7594b5b95bd53b30df4b0da', 'request_id': 'req-b954e551-9126-49c9-a783-bd95aa80785f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:34.321037 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:31:34.327138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b954e551-9126-49c9-a783-bd95aa80785f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f6d7d01c7594b5b95bd53b30df4b0da', 'request_id': 'req-b954e551-9126-49c9-a783-bd95aa80785f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:34.335386 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b954e551-9126-49c9-a783-bd95aa80785f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f6d7d01c7594b5b95bd53b30df4b0da', 'request_id': 'req-b954e551-9126-49c9-a783-bd95aa80785f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:34.350050 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b954e551-9126-49c9-a783-bd95aa80785f admin admin] The token cache is being invalidate because project 3f6d7d01c7594b5b95bd53b30df4b0da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:31:34.350410 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b954e551-9126-49c9-a783-bd95aa80785f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:34.351083 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b954e551-9126-49c9-a783-bd95aa80785f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:34.352707 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1047/2078] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:31:34 2022] DELETE /identity/v3/projects/3f6d7d01c7594b5b95bd53b30df4b0da => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:31:34.356825 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558b482-1d52-4567-b816-65257dd0b206 service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:34.368108 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558b482-1d52-4567-b816-65257dd0b206 service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:34.433121 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775ccf7-d972-4e86-ade7-ebc6d03c4a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:34.433751 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775ccf7-d972-4e86-ade7-ebc6d03c4a2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:34.434037 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775ccf7-d972-4e86-ade7-ebc6d03c4a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:34.434352 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775ccf7-d972-4e86-ade7-ebc6d03c4a2c admin admin] PATH_INFO: `/v3/users/d0bb9781d05d4ad88d44da4ec71c9be6` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:34.435741 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b775ccf7-d972-4e86-ade7-ebc6d03c4a2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0bb9781d05d4ad88d44da4ec71c9be6)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:34.437801 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b775ccf7-d972-4e86-ade7-ebc6d03c4a2c admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:34.483455 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b775ccf7-d972-4e86-ade7-ebc6d03c4a2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0bb9781d05d4ad88d44da4ec71c9be6'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:34.496092 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b775ccf7-d972-4e86-ade7-ebc6d03c4a2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0bb9781d05d4ad88d44da4ec71c9be6'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:34.496801 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b775ccf7-d972-4e86-ade7-ebc6d03c4a2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0bb9781d05d4ad88d44da4ec71c9be6'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:34.500374 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:31:34.507066 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b775ccf7-d972-4e86-ade7-ebc6d03c4a2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0bb9781d05d4ad88d44da4ec71c9be6'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:34.507937 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b775ccf7-d972-4e86-ade7-ebc6d03c4a2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0bb9781d05d4ad88d44da4ec71c9be6'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:34.521820 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1032/2079] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:31:34 2022] DELETE /identity/v3/users/d0bb9781d05d4ad88d44da4ec71c9be6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:31:34.810669 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b954e551-9126-49c9-a783-bd95aa80785f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:34.812215 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b954e551-9126-49c9-a783-bd95aa80785f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:34.826373 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b954e551-9126-49c9-a783-bd95aa80785f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:34.888742 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972924b-fbd6-479e-a46d-834ab657f155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:34.889375 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972924b-fbd6-479e-a46d-834ab657f155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:34.889656 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972924b-fbd6-479e-a46d-834ab657f155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:34.889930 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972924b-fbd6-479e-a46d-834ab657f155 admin admin] PATH_INFO: `/v3/projects/c0efd872a1c845d084c31db321f37a4d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:34.891076 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972924b-fbd6-479e-a46d-834ab657f155 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0efd872a1c845d084c31db321f37a4d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:34.893032 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972924b-fbd6-479e-a46d-834ab657f155 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:34.948296 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1972924b-fbd6-479e-a46d-834ab657f155 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0efd872a1c845d084c31db321f37a4d', 'request_id': 'req-1972924b-fbd6-479e-a46d-834ab657f155'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:34.959127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1972924b-fbd6-479e-a46d-834ab657f155 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0efd872a1c845d084c31db321f37a4d', 'request_id': 'req-1972924b-fbd6-479e-a46d-834ab657f155'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:34.966044 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1972924b-fbd6-479e-a46d-834ab657f155 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0efd872a1c845d084c31db321f37a4d', 'request_id': 'req-1972924b-fbd6-479e-a46d-834ab657f155'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:34.979015 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1972924b-fbd6-479e-a46d-834ab657f155 admin admin] The token cache is being invalidate because project c0efd872a1c845d084c31db321f37a4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:31:34.979302 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1972924b-fbd6-479e-a46d-834ab657f155 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:34.979993 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1972924b-fbd6-479e-a46d-834ab657f155 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:34.981560 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1048/2080] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:31:34 2022] DELETE /identity/v3/projects/c0efd872a1c845d084c31db321f37a4d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:31:34.986463 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ca07e-bc66-48cc-afeb-8bf5b4777906 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:34.986990 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ca07e-bc66-48cc-afeb-8bf5b4777906 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:34.987295 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ca07e-bc66-48cc-afeb-8bf5b4777906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:35.009653 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-d49ca07e-bc66-48cc-afeb-8bf5b4777906 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:31:35.010882 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-d49ca07e-bc66-48cc-afeb-8bf5b4777906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:35.082842 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1033/2081] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:31:35.092327 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27bf1b-a2d9-4844-9da9-eead8d7f64db None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:35.092614 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27bf1b-a2d9-4844-9da9-eead8d7f64db None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:35.092896 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27bf1b-a2d9-4844-9da9-eead8d7f64db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:35.115307 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-5d27bf1b-a2d9-4844-9da9-eead8d7f64db None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:31:35.116584 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5d27bf1b-a2d9-4844-9da9-eead8d7f64db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:35.125160 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1049/2082] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:31:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:31:35.129494 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ca07e-bc66-48cc-afeb-8bf5b4777906 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:35.139567 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ca07e-bc66-48cc-afeb-8bf5b4777906 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:35.146204 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d9521-cdff-45b8-904b-ed9c940a5630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:35.146840 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d9521-cdff-45b8-904b-ed9c940a5630 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:35.147179 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d9521-cdff-45b8-904b-ed9c940a5630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:35.147460 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d9521-cdff-45b8-904b-ed9c940a5630 admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:35.148158 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d9521-cdff-45b8-904b-ed9c940a5630 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:31:35.148464 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d9521-cdff-45b8-904b-ed9c940a5630 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:35.150101 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d9521-cdff-45b8-904b-ed9c940a5630 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:35.166349 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1034/2083] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:31:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:31:35.167781 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27bf1b-a2d9-4844-9da9-eead8d7f64db None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:35.180650 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27bf1b-a2d9-4844-9da9-eead8d7f64db None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:35.188080 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0630a36-15f2-47bd-97e7-4eb4d4af0fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:35.189299 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0630a36-15f2-47bd-97e7-4eb4d4af0fd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:35.189661 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0630a36-15f2-47bd-97e7-4eb4d4af0fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:35.190016 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0630a36-15f2-47bd-97e7-4eb4d4af0fd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:35.190746 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0630a36-15f2-47bd-97e7-4eb4d4af0fd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:35.194161 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0630a36-15f2-47bd-97e7-4eb4d4af0fd9 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:35.227072 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1050/2084] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:31:35 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:31:35.231239 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d9521-cdff-45b8-904b-ed9c940a5630 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:35.242987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d9521-cdff-45b8-904b-ed9c940a5630 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:35.309311 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e98f8-cfcc-442f-87ad-dfd220be44f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:35.310177 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e98f8-cfcc-442f-87ad-dfd220be44f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:35.310348 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e98f8-cfcc-442f-87ad-dfd220be44f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:35.310526 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e98f8-cfcc-442f-87ad-dfd220be44f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:35.311116 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e98f8-cfcc-442f-87ad-dfd220be44f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:35.314474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e98f8-cfcc-442f-87ad-dfd220be44f8 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:35.344067 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1035/2085] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:31:35 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:31:35.345572 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0630a36-15f2-47bd-97e7-4eb4d4af0fd9 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:35.357923 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0630a36-15f2-47bd-97e7-4eb4d4af0fd9 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:35.364392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc26949-1c21-48a3-a23c-98aa42ee4da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:35.365036 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc26949-1c21-48a3-a23c-98aa42ee4da8 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:35.365319 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc26949-1c21-48a3-a23c-98aa42ee4da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:35.365594 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc26949-1c21-48a3-a23c-98aa42ee4da8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:35.366264 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc26949-1c21-48a3-a23c-98aa42ee4da8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:35.367940 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc26949-1c21-48a3-a23c-98aa42ee4da8 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:35.379328 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1051/2086] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:31:35.384277 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e98f8-cfcc-442f-87ad-dfd220be44f8 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:35.394859 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e98f8-cfcc-442f-87ad-dfd220be44f8 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:35.400138 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d142c-8f07-4f9b-81d8-398f1f11a07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:35.400850 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d142c-8f07-4f9b-81d8-398f1f11a07b admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:35.401204 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d142c-8f07-4f9b-81d8-398f1f11a07b admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:35.401548 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d142c-8f07-4f9b-81d8-398f1f11a07b admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:35.403239 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d142c-8f07-4f9b-81d8-398f1f11a07b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:35.404037 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d142c-8f07-4f9b-81d8-398f1f11a07b admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:35.419470 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1036/2087] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:31:35.424470 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc26949-1c21-48a3-a23c-98aa42ee4da8 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:35.435874 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc26949-1c21-48a3-a23c-98aa42ee4da8 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:35.440858 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4438c2-4eb5-4401-931e-0d35e0e9128f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:35.441763 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4438c2-4eb5-4401-931e-0d35e0e9128f admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:35.442325 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4438c2-4eb5-4401-931e-0d35e0e9128f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:35.442552 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4438c2-4eb5-4401-931e-0d35e0e9128f admin admin] PATH_INFO: `/v3/projects/546a1aae1e644ea183b85b7f8c252c80/users/a3c44b8e24994deba65a73e29334ce14/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:35.460122 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4438c2-4eb5-4401-931e-0d35e0e9128f admin admin] RBAC: Authorizing `identity:create_grant(project_id=546a1aae1e644ea183b85b7f8c252c80, user_id=a3c44b8e24994deba65a73e29334ce14, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:35.464470 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4438c2-4eb5-4401-931e-0d35e0e9128f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:35.483861 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1052/2088] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:31:35 2022] PUT /identity/v3/projects/546a1aae1e644ea183b85b7f8c252c80/users/a3c44b8e24994deba65a73e29334ce14/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:31:35.494779 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5d514-e497-4fdb-8433-e18063fb1175 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:35.495074 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5d514-e497-4fdb-8433-e18063fb1175 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:35.495352 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5d514-e497-4fdb-8433-e18063fb1175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:35.527485 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-4fc5d514-e497-4fdb-8433-e18063fb1175 None None] MFA Rules not processed for user `a3c44b8e24994deba65a73e29334ce14`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:31:35.528743 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-4fc5d514-e497-4fdb-8433-e18063fb1175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:35.581478 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:31:35.615347 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1037/2089] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:31:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:31:35.620298 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4438c2-4eb5-4401-931e-0d35e0e9128f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:35.631171 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:31:35.690009 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4438c2-4eb5-4401-931e-0d35e0e9128f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:35.695580 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd5a39-dcd7-43b1-8356-fff3cceac21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:35.696372 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd5a39-dcd7-43b1-8356-fff3cceac21e admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:35.696710 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd5a39-dcd7-43b1-8356-fff3cceac21e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:35.697102 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd5a39-dcd7-43b1-8356-fff3cceac21e admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:35.698175 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd5a39-dcd7-43b1-8356-fff3cceac21e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:35.700031 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd5a39-dcd7-43b1-8356-fff3cceac21e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:35.737754 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1053/2090] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:31:35 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:31:35.741885 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5d514-e497-4fdb-8433-e18063fb1175 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:35.754838 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5d514-e497-4fdb-8433-e18063fb1175 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:35.827887 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2b2fe-f610-4745-acd3-00eceb3d123a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:35.828530 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2b2fe-f610-4745-acd3-00eceb3d123a admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:35.828799 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2b2fe-f610-4745-acd3-00eceb3d123a admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:35.829064 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2b2fe-f610-4745-acd3-00eceb3d123a admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:35.829690 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db2b2fe-f610-4745-acd3-00eceb3d123a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:35.831621 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db2b2fe-f610-4745-acd3-00eceb3d123a admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:35.862332 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1038/2091] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:31:35 2022] POST /identity/v3/users => generated 295 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:31:35.866773 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd5a39-dcd7-43b1-8356-fff3cceac21e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:35.879781 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd5a39-dcd7-43b1-8356-fff3cceac21e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:35.885417 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72638c4-c87a-4fa6-af6b-cbb38dbdb4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:35.886094 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72638c4-c87a-4fa6-af6b-cbb38dbdb4b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:35.886383 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72638c4-c87a-4fa6-af6b-cbb38dbdb4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:35.886648 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72638c4-c87a-4fa6-af6b-cbb38dbdb4b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:35.887456 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72638c4-c87a-4fa6-af6b-cbb38dbdb4b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:35.889101 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72638c4-c87a-4fa6-af6b-cbb38dbdb4b2 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:35.902820 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1054/2092] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:31:35.906788 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2b2fe-f610-4745-acd3-00eceb3d123a admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:35.917715 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2b2fe-f610-4745-acd3-00eceb3d123a admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:35.922712 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45fb785-3ee5-42a2-ba18-520cb0e88299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:35.923391 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45fb785-3ee5-42a2-ba18-520cb0e88299 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:35.923671 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45fb785-3ee5-42a2-ba18-520cb0e88299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:35.923996 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45fb785-3ee5-42a2-ba18-520cb0e88299 admin admin] PATH_INFO: `/v3/projects/011170a98b714973b8f2a33ef7b8b9b4/users/ed3095b23c72486494a2ce32dd6845dd/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:35.943471 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45fb785-3ee5-42a2-ba18-520cb0e88299 admin admin] RBAC: Authorizing `identity:create_grant(project_id=011170a98b714973b8f2a33ef7b8b9b4, user_id=ed3095b23c72486494a2ce32dd6845dd, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:35.946236 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45fb785-3ee5-42a2-ba18-520cb0e88299 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:35.959977 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1039/2093] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:31:35 2022] PUT /identity/v3/projects/011170a98b714973b8f2a33ef7b8b9b4/users/ed3095b23c72486494a2ce32dd6845dd/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:31:35.963828 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72638c4-c87a-4fa6-af6b-cbb38dbdb4b2 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:35.974438 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72638c4-c87a-4fa6-af6b-cbb38dbdb4b2 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:36.033045 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2054509-e2be-490c-8781-4cb9e82868b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:36.033660 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2054509-e2be-490c-8781-4cb9e82868b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:36.033938 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2054509-e2be-490c-8781-4cb9e82868b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:36.034210 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2054509-e2be-490c-8781-4cb9e82868b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:36.035503 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2054509-e2be-490c-8781-4cb9e82868b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:36.037149 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2054509-e2be-490c-8781-4cb9e82868b8 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:36.048175 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1055/2094] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:31:36.052798 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45fb785-3ee5-42a2-ba18-520cb0e88299 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:36.075081 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45fb785-3ee5-42a2-ba18-520cb0e88299 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:36.079880 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f57b13-82af-4300-b400-46716a8e35ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:36.080596 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f57b13-82af-4300-b400-46716a8e35ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:36.080896 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f57b13-82af-4300-b400-46716a8e35ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:36.081149 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f57b13-82af-4300-b400-46716a8e35ad admin admin] PATH_INFO: `/v3/projects/011170a98b714973b8f2a33ef7b8b9b4/users/ed3095b23c72486494a2ce32dd6845dd/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:36.084675 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f57b13-82af-4300-b400-46716a8e35ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=011170a98b714973b8f2a33ef7b8b9b4, user_id=ed3095b23c72486494a2ce32dd6845dd, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:36.087293 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f57b13-82af-4300-b400-46716a8e35ad admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:36.098457 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1040/2095] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:31:36 2022] PUT /identity/v3/projects/011170a98b714973b8f2a33ef7b8b9b4/users/ed3095b23c72486494a2ce32dd6845dd/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:31:36.108572 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe20fb4-fe74-45f2-9e98-4942413d5204 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:36.108860 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe20fb4-fe74-45f2-9e98-4942413d5204 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:36.109138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe20fb4-fe74-45f2-9e98-4942413d5204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:36.138893 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-2fe20fb4-fe74-45f2-9e98-4942413d5204 None None] MFA Rules not processed for user `ed3095b23c72486494a2ce32dd6845dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:31:36.140199 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2fe20fb4-fe74-45f2-9e98-4942413d5204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:36.214340 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1056/2096] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:31:36 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:31:36.226094 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f57b13-82af-4300-b400-46716a8e35ad admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:36.227862 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-e7f57b13-82af-4300-b400-46716a8e35ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:36.286607 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f57b13-82af-4300-b400-46716a8e35ad admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:36.290406 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86270126-2a05-449b-b615-e1e8f118de6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:36.291010 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86270126-2a05-449b-b615-e1e8f118de6c service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:36.291287 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86270126-2a05-449b-b615-e1e8f118de6c service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:36.291560 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86270126-2a05-449b-b615-e1e8f118de6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:36.337811 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:31:36.349391 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86270126-2a05-449b-b615-e1e8f118de6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:36.350826 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86270126-2a05-449b-b615-e1e8f118de6c service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:36.359824 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1041/2097] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:31:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:31:38.926068 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe20fb4-fe74-45f2-9e98-4942413d5204 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:38.930986 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:31:38.937958 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe20fb4-fe74-45f2-9e98-4942413d5204 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:38.942357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6280ba2-24a8-4cb1-beb0-e46ce04d1212 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:38.942969 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6280ba2-24a8-4cb1-beb0-e46ce04d1212 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:38.943250 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6280ba2-24a8-4cb1-beb0-e46ce04d1212 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:38.943520 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6280ba2-24a8-4cb1-beb0-e46ce04d1212 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:38.952772 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6280ba2-24a8-4cb1-beb0-e46ce04d1212 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:38.954977 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6280ba2-24a8-4cb1-beb0-e46ce04d1212 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:38.967026 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1057/2098] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:31:38 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:31:46.355598 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=5 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:31:48.965005 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:31:51.592233 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86270126-2a05-449b-b615-e1e8f118de6c service cinder] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:51.656272 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86270126-2a05-449b-b615-e1e8f118de6c service cinder] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:51.660847 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea56ce-44d6-44d3-8ca2-badf3319276f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:51.661597 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea56ce-44d6-44d3-8ca2-badf3319276f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:51.661851 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea56ce-44d6-44d3-8ca2-badf3319276f admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:51.662252 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea56ce-44d6-44d3-8ca2-badf3319276f admin admin] PATH_INFO: `/v3/users/a3c44b8e24994deba65a73e29334ce14` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:51.663442 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea56ce-44d6-44d3-8ca2-badf3319276f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3c44b8e24994deba65a73e29334ce14)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:51.665535 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea56ce-44d6-44d3-8ca2-badf3319276f admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:51.713845 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-8cea56ce-44d6-44d3-8ca2-badf3319276f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3c44b8e24994deba65a73e29334ce14'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:51.733611 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-8cea56ce-44d6-44d3-8ca2-badf3319276f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3c44b8e24994deba65a73e29334ce14'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:51.734345 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-8cea56ce-44d6-44d3-8ca2-badf3319276f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3c44b8e24994deba65a73e29334ce14'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:51.743820 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-8cea56ce-44d6-44d3-8ca2-badf3319276f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3c44b8e24994deba65a73e29334ce14'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:51.744463 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-8cea56ce-44d6-44d3-8ca2-badf3319276f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3c44b8e24994deba65a73e29334ce14'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:51.763680 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1042/2099] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:31:51 2022] DELETE /identity/v3/users/a3c44b8e24994deba65a73e29334ce14 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:31:51.768501 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5f8dd-7ffb-4881-ae1e-05bf47388e45 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:51.769006 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5f8dd-7ffb-4881-ae1e-05bf47388e45 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:51.769121 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5f8dd-7ffb-4881-ae1e-05bf47388e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:51.788791 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-b4e5f8dd-7ffb-4881-ae1e-05bf47388e45 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:31:51.790004 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b4e5f8dd-7ffb-4881-ae1e-05bf47388e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:51.858458 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1058/2100] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:31:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:31:51.869425 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea56ce-44d6-44d3-8ca2-badf3319276f admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:51.870827 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-8cea56ce-44d6-44d3-8ca2-badf3319276f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:51.933497 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea56ce-44d6-44d3-8ca2-badf3319276f admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:51.937059 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b848be8-4ea4-487a-8e25-d443621aabff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:51.937860 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b848be8-4ea4-487a-8e25-d443621aabff service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:51.937986 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b848be8-4ea4-487a-8e25-d443621aabff service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:51.938184 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b848be8-4ea4-487a-8e25-d443621aabff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:51.947943 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b848be8-4ea4-487a-8e25-d443621aabff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:51.949533 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b848be8-4ea4-487a-8e25-d443621aabff service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:51.960699 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1043/2101] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:31:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:31:52.372988 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5f8dd-7ffb-4881-ae1e-05bf47388e45 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:52.374483 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b4e5f8dd-7ffb-4881-ae1e-05bf47388e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:52.388137 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5f8dd-7ffb-4881-ae1e-05bf47388e45 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:52.393912 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151c362-8721-4e23-995e-405478e0ccd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:52.394516 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151c362-8721-4e23-995e-405478e0ccd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:52.395310 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151c362-8721-4e23-995e-405478e0ccd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:52.395590 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151c362-8721-4e23-995e-405478e0ccd4 admin admin] PATH_INFO: `/v3/projects/546a1aae1e644ea183b85b7f8c252c80` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:52.396917 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151c362-8721-4e23-995e-405478e0ccd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=546a1aae1e644ea183b85b7f8c252c80)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:52.398841 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151c362-8721-4e23-995e-405478e0ccd4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:52.449504 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2151c362-8721-4e23-995e-405478e0ccd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '546a1aae1e644ea183b85b7f8c252c80', 'request_id': 'req-2151c362-8721-4e23-995e-405478e0ccd4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:52.457801 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2151c362-8721-4e23-995e-405478e0ccd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '546a1aae1e644ea183b85b7f8c252c80', 'request_id': 'req-2151c362-8721-4e23-995e-405478e0ccd4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:52.464467 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2151c362-8721-4e23-995e-405478e0ccd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '546a1aae1e644ea183b85b7f8c252c80', 'request_id': 'req-2151c362-8721-4e23-995e-405478e0ccd4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:52.477551 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2151c362-8721-4e23-995e-405478e0ccd4 admin admin] The token cache is being invalidate because project 546a1aae1e644ea183b85b7f8c252c80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:31:52.477762 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2151c362-8721-4e23-995e-405478e0ccd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:52.478404 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2151c362-8721-4e23-995e-405478e0ccd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:52.480193 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1059/2102] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:31:52 2022] DELETE /identity/v3/projects/546a1aae1e644ea183b85b7f8c252c80 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:31:52.483830 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b848be8-4ea4-487a-8e25-d443621aabff service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:52.494459 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b848be8-4ea4-487a-8e25-d443621aabff service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:52.512970 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:31:52.555761 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafdf593-20ca-4d62-a516-ee83c429a071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:52.556427 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafdf593-20ca-4d62-a516-ee83c429a071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:52.556703 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafdf593-20ca-4d62-a516-ee83c429a071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:52.556975 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafdf593-20ca-4d62-a516-ee83c429a071 admin admin] PATH_INFO: `/v3/users/ed3095b23c72486494a2ce32dd6845dd` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:52.558087 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafdf593-20ca-4d62-a516-ee83c429a071 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed3095b23c72486494a2ce32dd6845dd)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:52.560048 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafdf593-20ca-4d62-a516-ee83c429a071 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:52.608285 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-bafdf593-20ca-4d62-a516-ee83c429a071 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed3095b23c72486494a2ce32dd6845dd'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:52.621133 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-bafdf593-20ca-4d62-a516-ee83c429a071 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed3095b23c72486494a2ce32dd6845dd'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:52.621820 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-bafdf593-20ca-4d62-a516-ee83c429a071 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed3095b23c72486494a2ce32dd6845dd'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:52.630972 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-bafdf593-20ca-4d62-a516-ee83c429a071 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed3095b23c72486494a2ce32dd6845dd'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:52.631670 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-bafdf593-20ca-4d62-a516-ee83c429a071 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed3095b23c72486494a2ce32dd6845dd'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:52.643864 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1044/2103] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:31:52 2022] DELETE /identity/v3/users/ed3095b23c72486494a2ce32dd6845dd => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:31:52.935557 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151c362-8721-4e23-995e-405478e0ccd4 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:52.937075 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2151c362-8721-4e23-995e-405478e0ccd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:52.964893 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151c362-8721-4e23-995e-405478e0ccd4 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:53.024012 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3cce86-b913-42ff-81e5-5dab560894d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:53.024565 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3cce86-b913-42ff-81e5-5dab560894d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:53.024844 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3cce86-b913-42ff-81e5-5dab560894d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:53.025114 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3cce86-b913-42ff-81e5-5dab560894d3 admin admin] PATH_INFO: `/v3/projects/011170a98b714973b8f2a33ef7b8b9b4` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:53.026229 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3cce86-b913-42ff-81e5-5dab560894d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=011170a98b714973b8f2a33ef7b8b9b4)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:53.028155 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3cce86-b913-42ff-81e5-5dab560894d3 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:53.062032 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:31:53.080366 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1b3cce86-b913-42ff-81e5-5dab560894d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '011170a98b714973b8f2a33ef7b8b9b4', 'request_id': 'req-1b3cce86-b913-42ff-81e5-5dab560894d3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:53.088241 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1b3cce86-b913-42ff-81e5-5dab560894d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '011170a98b714973b8f2a33ef7b8b9b4', 'request_id': 'req-1b3cce86-b913-42ff-81e5-5dab560894d3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:53.094234 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1b3cce86-b913-42ff-81e5-5dab560894d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '011170a98b714973b8f2a33ef7b8b9b4', 'request_id': 'req-1b3cce86-b913-42ff-81e5-5dab560894d3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:53.106101 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1b3cce86-b913-42ff-81e5-5dab560894d3 admin admin] The token cache is being invalidate because project 011170a98b714973b8f2a33ef7b8b9b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:31:53.106400 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1b3cce86-b913-42ff-81e5-5dab560894d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:53.107392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1b3cce86-b913-42ff-81e5-5dab560894d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:53.109170 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1060/2104] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:31:52 2022] DELETE /identity/v3/projects/011170a98b714973b8f2a33ef7b8b9b4 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:31:53.114705 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ee9c7-7ae6-4ebd-be42-a80668d73edf None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:53.114705 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ee9c7-7ae6-4ebd-be42-a80668d73edf None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:53.114948 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ee9c7-7ae6-4ebd-be42-a80668d73edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:53.134616 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-696ee9c7-7ae6-4ebd-be42-a80668d73edf None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:31:53.135822 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-696ee9c7-7ae6-4ebd-be42-a80668d73edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:53.197934 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8efca-e76e-4630-8824-b0d705f2f6ae None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:53.198306 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8efca-e76e-4630-8824-b0d705f2f6ae None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:53.198595 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8efca-e76e-4630-8824-b0d705f2f6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:53.199402 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1045/2105] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:31:53.206986 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec1fd3-32eb-48b1-8c7b-10602ef8db62 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:53.207416 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec1fd3-32eb-48b1-8c7b-10602ef8db62 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:53.207771 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec1fd3-32eb-48b1-8c7b-10602ef8db62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:53.218726 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-9df8efca-e76e-4630-8824-b0d705f2f6ae None None] MFA Rules not processed for user `b45585ee97774a5fa704eac9e992adcb`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:31:53.219981 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9df8efca-e76e-4630-8824-b0d705f2f6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:53.227453 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-44ec1fd3-32eb-48b1-8c7b-10602ef8db62 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:31:53.228653 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-44ec1fd3-32eb-48b1-8c7b-10602ef8db62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:53.236474 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1046/2106] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:31:53.241177 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec1fd3-32eb-48b1-8c7b-10602ef8db62 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:53.249931 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec1fd3-32eb-48b1-8c7b-10602ef8db62 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:53.255615 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e50a1-a9cc-4273-97db-8dd8afe48e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:53.256241 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e50a1-a9cc-4273-97db-8dd8afe48e64 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:53.256519 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e50a1-a9cc-4273-97db-8dd8afe48e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:53.256789 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e50a1-a9cc-4273-97db-8dd8afe48e64 admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:53.257432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e50a1-a9cc-4273-97db-8dd8afe48e64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:31:53.257760 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e50a1-a9cc-4273-97db-8dd8afe48e64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:53.259357 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e50a1-a9cc-4273-97db-8dd8afe48e64 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:53.271178 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1047/2107] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:31:53.275327 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e50a1-a9cc-4273-97db-8dd8afe48e64 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:53.278710 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1061/2108] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:31:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:31:53.285538 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e50a1-a9cc-4273-97db-8dd8afe48e64 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:53.290281 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb9f79-3fe7-4275-b0d3-f2e542742ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:53.290873 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb9f79-3fe7-4275-b0d3-f2e542742ca4 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:53.291152 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb9f79-3fe7-4275-b0d3-f2e542742ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:53.291425 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb9f79-3fe7-4275-b0d3-f2e542742ca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:53.292088 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb9f79-3fe7-4275-b0d3-f2e542742ca4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:53.293976 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb9f79-3fe7-4275-b0d3-f2e542742ca4 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:53.317495 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:31:53.325026 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1048/2109] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:31:53 2022] POST /identity/v3/projects => generated 389 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:31:53.329120 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8efca-e76e-4630-8824-b0d705f2f6ae None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:53.340557 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8efca-e76e-4630-8824-b0d705f2f6ae None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:53.398498 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96355a2a-5620-46af-9633-1dfab66e6be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:53.399103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96355a2a-5620-46af-9633-1dfab66e6be5 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:53.399381 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96355a2a-5620-46af-9633-1dfab66e6be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:53.399650 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96355a2a-5620-46af-9633-1dfab66e6be5 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:53.400335 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96355a2a-5620-46af-9633-1dfab66e6be5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:53.402240 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96355a2a-5620-46af-9633-1dfab66e6be5 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:53.425343 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1062/2110] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:31:53 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:31:53.430622 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb9f79-3fe7-4275-b0d3-f2e542742ca4 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:53.440865 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb9f79-3fe7-4275-b0d3-f2e542742ca4 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:53.446488 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c10610-5ef9-4546-ba52-a111b3578368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:53.447130 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c10610-5ef9-4546-ba52-a111b3578368 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:53.447397 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c10610-5ef9-4546-ba52-a111b3578368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:53.447670 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c10610-5ef9-4546-ba52-a111b3578368 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:53.448339 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c10610-5ef9-4546-ba52-a111b3578368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:53.449920 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c10610-5ef9-4546-ba52-a111b3578368 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:53.463608 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1049/2111] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:31:53.464816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96355a2a-5620-46af-9633-1dfab66e6be5 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:53.475924 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96355a2a-5620-46af-9633-1dfab66e6be5 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:53.480660 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba37c5f-f58a-4d40-a885-c457e332deca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:53.481265 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba37c5f-f58a-4d40-a885-c457e332deca admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:53.481554 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba37c5f-f58a-4d40-a885-c457e332deca admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:53.481819 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba37c5f-f58a-4d40-a885-c457e332deca admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:53.482463 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba37c5f-f58a-4d40-a885-c457e332deca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:53.484096 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba37c5f-f58a-4d40-a885-c457e332deca admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:53.494975 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1063/2112] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:31:53.499127 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c10610-5ef9-4546-ba52-a111b3578368 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:53.509816 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c10610-5ef9-4546-ba52-a111b3578368 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:53.514415 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5463d9-e8c1-4aa8-bcb7-18cca09223f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:53.515066 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5463d9-e8c1-4aa8-bcb7-18cca09223f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:53.515345 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5463d9-e8c1-4aa8-bcb7-18cca09223f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:53.515617 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5463d9-e8c1-4aa8-bcb7-18cca09223f5 admin admin] PATH_INFO: `/v3/projects/b007b72c41294ed3b56fa86086c0b7d6/users/5ca61cc744f4477eb2f3e38d94f260fa/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:53.531572 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5463d9-e8c1-4aa8-bcb7-18cca09223f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b007b72c41294ed3b56fa86086c0b7d6, user_id=5ca61cc744f4477eb2f3e38d94f260fa, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:53.534184 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5463d9-e8c1-4aa8-bcb7-18cca09223f5 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:53.547683 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1050/2113] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:31:53 2022] PUT /identity/v3/projects/b007b72c41294ed3b56fa86086c0b7d6/users/5ca61cc744f4477eb2f3e38d94f260fa/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:31:53.558238 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56e67d-bcec-4d14-8aa3-2595b672c962 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:53.558576 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56e67d-bcec-4d14-8aa3-2595b672c962 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:53.558861 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56e67d-bcec-4d14-8aa3-2595b672c962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:53.591161 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-0f56e67d-bcec-4d14-8aa3-2595b672c962 None None] MFA Rules not processed for user `5ca61cc744f4477eb2f3e38d94f260fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:31:53.592408 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0f56e67d-bcec-4d14-8aa3-2595b672c962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:53.620365 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:31:53.662823 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1064/2114] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:31:53 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:31:53.667288 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5463d9-e8c1-4aa8-bcb7-18cca09223f5 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:53.732853 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5463d9-e8c1-4aa8-bcb7-18cca09223f5 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:53.737508 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa983db2-a08d-40c8-8d98-d005594bf69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:53.738110 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa983db2-a08d-40c8-8d98-d005594bf69e admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:53.738418 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa983db2-a08d-40c8-8d98-d005594bf69e admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:53.738885 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa983db2-a08d-40c8-8d98-d005594bf69e admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:53.739583 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa983db2-a08d-40c8-8d98-d005594bf69e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:53.741543 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa983db2-a08d-40c8-8d98-d005594bf69e admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:53.768670 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1051/2115] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:31:53 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:31:53.773405 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56e67d-bcec-4d14-8aa3-2595b672c962 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:53.784086 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56e67d-bcec-4d14-8aa3-2595b672c962 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:53.841341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b95ce5-a5de-41d3-a949-8be66982013b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:53.841947 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b95ce5-a5de-41d3-a949-8be66982013b admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:53.842228 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b95ce5-a5de-41d3-a949-8be66982013b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:53.842501 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b95ce5-a5de-41d3-a949-8be66982013b admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:53.843126 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b95ce5-a5de-41d3-a949-8be66982013b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:53.845075 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b95ce5-a5de-41d3-a949-8be66982013b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:53.867401 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1065/2116] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:31:53 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:31:53.871596 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa983db2-a08d-40c8-8d98-d005594bf69e admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:53.883274 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa983db2-a08d-40c8-8d98-d005594bf69e admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:53.887823 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a639101-f5ed-434b-afca-0daf644cb171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:53.888447 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a639101-f5ed-434b-afca-0daf644cb171 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:53.888746 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a639101-f5ed-434b-afca-0daf644cb171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:53.889011 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a639101-f5ed-434b-afca-0daf644cb171 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:53.889654 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a639101-f5ed-434b-afca-0daf644cb171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:53.891241 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a639101-f5ed-434b-afca-0daf644cb171 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:53.903299 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1052/2117] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:31:53.908212 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b95ce5-a5de-41d3-a949-8be66982013b admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:53.919503 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b95ce5-a5de-41d3-a949-8be66982013b admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:53.925453 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7beb20-9799-4f7f-942a-1677dd541ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:53.927186 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7beb20-9799-4f7f-942a-1677dd541ded admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:53.927506 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7beb20-9799-4f7f-942a-1677dd541ded admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:53.927783 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7beb20-9799-4f7f-942a-1677dd541ded admin admin] PATH_INFO: `/v3/projects/a3a40efbdc1e494b8e053be4227f5b33/users/46790f699857422c8b884ecae1c93613/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:53.945158 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7beb20-9799-4f7f-942a-1677dd541ded admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3a40efbdc1e494b8e053be4227f5b33, user_id=46790f699857422c8b884ecae1c93613, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:53.947834 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7beb20-9799-4f7f-942a-1677dd541ded admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:53.963949 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1066/2118] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:31:53 2022] PUT /identity/v3/projects/a3a40efbdc1e494b8e053be4227f5b33/users/46790f699857422c8b884ecae1c93613/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:31:53.967118 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a639101-f5ed-434b-afca-0daf644cb171 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:53.978952 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a639101-f5ed-434b-afca-0daf644cb171 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:54.042074 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb532a-b90e-4567-8ee3-70d0e3594d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:54.042686 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb532a-b90e-4567-8ee3-70d0e3594d77 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:54.042962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb532a-b90e-4567-8ee3-70d0e3594d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:54.043235 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb532a-b90e-4567-8ee3-70d0e3594d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:54.043868 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb532a-b90e-4567-8ee3-70d0e3594d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:54.045761 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb532a-b90e-4567-8ee3-70d0e3594d77 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:54.057165 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1053/2119] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:31:54.061086 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7beb20-9799-4f7f-942a-1677dd541ded admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:54.072110 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7beb20-9799-4f7f-942a-1677dd541ded admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:54.076581 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e2cb1-3c0c-435c-9737-36d76d84a532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:54.077221 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e2cb1-3c0c-435c-9737-36d76d84a532 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:54.077497 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e2cb1-3c0c-435c-9737-36d76d84a532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:54.077767 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e2cb1-3c0c-435c-9737-36d76d84a532 admin admin] PATH_INFO: `/v3/projects/a3a40efbdc1e494b8e053be4227f5b33/users/46790f699857422c8b884ecae1c93613/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:54.079655 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e2cb1-3c0c-435c-9737-36d76d84a532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3a40efbdc1e494b8e053be4227f5b33, user_id=46790f699857422c8b884ecae1c93613, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:54.083333 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e2cb1-3c0c-435c-9737-36d76d84a532 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:54.093996 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1067/2120] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:31:54 2022] PUT /identity/v3/projects/a3a40efbdc1e494b8e053be4227f5b33/users/46790f699857422c8b884ecae1c93613/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:31:54.106770 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d100f-66cd-414d-8af4-696e19aaf83e None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:54.107133 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d100f-66cd-414d-8af4-696e19aaf83e None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:54.107369 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d100f-66cd-414d-8af4-696e19aaf83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:54.136458 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-bd9d100f-66cd-414d-8af4-696e19aaf83e None None] MFA Rules not processed for user `46790f699857422c8b884ecae1c93613`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:31:54.137662 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-bd9d100f-66cd-414d-8af4-696e19aaf83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:54.163132 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:31:54.212656 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1054/2121] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:31:54 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:31:54.223543 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e2cb1-3c0c-435c-9737-36d76d84a532 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:54.225460 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9f3e2cb1-3c0c-435c-9737-36d76d84a532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:54.289565 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e2cb1-3c0c-435c-9737-36d76d84a532 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:54.293269 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d698e76-9f12-4254-9f0e-39ffdf3919a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:54.293871 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d698e76-9f12-4254-9f0e-39ffdf3919a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:54.294146 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d698e76-9f12-4254-9f0e-39ffdf3919a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:54.294415 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d698e76-9f12-4254-9f0e-39ffdf3919a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:54.304228 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d698e76-9f12-4254-9f0e-39ffdf3919a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:54.305650 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d698e76-9f12-4254-9f0e-39ffdf3919a6 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:54.314805 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1068/2122] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:31:54 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:31:54.457466 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d100f-66cd-414d-8af4-696e19aaf83e None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:54.521226 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d100f-66cd-414d-8af4-696e19aaf83e None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:54.525784 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23dd6f-7414-452b-859f-a5993c6436be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:54.526415 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23dd6f-7414-452b-859f-a5993c6436be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:54.526694 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23dd6f-7414-452b-859f-a5993c6436be admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:54.526969 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23dd6f-7414-452b-859f-a5993c6436be admin admin] PATH_INFO: `/v3/users/5ca61cc744f4477eb2f3e38d94f260fa` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:54.528122 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe23dd6f-7414-452b-859f-a5993c6436be admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ca61cc744f4477eb2f3e38d94f260fa)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:54.530338 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe23dd6f-7414-452b-859f-a5993c6436be admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:54.579575 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-fe23dd6f-7414-452b-859f-a5993c6436be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ca61cc744f4477eb2f3e38d94f260fa'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:54.594269 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-fe23dd6f-7414-452b-859f-a5993c6436be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ca61cc744f4477eb2f3e38d94f260fa'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:54.594985 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-fe23dd6f-7414-452b-859f-a5993c6436be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ca61cc744f4477eb2f3e38d94f260fa'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:54.602730 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-fe23dd6f-7414-452b-859f-a5993c6436be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ca61cc744f4477eb2f3e38d94f260fa'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:54.603337 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-fe23dd6f-7414-452b-859f-a5993c6436be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ca61cc744f4477eb2f3e38d94f260fa'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:54.616714 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1055/2123] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:31:54 2022] DELETE /identity/v3/users/5ca61cc744f4477eb2f3e38d94f260fa => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:31:54.620984 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bef414-cdc1-4f08-ac0e-fdb29197db58 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:54.621268 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bef414-cdc1-4f08-ac0e-fdb29197db58 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:54.621538 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bef414-cdc1-4f08-ac0e-fdb29197db58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:54.641346 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a3bef414-cdc1-4f08-ac0e-fdb29197db58 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:31:54.642547 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a3bef414-cdc1-4f08-ac0e-fdb29197db58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:54.659821 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:31:54.706911 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1069/2124] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:31:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:31:54.717406 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23dd6f-7414-452b-859f-a5993c6436be admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:54.718890 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-fe23dd6f-7414-452b-859f-a5993c6436be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:54.762015 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:31:54.777395 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23dd6f-7414-452b-859f-a5993c6436be admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:54.781008 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b95c1-1378-4d3c-9e62-13b4c7ce904c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:54.781636 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b95c1-1378-4d3c-9e62-13b4c7ce904c service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:54.781911 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b95c1-1378-4d3c-9e62-13b4c7ce904c service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:54.782181 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b95c1-1378-4d3c-9e62-13b4c7ce904c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:54.792294 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b95c1-1378-4d3c-9e62-13b4c7ce904c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:54.793740 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b95c1-1378-4d3c-9e62-13b4c7ce904c service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:54.804078 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1056/2125] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:31:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:31:55.120312 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bef414-cdc1-4f08-ac0e-fdb29197db58 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:55.122359 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a3bef414-cdc1-4f08-ac0e-fdb29197db58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:55.140374 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bef414-cdc1-4f08-ac0e-fdb29197db58 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:55.151488 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c5c8c-ea51-4b84-8245-c26b70f14927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:55.152169 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c5c8c-ea51-4b84-8245-c26b70f14927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:55.152447 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c5c8c-ea51-4b84-8245-c26b70f14927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:55.153374 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c5c8c-ea51-4b84-8245-c26b70f14927 admin admin] PATH_INFO: `/v3/projects/b007b72c41294ed3b56fa86086c0b7d6` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:55.154281 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c5c8c-ea51-4b84-8245-c26b70f14927 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b007b72c41294ed3b56fa86086c0b7d6)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:55.156893 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c5c8c-ea51-4b84-8245-c26b70f14927 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:55.213494 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5f7c5c8c-ea51-4b84-8245-c26b70f14927 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b007b72c41294ed3b56fa86086c0b7d6', 'request_id': 'req-5f7c5c8c-ea51-4b84-8245-c26b70f14927'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:55.223314 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5f7c5c8c-ea51-4b84-8245-c26b70f14927 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b007b72c41294ed3b56fa86086c0b7d6', 'request_id': 'req-5f7c5c8c-ea51-4b84-8245-c26b70f14927'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:55.230477 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5f7c5c8c-ea51-4b84-8245-c26b70f14927 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b007b72c41294ed3b56fa86086c0b7d6', 'request_id': 'req-5f7c5c8c-ea51-4b84-8245-c26b70f14927'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:55.243031 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5f7c5c8c-ea51-4b84-8245-c26b70f14927 admin admin] The token cache is being invalidate because project b007b72c41294ed3b56fa86086c0b7d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:31:55.244072 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5f7c5c8c-ea51-4b84-8245-c26b70f14927 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:55.244072 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5f7c5c8c-ea51-4b84-8245-c26b70f14927 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:55.245610 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1070/2126] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:31:55 2022] DELETE /identity/v3/projects/b007b72c41294ed3b56fa86086c0b7d6 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:31:55.249953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b95c1-1378-4d3c-9e62-13b4c7ce904c service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:55.260619 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b95c1-1378-4d3c-9e62-13b4c7ce904c service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:55.329000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc35999a-ac13-4371-8f19-1799024c2f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:55.329621 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc35999a-ac13-4371-8f19-1799024c2f20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:55.329894 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc35999a-ac13-4371-8f19-1799024c2f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:55.330165 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc35999a-ac13-4371-8f19-1799024c2f20 admin admin] PATH_INFO: `/v3/users/46790f699857422c8b884ecae1c93613` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:55.331260 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc35999a-ac13-4371-8f19-1799024c2f20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46790f699857422c8b884ecae1c93613)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:55.333824 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc35999a-ac13-4371-8f19-1799024c2f20 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:55.380019 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-dc35999a-ac13-4371-8f19-1799024c2f20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46790f699857422c8b884ecae1c93613'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:55.391714 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-dc35999a-ac13-4371-8f19-1799024c2f20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46790f699857422c8b884ecae1c93613'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:55.392389 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-dc35999a-ac13-4371-8f19-1799024c2f20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46790f699857422c8b884ecae1c93613'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:55.399651 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-dc35999a-ac13-4371-8f19-1799024c2f20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46790f699857422c8b884ecae1c93613'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:55.400195 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-dc35999a-ac13-4371-8f19-1799024c2f20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46790f699857422c8b884ecae1c93613'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:55.412219 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1057/2127] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:31:55 2022] DELETE /identity/v3/users/46790f699857422c8b884ecae1c93613 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:31:55.801673 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c5c8c-ea51-4b84-8245-c26b70f14927 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:55.803404 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5f7c5c8c-ea51-4b84-8245-c26b70f14927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:55.820713 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c5c8c-ea51-4b84-8245-c26b70f14927 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:55.882915 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abf6c6-3e1a-49d5-8ca5-a1a7d8ac7151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:55.883552 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abf6c6-3e1a-49d5-8ca5-a1a7d8ac7151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:55.883836 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abf6c6-3e1a-49d5-8ca5-a1a7d8ac7151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:55.884152 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abf6c6-3e1a-49d5-8ca5-a1a7d8ac7151 admin admin] PATH_INFO: `/v3/projects/a3a40efbdc1e494b8e053be4227f5b33` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:55.885283 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14abf6c6-3e1a-49d5-8ca5-a1a7d8ac7151 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3a40efbdc1e494b8e053be4227f5b33)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:55.887190 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14abf6c6-3e1a-49d5-8ca5-a1a7d8ac7151 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:55.947786 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:31:55.949431 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-14abf6c6-3e1a-49d5-8ca5-a1a7d8ac7151 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3a40efbdc1e494b8e053be4227f5b33', 'request_id': 'req-14abf6c6-3e1a-49d5-8ca5-a1a7d8ac7151'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:55.959739 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-14abf6c6-3e1a-49d5-8ca5-a1a7d8ac7151 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3a40efbdc1e494b8e053be4227f5b33', 'request_id': 'req-14abf6c6-3e1a-49d5-8ca5-a1a7d8ac7151'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:55.966611 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-14abf6c6-3e1a-49d5-8ca5-a1a7d8ac7151 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3a40efbdc1e494b8e053be4227f5b33', 'request_id': 'req-14abf6c6-3e1a-49d5-8ca5-a1a7d8ac7151'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:55.979859 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-14abf6c6-3e1a-49d5-8ca5-a1a7d8ac7151 admin admin] The token cache is being invalidate because project a3a40efbdc1e494b8e053be4227f5b33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:31:55.980241 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-14abf6c6-3e1a-49d5-8ca5-a1a7d8ac7151 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:55.981088 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-14abf6c6-3e1a-49d5-8ca5-a1a7d8ac7151 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:55.983567 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1071/2128] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:31:55 2022] DELETE /identity/v3/projects/a3a40efbdc1e494b8e053be4227f5b33 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:31:55.988284 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cf2de-610f-435e-b55b-7de4cba722c2 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:55.989406 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cf2de-610f-435e-b55b-7de4cba722c2 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:55.991014 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cf2de-610f-435e-b55b-7de4cba722c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:56.009223 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-752cf2de-610f-435e-b55b-7de4cba722c2 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:31:56.010491 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-752cf2de-610f-435e-b55b-7de4cba722c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:56.084234 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1058/2129] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:31:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:31:56.087209 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa32dd-a62b-4936-a9af-38b771950a5e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:56.087501 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa32dd-a62b-4936-a9af-38b771950a5e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:56.087776 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa32dd-a62b-4936-a9af-38b771950a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:56.110637 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-71aa32dd-a62b-4936-a9af-38b771950a5e None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:31:56.111877 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-71aa32dd-a62b-4936-a9af-38b771950a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:56.120707 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1072/2130] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:31:56.124917 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752cf2de-610f-435e-b55b-7de4cba722c2 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:56.130655 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:31:56.139963 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752cf2de-610f-435e-b55b-7de4cba722c2 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:56.146814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d307b8-4ff7-4213-84af-42c64aad176e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:56.147617 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d307b8-4ff7-4213-84af-42c64aad176e admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:56.148101 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d307b8-4ff7-4213-84af-42c64aad176e admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:56.148454 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d307b8-4ff7-4213-84af-42c64aad176e admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:56.149571 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d307b8-4ff7-4213-84af-42c64aad176e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:31:56.149992 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d307b8-4ff7-4213-84af-42c64aad176e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:56.151962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d307b8-4ff7-4213-84af-42c64aad176e admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:56.166623 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1059/2131] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:31:56.171184 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa32dd-a62b-4936-a9af-38b771950a5e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:56.182265 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa32dd-a62b-4936-a9af-38b771950a5e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:56.190128 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab5d29-2039-4bc8-92fd-51e96e75d245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:56.190956 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab5d29-2039-4bc8-92fd-51e96e75d245 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:56.191420 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab5d29-2039-4bc8-92fd-51e96e75d245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:56.191953 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab5d29-2039-4bc8-92fd-51e96e75d245 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:56.192951 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab5d29-2039-4bc8-92fd-51e96e75d245 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:56.195242 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab5d29-2039-4bc8-92fd-51e96e75d245 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:56.249650 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1073/2132] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:31:56 2022] POST /identity/v3/projects => generated 375 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:31:56.250656 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d307b8-4ff7-4213-84af-42c64aad176e admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:56.263213 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d307b8-4ff7-4213-84af-42c64aad176e admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:56.333406 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ec3b2-b1d3-4ea2-a440-53fdba4a0d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:56.341631 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ec3b2-b1d3-4ea2-a440-53fdba4a0d3c admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:56.342203 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ec3b2-b1d3-4ea2-a440-53fdba4a0d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:56.342697 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ec3b2-b1d3-4ea2-a440-53fdba4a0d3c admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:56.343502 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ec3b2-b1d3-4ea2-a440-53fdba4a0d3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:56.346176 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ec3b2-b1d3-4ea2-a440-53fdba4a0d3c admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:56.376745 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1060/2133] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:31:56 2022] POST /identity/v3/users => generated 288 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:31:56.381378 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab5d29-2039-4bc8-92fd-51e96e75d245 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:56.392525 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab5d29-2039-4bc8-92fd-51e96e75d245 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:56.400763 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17ed13-1cd7-431e-9035-b7f53f9b9716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:56.401453 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17ed13-1cd7-431e-9035-b7f53f9b9716 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:56.401798 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17ed13-1cd7-431e-9035-b7f53f9b9716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:56.402160 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17ed13-1cd7-431e-9035-b7f53f9b9716 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:56.402873 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17ed13-1cd7-431e-9035-b7f53f9b9716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:56.404623 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17ed13-1cd7-431e-9035-b7f53f9b9716 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:56.416365 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1074/2134] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:31:56.421005 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ec3b2-b1d3-4ea2-a440-53fdba4a0d3c admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:56.433499 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ec3b2-b1d3-4ea2-a440-53fdba4a0d3c admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:56.438621 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f5cd3-6d12-4b8f-9ba3-285a4024ffa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:56.439233 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f5cd3-6d12-4b8f-9ba3-285a4024ffa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:56.439516 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f5cd3-6d12-4b8f-9ba3-285a4024ffa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:56.439794 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f5cd3-6d12-4b8f-9ba3-285a4024ffa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:56.440599 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f5cd3-6d12-4b8f-9ba3-285a4024ffa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:56.442868 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f5cd3-6d12-4b8f-9ba3-285a4024ffa9 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:56.454108 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1061/2135] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:31:56.458278 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17ed13-1cd7-431e-9035-b7f53f9b9716 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:56.468261 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17ed13-1cd7-431e-9035-b7f53f9b9716 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:56.474305 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2afc66-3a5f-47f4-b7f9-459d4fffaf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:56.474977 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2afc66-3a5f-47f4-b7f9-459d4fffaf4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:56.475256 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2afc66-3a5f-47f4-b7f9-459d4fffaf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:56.475533 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2afc66-3a5f-47f4-b7f9-459d4fffaf4a admin admin] PATH_INFO: `/v3/projects/dab4a5d538e7454e8422388905a22245/users/af6bdbfd7be142249133f6f17497056d/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:56.493223 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2afc66-3a5f-47f4-b7f9-459d4fffaf4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dab4a5d538e7454e8422388905a22245, user_id=af6bdbfd7be142249133f6f17497056d, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:56.495925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2afc66-3a5f-47f4-b7f9-459d4fffaf4a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:56.509509 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1075/2136] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:31:56 2022] PUT /identity/v3/projects/dab4a5d538e7454e8422388905a22245/users/af6bdbfd7be142249133f6f17497056d/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:31:56.520487 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcba33d-6150-4d06-8f5b-a3bec471e82f None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:56.520887 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcba33d-6150-4d06-8f5b-a3bec471e82f None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:56.521253 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcba33d-6150-4d06-8f5b-a3bec471e82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:56.549871 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-1bcba33d-6150-4d06-8f5b-a3bec471e82f None None] MFA Rules not processed for user `af6bdbfd7be142249133f6f17497056d`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:31:56.551129 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-1bcba33d-6150-4d06-8f5b-a3bec471e82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:56.617372 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1062/2137] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:31:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:31:56.629793 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2afc66-3a5f-47f4-b7f9-459d4fffaf4a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:56.631613 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1a2afc66-3a5f-47f4-b7f9-459d4fffaf4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:31:56.692553 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2afc66-3a5f-47f4-b7f9-459d4fffaf4a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:56.696414 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b48d2f-4044-4673-9028-82b319e007c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:56.697028 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b48d2f-4044-4673-9028-82b319e007c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:56.697309 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b48d2f-4044-4673-9028-82b319e007c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:56.697584 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b48d2f-4044-4673-9028-82b319e007c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:56.706178 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b48d2f-4044-4673-9028-82b319e007c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:56.707592 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b48d2f-4044-4673-9028-82b319e007c9 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:56.716846 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1076/2138] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:31:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:31:59.777809 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcba33d-6150-4d06-8f5b-a3bec471e82f None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:31:59.845315 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:31:59.850896 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcba33d-6150-4d06-8f5b-a3bec471e82f None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:31:59.856698 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee0da4-c81a-4c39-863b-823c2e1563cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:31:59.857356 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee0da4-c81a-4c39-863b-823c2e1563cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:59.857636 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee0da4-c81a-4c39-863b-823c2e1563cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:59.857910 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee0da4-c81a-4c39-863b-823c2e1563cb admin admin] PATH_INFO: `/v3/users/af6bdbfd7be142249133f6f17497056d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:59.859082 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee0da4-c81a-4c39-863b-823c2e1563cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=af6bdbfd7be142249133f6f17497056d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:31:59.861083 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee0da4-c81a-4c39-863b-823c2e1563cb admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:31:59.912236 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-e0ee0da4-c81a-4c39-863b-823c2e1563cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af6bdbfd7be142249133f6f17497056d'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:59.924305 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-e0ee0da4-c81a-4c39-863b-823c2e1563cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af6bdbfd7be142249133f6f17497056d'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:59.924973 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-e0ee0da4-c81a-4c39-863b-823c2e1563cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af6bdbfd7be142249133f6f17497056d'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:59.934895 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-e0ee0da4-c81a-4c39-863b-823c2e1563cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af6bdbfd7be142249133f6f17497056d'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:59.935518 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-e0ee0da4-c81a-4c39-863b-823c2e1563cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af6bdbfd7be142249133f6f17497056d'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:31:59.949040 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1063/2139] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:31:59 2022] DELETE /identity/v3/users/af6bdbfd7be142249133f6f17497056d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:31:59.953431 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc274d-d522-4d6c-86a3-efded322f442 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:31:59.953923 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc274d-d522-4d6c-86a3-efded322f442 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:31:59.954033 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc274d-d522-4d6c-86a3-efded322f442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:31:59.973400 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c3cc274d-d522-4d6c-86a3-efded322f442 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:31:59.974619 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c3cc274d-d522-4d6c-86a3-efded322f442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:32:00.036434 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1077/2140] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:32:00.046086 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee0da4-c81a-4c39-863b-823c2e1563cb admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:00.047471 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-e0ee0da4-c81a-4c39-863b-823c2e1563cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:32:00.104955 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee0da4-c81a-4c39-863b-823c2e1563cb admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:00.108561 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3567763-ab28-480c-a1f1-991702aac397 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:00.109186 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3567763-ab28-480c-a1f1-991702aac397 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:00.109466 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3567763-ab28-480c-a1f1-991702aac397 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:00.109743 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3567763-ab28-480c-a1f1-991702aac397 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:00.119394 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3567763-ab28-480c-a1f1-991702aac397 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:00.120858 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3567763-ab28-480c-a1f1-991702aac397 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:00.130244 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1064/2141] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:32:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:32:00.430005 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc274d-d522-4d6c-86a3-efded322f442 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:00.431508 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c3cc274d-d522-4d6c-86a3-efded322f442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:32:00.443762 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc274d-d522-4d6c-86a3-efded322f442 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:00.448417 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7531c95-b68b-4e09-9b0a-548d92ad6c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:00.449053 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7531c95-b68b-4e09-9b0a-548d92ad6c4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:00.449333 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7531c95-b68b-4e09-9b0a-548d92ad6c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:00.449609 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7531c95-b68b-4e09-9b0a-548d92ad6c4a admin admin] PATH_INFO: `/v3/projects/dab4a5d538e7454e8422388905a22245` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:00.450768 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7531c95-b68b-4e09-9b0a-548d92ad6c4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dab4a5d538e7454e8422388905a22245)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:00.452658 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7531c95-b68b-4e09-9b0a-548d92ad6c4a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:00.464517 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:32:00.501432 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b7531c95-b68b-4e09-9b0a-548d92ad6c4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dab4a5d538e7454e8422388905a22245', 'request_id': 'req-b7531c95-b68b-4e09-9b0a-548d92ad6c4a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:32:00.510078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b7531c95-b68b-4e09-9b0a-548d92ad6c4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dab4a5d538e7454e8422388905a22245', 'request_id': 'req-b7531c95-b68b-4e09-9b0a-548d92ad6c4a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:32:00.515834 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b7531c95-b68b-4e09-9b0a-548d92ad6c4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dab4a5d538e7454e8422388905a22245', 'request_id': 'req-b7531c95-b68b-4e09-9b0a-548d92ad6c4a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:32:00.528179 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b7531c95-b68b-4e09-9b0a-548d92ad6c4a admin admin] The token cache is being invalidate because project dab4a5d538e7454e8422388905a22245 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:32:00.528397 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b7531c95-b68b-4e09-9b0a-548d92ad6c4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:32:00.529043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b7531c95-b68b-4e09-9b0a-548d92ad6c4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:32:00.530534 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1078/2142] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:32:00 2022] DELETE /identity/v3/projects/dab4a5d538e7454e8422388905a22245 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:32:00.535430 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bcf997-18b2-4a28-9e54-79f69fe8b024 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:00.535701 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bcf997-18b2-4a28-9e54-79f69fe8b024 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:00.536016 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bcf997-18b2-4a28-9e54-79f69fe8b024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:00.555628 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-25bcf997-18b2-4a28-9e54-79f69fe8b024 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:32:00.556878 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-25bcf997-18b2-4a28-9e54-79f69fe8b024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:32:00.618765 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1065/2143] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:32:00.684896 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2991599-e16b-44c0-8e93-e0b1dc01286b None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:00.685393 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2991599-e16b-44c0-8e93-e0b1dc01286b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:00.685913 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2991599-e16b-44c0-8e93-e0b1dc01286b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:00.719529 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f2991599-e16b-44c0-8e93-e0b1dc01286b None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:32:00.721321 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f2991599-e16b-44c0-8e93-e0b1dc01286b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:32:00.733930 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1079/2144] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:32:00.738145 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bcf997-18b2-4a28-9e54-79f69fe8b024 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:00.749363 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bcf997-18b2-4a28-9e54-79f69fe8b024 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:00.754132 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa8a6b-92c7-4673-88de-e7c5a2d4e3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:00.755017 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa8a6b-92c7-4673-88de-e7c5a2d4e3dc admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:00.755301 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa8a6b-92c7-4673-88de-e7c5a2d4e3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:00.755575 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa8a6b-92c7-4673-88de-e7c5a2d4e3dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:00.756273 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fa8a6b-92c7-4673-88de-e7c5a2d4e3dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:32:00.756575 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fa8a6b-92c7-4673-88de-e7c5a2d4e3dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:00.758196 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fa8a6b-92c7-4673-88de-e7c5a2d4e3dc admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:00.774713 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1066/2145] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:32:00.775940 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2991599-e16b-44c0-8e93-e0b1dc01286b None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:00.786798 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2991599-e16b-44c0-8e93-e0b1dc01286b None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:00.792121 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd07d7-0285-46df-b121-6a9c9169f8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:00.792748 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd07d7-0285-46df-b121-6a9c9169f8b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:00.793029 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd07d7-0285-46df-b121-6a9c9169f8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:00.793300 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd07d7-0285-46df-b121-6a9c9169f8b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:00.793946 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd07d7-0285-46df-b121-6a9c9169f8b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:00.796161 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd07d7-0285-46df-b121-6a9c9169f8b8 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:00.828198 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1080/2146] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:32:00 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:32:00.829392 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa8a6b-92c7-4673-88de-e7c5a2d4e3dc admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:00.840761 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa8a6b-92c7-4673-88de-e7c5a2d4e3dc admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:00.844602 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:32:00.903817 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf9a33f-8052-4523-b643-41c4afeec4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:00.904472 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9a33f-8052-4523-b643-41c4afeec4f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:00.904746 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9a33f-8052-4523-b643-41c4afeec4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:00.905019 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9a33f-8052-4523-b643-41c4afeec4f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:00.905702 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf9a33f-8052-4523-b643-41c4afeec4f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:00.907700 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf9a33f-8052-4523-b643-41c4afeec4f2 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:00.931226 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1067/2147] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:32:00 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:32:00.935403 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd07d7-0285-46df-b121-6a9c9169f8b8 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:00.946123 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd07d7-0285-46df-b121-6a9c9169f8b8 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:00.951219 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77c486-1158-4186-ae9c-bc42b361a77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:00.951835 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77c486-1158-4186-ae9c-bc42b361a77e admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:00.952159 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77c486-1158-4186-ae9c-bc42b361a77e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:00.952438 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77c486-1158-4186-ae9c-bc42b361a77e admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:00.953088 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77c486-1158-4186-ae9c-bc42b361a77e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:00.954700 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77c486-1158-4186-ae9c-bc42b361a77e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:00.966117 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1081/2148] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:32:00.970243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf9a33f-8052-4523-b643-41c4afeec4f2 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:00.981346 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf9a33f-8052-4523-b643-41c4afeec4f2 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:00.986277 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27b6a2-6a69-432d-9b46-96aa73bcb6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:00.986884 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27b6a2-6a69-432d-9b46-96aa73bcb6be admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:00.987162 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27b6a2-6a69-432d-9b46-96aa73bcb6be admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:00.987433 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27b6a2-6a69-432d-9b46-96aa73bcb6be admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:00.988107 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27b6a2-6a69-432d-9b46-96aa73bcb6be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:00.990031 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27b6a2-6a69-432d-9b46-96aa73bcb6be admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:01.002568 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1068/2149] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:32:01.007359 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77c486-1158-4186-ae9c-bc42b361a77e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:01.017416 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77c486-1158-4186-ae9c-bc42b361a77e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:01.022231 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26d2f3-9ffc-4bde-ac45-c277236e4fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:01.022878 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26d2f3-9ffc-4bde-ac45-c277236e4fba admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:01.023160 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26d2f3-9ffc-4bde-ac45-c277236e4fba admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:01.023433 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26d2f3-9ffc-4bde-ac45-c277236e4fba admin admin] PATH_INFO: `/v3/projects/e54e0088717744b4894bfd796eaf77fe/users/1eab8532e5fa482f8f999bea999d3ec1/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:01.039195 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce26d2f3-9ffc-4bde-ac45-c277236e4fba admin admin] RBAC: Authorizing `identity:create_grant(project_id=e54e0088717744b4894bfd796eaf77fe, user_id=1eab8532e5fa482f8f999bea999d3ec1, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:01.041848 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce26d2f3-9ffc-4bde-ac45-c277236e4fba admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:01.056653 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1082/2150] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:32:01 2022] PUT /identity/v3/projects/e54e0088717744b4894bfd796eaf77fe/users/1eab8532e5fa482f8f999bea999d3ec1/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:32:01.066876 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e061b2-66c9-4d79-a054-7c69bd551162 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:01.067175 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e061b2-66c9-4d79-a054-7c69bd551162 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:01.067478 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e061b2-66c9-4d79-a054-7c69bd551162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:01.102391 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-92e061b2-66c9-4d79-a054-7c69bd551162 None None] MFA Rules not processed for user `1eab8532e5fa482f8f999bea999d3ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:32:01.103628 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-92e061b2-66c9-4d79-a054-7c69bd551162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:32:01.177876 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1069/2151] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:32:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:32:01.182357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26d2f3-9ffc-4bde-ac45-c277236e4fba admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:01.252131 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26d2f3-9ffc-4bde-ac45-c277236e4fba admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:01.257507 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefbebf-e7da-4882-82b0-24d949da57aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:01.258117 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefbebf-e7da-4882-82b0-24d949da57aa admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:01.258395 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefbebf-e7da-4882-82b0-24d949da57aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:01.258668 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefbebf-e7da-4882-82b0-24d949da57aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:01.259294 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecefbebf-e7da-4882-82b0-24d949da57aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:01.261202 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecefbebf-e7da-4882-82b0-24d949da57aa admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:01.288689 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1083/2152] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:32:01 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:32:01.292775 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e061b2-66c9-4d79-a054-7c69bd551162 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:01.303506 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e061b2-66c9-4d79-a054-7c69bd551162 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:01.359077 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30e7b1-8a9b-47a2-b098-25667c220ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:01.359679 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30e7b1-8a9b-47a2-b098-25667c220ea7 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:01.359999 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30e7b1-8a9b-47a2-b098-25667c220ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:01.360276 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30e7b1-8a9b-47a2-b098-25667c220ea7 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:01.360912 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f30e7b1-8a9b-47a2-b098-25667c220ea7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:01.362822 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f30e7b1-8a9b-47a2-b098-25667c220ea7 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:01.384315 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1070/2153] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:32:01 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:32:01.388318 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefbebf-e7da-4882-82b0-24d949da57aa admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:01.398886 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefbebf-e7da-4882-82b0-24d949da57aa admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:01.403479 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839261a-3514-4faf-8c6a-770f2b946646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:01.404105 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839261a-3514-4faf-8c6a-770f2b946646 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:01.404386 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839261a-3514-4faf-8c6a-770f2b946646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:01.404658 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839261a-3514-4faf-8c6a-770f2b946646 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:01.405286 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839261a-3514-4faf-8c6a-770f2b946646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:01.406862 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839261a-3514-4faf-8c6a-770f2b946646 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:01.418853 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1084/2154] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:32:01.423368 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30e7b1-8a9b-47a2-b098-25667c220ea7 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:01.429794 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:32:01.434540 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30e7b1-8a9b-47a2-b098-25667c220ea7 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:01.440644 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c35c12-3f87-4171-8635-140df814840c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:01.441250 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c35c12-3f87-4171-8635-140df814840c admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:01.441680 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c35c12-3f87-4171-8635-140df814840c admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:01.441918 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c35c12-3f87-4171-8635-140df814840c admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:01.442422 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c35c12-3f87-4171-8635-140df814840c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:01.444099 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c35c12-3f87-4171-8635-140df814840c admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:01.454503 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1071/2155] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:32:01.459803 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839261a-3514-4faf-8c6a-770f2b946646 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:01.470542 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839261a-3514-4faf-8c6a-770f2b946646 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:01.475924 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123426a3-19cc-4ae5-aa93-8b3e50f7f3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:01.476589 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123426a3-19cc-4ae5-aa93-8b3e50f7f3cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:01.476869 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123426a3-19cc-4ae5-aa93-8b3e50f7f3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:01.477145 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123426a3-19cc-4ae5-aa93-8b3e50f7f3cb admin admin] PATH_INFO: `/v3/projects/fa9de74ddd7442b48163bbd6f11199b6/users/bfc34c100a944757b5b867283c26c076/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:01.480446 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:32:01.495153 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123426a3-19cc-4ae5-aa93-8b3e50f7f3cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa9de74ddd7442b48163bbd6f11199b6, user_id=bfc34c100a944757b5b867283c26c076, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:01.497968 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123426a3-19cc-4ae5-aa93-8b3e50f7f3cb admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:01.512506 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1085/2156] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:32:01 2022] PUT /identity/v3/projects/fa9de74ddd7442b48163bbd6f11199b6/users/bfc34c100a944757b5b867283c26c076/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:32:01.522862 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72ea10-95dd-42db-a0f1-ed60353b73ee None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:01.523146 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72ea10-95dd-42db-a0f1-ed60353b73ee None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:01.523415 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72ea10-95dd-42db-a0f1-ed60353b73ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:01.551992 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-0f72ea10-95dd-42db-a0f1-ed60353b73ee None None] MFA Rules not processed for user `bfc34c100a944757b5b867283c26c076`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:32:01.553114 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-0f72ea10-95dd-42db-a0f1-ed60353b73ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:32:01.622229 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1072/2157] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:32:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:32:01.626687 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123426a3-19cc-4ae5-aa93-8b3e50f7f3cb admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:01.696230 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123426a3-19cc-4ae5-aa93-8b3e50f7f3cb admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:01.700899 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86e374-294e-4534-9d91-1a9bd29ad7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:01.701504 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86e374-294e-4534-9d91-1a9bd29ad7b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:01.701786 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86e374-294e-4534-9d91-1a9bd29ad7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:01.702059 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86e374-294e-4534-9d91-1a9bd29ad7b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:01.702709 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86e374-294e-4534-9d91-1a9bd29ad7b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:01.704630 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86e374-294e-4534-9d91-1a9bd29ad7b7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:01.732288 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1086/2158] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:32:01 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:32:01.736345 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72ea10-95dd-42db-a0f1-ed60353b73ee None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:01.747719 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72ea10-95dd-42db-a0f1-ed60353b73ee None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:01.804062 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e319c32-de1c-4290-b786-6e512b5d0c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:01.804589 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e319c32-de1c-4290-b786-6e512b5d0c6d admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:01.804863 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e319c32-de1c-4290-b786-6e512b5d0c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:01.805131 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e319c32-de1c-4290-b786-6e512b5d0c6d admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:01.805754 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e319c32-de1c-4290-b786-6e512b5d0c6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:01.807646 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e319c32-de1c-4290-b786-6e512b5d0c6d admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:01.828099 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1073/2159] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:32:01 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:32:01.832265 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86e374-294e-4534-9d91-1a9bd29ad7b7 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:01.842185 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86e374-294e-4534-9d91-1a9bd29ad7b7 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:01.846740 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6389f-adcf-4941-90bf-317dcbe1e81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:01.847328 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6389f-adcf-4941-90bf-317dcbe1e81b admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:01.848253 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6389f-adcf-4941-90bf-317dcbe1e81b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:01.848568 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6389f-adcf-4941-90bf-317dcbe1e81b admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:01.849199 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d6389f-adcf-4941-90bf-317dcbe1e81b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:01.850768 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d6389f-adcf-4941-90bf-317dcbe1e81b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:01.860922 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1087/2160] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:32:01.865680 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e319c32-de1c-4290-b786-6e512b5d0c6d admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:01.875685 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e319c32-de1c-4290-b786-6e512b5d0c6d admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:01.880478 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a218a2-20af-487e-add6-d163a8a91928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:01.881120 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a218a2-20af-487e-add6-d163a8a91928 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:01.881401 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a218a2-20af-487e-add6-d163a8a91928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:01.881679 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a218a2-20af-487e-add6-d163a8a91928 admin admin] PATH_INFO: `/v3/projects/ebdcbd5706ae4f47a05cfa167d2426a8/users/aa2c87a019db4668ba21360a08b46516/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:01.896861 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a218a2-20af-487e-add6-d163a8a91928 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebdcbd5706ae4f47a05cfa167d2426a8, user_id=aa2c87a019db4668ba21360a08b46516, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:01.899551 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a218a2-20af-487e-add6-d163a8a91928 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:01.912795 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1074/2161] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:32:01 2022] PUT /identity/v3/projects/ebdcbd5706ae4f47a05cfa167d2426a8/users/aa2c87a019db4668ba21360a08b46516/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:32:01.916816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6389f-adcf-4941-90bf-317dcbe1e81b admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:01.927604 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6389f-adcf-4941-90bf-317dcbe1e81b admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:01.986891 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5e2c2-9e05-4470-864d-cf307f8ec247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:01.987494 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5e2c2-9e05-4470-864d-cf307f8ec247 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:01.987785 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5e2c2-9e05-4470-864d-cf307f8ec247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:01.988109 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5e2c2-9e05-4470-864d-cf307f8ec247 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:01.989373 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c5e2c2-9e05-4470-864d-cf307f8ec247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:01.991078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c5e2c2-9e05-4470-864d-cf307f8ec247 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:02.001440 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1088/2162] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:32:02.005690 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a218a2-20af-487e-add6-d163a8a91928 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:02.015791 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a218a2-20af-487e-add6-d163a8a91928 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:02.020270 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed26287-049f-4f20-bd79-32379db6fc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:02.020901 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed26287-049f-4f20-bd79-32379db6fc3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:02.021175 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed26287-049f-4f20-bd79-32379db6fc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:02.021447 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed26287-049f-4f20-bd79-32379db6fc3b admin admin] PATH_INFO: `/v3/projects/ebdcbd5706ae4f47a05cfa167d2426a8/users/aa2c87a019db4668ba21360a08b46516/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:02.023386 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed26287-049f-4f20-bd79-32379db6fc3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebdcbd5706ae4f47a05cfa167d2426a8, user_id=aa2c87a019db4668ba21360a08b46516, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:02.026460 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed26287-049f-4f20-bd79-32379db6fc3b admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:02.037287 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1075/2163] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:32:02 2022] PUT /identity/v3/projects/ebdcbd5706ae4f47a05cfa167d2426a8/users/aa2c87a019db4668ba21360a08b46516/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:32:02.048579 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf92a5-2028-4243-b7f3-e1786f990fa1 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:02.048871 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf92a5-2028-4243-b7f3-e1786f990fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:02.049146 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf92a5-2028-4243-b7f3-e1786f990fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:02.078119 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-3fcf92a5-2028-4243-b7f3-e1786f990fa1 None None] MFA Rules not processed for user `aa2c87a019db4668ba21360a08b46516`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:32:02.079981 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3fcf92a5-2028-4243-b7f3-e1786f990fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:32:02.137503 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:32:02.168901 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1089/2164] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:32:02 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:32:02.181720 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed26287-049f-4f20-bd79-32379db6fc3b admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:02.183703 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-1ed26287-049f-4f20-bd79-32379db6fc3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:32:02.237318 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:32:02.253021 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed26287-049f-4f20-bd79-32379db6fc3b admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:02.258020 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b374e-ae6e-475d-86c6-70df2e3e6f3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:02.258657 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b374e-ae6e-475d-86c6-70df2e3e6f3d service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:02.259291 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b374e-ae6e-475d-86c6-70df2e3e6f3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:02.259291 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b374e-ae6e-475d-86c6-70df2e3e6f3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:02.327567 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b374e-ae6e-475d-86c6-70df2e3e6f3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:02.329273 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b374e-ae6e-475d-86c6-70df2e3e6f3d service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:02.339597 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1076/2165] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:32:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:32:03.923622 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf92a5-2028-4243-b7f3-e1786f990fa1 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:03.934094 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf92a5-2028-4243-b7f3-e1786f990fa1 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:03.937748 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c1bb87-8924-49ca-aefa-c49a70ccdbf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:03.938348 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1bb87-8924-49ca-aefa-c49a70ccdbf2 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:03.938632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1bb87-8924-49ca-aefa-c49a70ccdbf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:03.938920 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1bb87-8924-49ca-aefa-c49a70ccdbf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:04.001141 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c1bb87-8924-49ca-aefa-c49a70ccdbf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:04.002537 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c1bb87-8924-49ca-aefa-c49a70ccdbf2 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:04.013110 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1090/2166] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:32:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:32:04.585901 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b374e-ae6e-475d-86c6-70df2e3e6f3d service cinder] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:04.594595 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b374e-ae6e-475d-86c6-70df2e3e6f3d service cinder] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:04.598821 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf637bdf-6ebe-498d-b1ec-c94050f91e7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:04.599441 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf637bdf-6ebe-498d-b1ec-c94050f91e7b service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:04.599716 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf637bdf-6ebe-498d-b1ec-c94050f91e7b service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:04.600014 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf637bdf-6ebe-498d-b1ec-c94050f91e7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:04.609265 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf637bdf-6ebe-498d-b1ec-c94050f91e7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:04.610681 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf637bdf-6ebe-498d-b1ec-c94050f91e7b service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:04.620218 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1077/2167] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:32:04 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:32:08.570729 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c1bb87-8924-49ca-aefa-c49a70ccdbf2 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:08.632160 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c1bb87-8924-49ca-aefa-c49a70ccdbf2 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:08.636628 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfae25c-17b0-4ec3-be96-f7168da7c598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:08.637239 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfae25c-17b0-4ec3-be96-f7168da7c598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:08.637516 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfae25c-17b0-4ec3-be96-f7168da7c598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:08.637784 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfae25c-17b0-4ec3-be96-f7168da7c598 admin admin] PATH_INFO: `/v3/users/1eab8532e5fa482f8f999bea999d3ec1` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:08.638876 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfae25c-17b0-4ec3-be96-f7168da7c598 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eab8532e5fa482f8f999bea999d3ec1)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:08.640802 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfae25c-17b0-4ec3-be96-f7168da7c598 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:08.686332 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2cfae25c-17b0-4ec3-be96-f7168da7c598 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eab8532e5fa482f8f999bea999d3ec1'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:32:08.686975 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2cfae25c-17b0-4ec3-be96-f7168da7c598 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eab8532e5fa482f8f999bea999d3ec1'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:32:08.699803 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2cfae25c-17b0-4ec3-be96-f7168da7c598 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eab8532e5fa482f8f999bea999d3ec1'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:32:08.707947 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2cfae25c-17b0-4ec3-be96-f7168da7c598 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eab8532e5fa482f8f999bea999d3ec1'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:32:08.715004 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2cfae25c-17b0-4ec3-be96-f7168da7c598 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eab8532e5fa482f8f999bea999d3ec1'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:32:08.716420 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:32:08.728056 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1091/2168] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:32:08 2022] DELETE /identity/v3/users/1eab8532e5fa482f8f999bea999d3ec1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:32:08.732332 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d2152-4feb-45df-a124-82298214fb39 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:08.732775 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d2152-4feb-45df-a124-82298214fb39 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:08.732871 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d2152-4feb-45df-a124-82298214fb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:08.751709 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-ca1d2152-4feb-45df-a124-82298214fb39 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:32:08.752923 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ca1d2152-4feb-45df-a124-82298214fb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:32:08.811209 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1078/2169] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:32:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:32:08.821368 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfae25c-17b0-4ec3-be96-f7168da7c598 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:08.822778 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2cfae25c-17b0-4ec3-be96-f7168da7c598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:32:08.880632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfae25c-17b0-4ec3-be96-f7168da7c598 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:08.884303 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6d2fd-90b2-4a83-b0ea-36131ac177f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:08.884903 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6d2fd-90b2-4a83-b0ea-36131ac177f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:08.885186 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6d2fd-90b2-4a83-b0ea-36131ac177f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:08.885459 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6d2fd-90b2-4a83-b0ea-36131ac177f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:08.894905 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b6d2fd-90b2-4a83-b0ea-36131ac177f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:08.896519 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b6d2fd-90b2-4a83-b0ea-36131ac177f7 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:08.905818 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1092/2170] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:32:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:32:09.176899 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d2152-4feb-45df-a124-82298214fb39 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:09.178343 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ca1d2152-4feb-45df-a124-82298214fb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:32:09.190234 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d2152-4feb-45df-a124-82298214fb39 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:09.196094 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a034d-0939-4f85-a075-fa71809f2318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:09.196094 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a034d-0939-4f85-a075-fa71809f2318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:09.196463 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a034d-0939-4f85-a075-fa71809f2318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:09.197049 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a034d-0939-4f85-a075-fa71809f2318 admin admin] PATH_INFO: `/v3/projects/e54e0088717744b4894bfd796eaf77fe` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:09.198173 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a034d-0939-4f85-a075-fa71809f2318 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e54e0088717744b4894bfd796eaf77fe)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:09.200118 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a034d-0939-4f85-a075-fa71809f2318 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:09.251236 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0a8a034d-0939-4f85-a075-fa71809f2318 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e54e0088717744b4894bfd796eaf77fe', 'request_id': 'req-0a8a034d-0939-4f85-a075-fa71809f2318'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:32:09.258062 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0a8a034d-0939-4f85-a075-fa71809f2318 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e54e0088717744b4894bfd796eaf77fe', 'request_id': 'req-0a8a034d-0939-4f85-a075-fa71809f2318'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:32:09.265948 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0a8a034d-0939-4f85-a075-fa71809f2318 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e54e0088717744b4894bfd796eaf77fe', 'request_id': 'req-0a8a034d-0939-4f85-a075-fa71809f2318'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:32:09.274806 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:32:09.278903 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0a8a034d-0939-4f85-a075-fa71809f2318 admin admin] The token cache is being invalidate because project e54e0088717744b4894bfd796eaf77fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:32:09.279210 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0a8a034d-0939-4f85-a075-fa71809f2318 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:32:09.279992 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0a8a034d-0939-4f85-a075-fa71809f2318 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:32:09.282151 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1079/2171] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:32:09 2022] DELETE /identity/v3/projects/e54e0088717744b4894bfd796eaf77fe => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:32:09.286530 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6d2fd-90b2-4a83-b0ea-36131ac177f7 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:09.296920 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6d2fd-90b2-4a83-b0ea-36131ac177f7 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:09.361535 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022a30b-6c57-44f0-a80e-3cda62b2f548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:09.362168 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022a30b-6c57-44f0-a80e-3cda62b2f548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:09.362445 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022a30b-6c57-44f0-a80e-3cda62b2f548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:09.362717 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022a30b-6c57-44f0-a80e-3cda62b2f548 admin admin] PATH_INFO: `/v3/users/bfc34c100a944757b5b867283c26c076` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:09.365136 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022a30b-6c57-44f0-a80e-3cda62b2f548 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfc34c100a944757b5b867283c26c076)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:09.367076 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022a30b-6c57-44f0-a80e-3cda62b2f548 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:09.413767 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0022a30b-6c57-44f0-a80e-3cda62b2f548 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfc34c100a944757b5b867283c26c076'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:32:09.414534 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0022a30b-6c57-44f0-a80e-3cda62b2f548 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfc34c100a944757b5b867283c26c076'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:32:09.429092 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0022a30b-6c57-44f0-a80e-3cda62b2f548 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfc34c100a944757b5b867283c26c076'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:32:09.436201 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0022a30b-6c57-44f0-a80e-3cda62b2f548 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfc34c100a944757b5b867283c26c076'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:32:09.443283 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0022a30b-6c57-44f0-a80e-3cda62b2f548 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfc34c100a944757b5b867283c26c076'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:32:09.449047 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1093/2172] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:32:09 2022] DELETE /identity/v3/users/bfc34c100a944757b5b867283c26c076 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:32:09.718991 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a034d-0939-4f85-a075-fa71809f2318 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:09.720472 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-0a8a034d-0939-4f85-a075-fa71809f2318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:32:09.735763 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a034d-0939-4f85-a075-fa71809f2318 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:09.792405 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850722b-fc8b-4dc1-9c05-4e9e7409ba60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:09.793033 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850722b-fc8b-4dc1-9c05-4e9e7409ba60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:09.793314 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850722b-fc8b-4dc1-9c05-4e9e7409ba60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:09.793587 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850722b-fc8b-4dc1-9c05-4e9e7409ba60 admin admin] PATH_INFO: `/v3/projects/fa9de74ddd7442b48163bbd6f11199b6` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:09.794685 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c850722b-fc8b-4dc1-9c05-4e9e7409ba60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa9de74ddd7442b48163bbd6f11199b6)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:09.796874 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c850722b-fc8b-4dc1-9c05-4e9e7409ba60 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:09.843121 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c850722b-fc8b-4dc1-9c05-4e9e7409ba60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa9de74ddd7442b48163bbd6f11199b6', 'request_id': 'req-c850722b-fc8b-4dc1-9c05-4e9e7409ba60'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:32:09.849367 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c850722b-fc8b-4dc1-9c05-4e9e7409ba60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa9de74ddd7442b48163bbd6f11199b6', 'request_id': 'req-c850722b-fc8b-4dc1-9c05-4e9e7409ba60'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:32:09.856836 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c850722b-fc8b-4dc1-9c05-4e9e7409ba60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa9de74ddd7442b48163bbd6f11199b6', 'request_id': 'req-c850722b-fc8b-4dc1-9c05-4e9e7409ba60'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:32:09.867819 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c850722b-fc8b-4dc1-9c05-4e9e7409ba60 admin admin] The token cache is being invalidate because project fa9de74ddd7442b48163bbd6f11199b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:32:09.868120 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c850722b-fc8b-4dc1-9c05-4e9e7409ba60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:32:09.868743 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c850722b-fc8b-4dc1-9c05-4e9e7409ba60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:32:09.870191 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1080/2173] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:32:09 2022] DELETE /identity/v3/projects/fa9de74ddd7442b48163bbd6f11199b6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:32:09.874164 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022a30b-6c57-44f0-a80e-3cda62b2f548 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:09.875584 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0022a30b-6c57-44f0-a80e-3cda62b2f548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:32:09.888753 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022a30b-6c57-44f0-a80e-3cda62b2f548 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:09.904871 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:32:09.947926 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6ce58-8524-4899-a626-e809d959d3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:09.948582 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6ce58-8524-4899-a626-e809d959d3ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:09.948863 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6ce58-8524-4899-a626-e809d959d3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:09.949137 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6ce58-8524-4899-a626-e809d959d3ff admin admin] PATH_INFO: `/v3/users/aa2c87a019db4668ba21360a08b46516` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:09.950253 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de6ce58-8524-4899-a626-e809d959d3ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa2c87a019db4668ba21360a08b46516)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:09.952208 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de6ce58-8524-4899-a626-e809d959d3ff admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:09.999826 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9de6ce58-8524-4899-a626-e809d959d3ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa2c87a019db4668ba21360a08b46516'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:32:10.000538 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9de6ce58-8524-4899-a626-e809d959d3ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa2c87a019db4668ba21360a08b46516'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:32:10.012789 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9de6ce58-8524-4899-a626-e809d959d3ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa2c87a019db4668ba21360a08b46516'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:32:10.019777 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9de6ce58-8524-4899-a626-e809d959d3ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa2c87a019db4668ba21360a08b46516'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:32:10.026747 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9de6ce58-8524-4899-a626-e809d959d3ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa2c87a019db4668ba21360a08b46516'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:32:10.032476 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1094/2174] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:32:09 2022] DELETE /identity/v3/users/aa2c87a019db4668ba21360a08b46516 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:32:10.303366 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850722b-fc8b-4dc1-9c05-4e9e7409ba60 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:10.304800 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c850722b-fc8b-4dc1-9c05-4e9e7409ba60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:32:10.318597 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850722b-fc8b-4dc1-9c05-4e9e7409ba60 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:10.374538 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1de38-e59d-4977-823f-a8b941bbd32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:10.375164 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1de38-e59d-4977-823f-a8b941bbd32d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:10.375439 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1de38-e59d-4977-823f-a8b941bbd32d admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:10.375711 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1de38-e59d-4977-823f-a8b941bbd32d admin admin] PATH_INFO: `/v3/projects/ebdcbd5706ae4f47a05cfa167d2426a8` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:10.376898 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1de38-e59d-4977-823f-a8b941bbd32d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebdcbd5706ae4f47a05cfa167d2426a8)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:10.379350 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1de38-e59d-4977-823f-a8b941bbd32d admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:10.414697 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:32:10.430138 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3bc1de38-e59d-4977-823f-a8b941bbd32d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebdcbd5706ae4f47a05cfa167d2426a8', 'request_id': 'req-3bc1de38-e59d-4977-823f-a8b941bbd32d'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:32:10.436340 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3bc1de38-e59d-4977-823f-a8b941bbd32d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebdcbd5706ae4f47a05cfa167d2426a8', 'request_id': 'req-3bc1de38-e59d-4977-823f-a8b941bbd32d'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:32:10.444772 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3bc1de38-e59d-4977-823f-a8b941bbd32d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebdcbd5706ae4f47a05cfa167d2426a8', 'request_id': 'req-3bc1de38-e59d-4977-823f-a8b941bbd32d'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:32:10.455188 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3bc1de38-e59d-4977-823f-a8b941bbd32d admin admin] The token cache is being invalidate because project ebdcbd5706ae4f47a05cfa167d2426a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:32:10.455469 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3bc1de38-e59d-4977-823f-a8b941bbd32d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:32:10.456119 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3bc1de38-e59d-4977-823f-a8b941bbd32d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:32:10.457642 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1081/2175] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:32:10 2022] DELETE /identity/v3/projects/ebdcbd5706ae4f47a05cfa167d2426a8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:32:10.462427 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60c8f1-2e4b-40fd-8435-addda9229946 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:10.462705 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60c8f1-2e4b-40fd-8435-addda9229946 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:10.462975 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60c8f1-2e4b-40fd-8435-addda9229946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:10.482834 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-0a60c8f1-2e4b-40fd-8435-addda9229946 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:32:10.484055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0a60c8f1-2e4b-40fd-8435-addda9229946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:32:10.545421 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1095/2176] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:32:10.553812 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8fbb5-cfb3-46ba-9ac6-e7e76778c8b1 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:10.554095 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8fbb5-cfb3-46ba-9ac6-e7e76778c8b1 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:10.554362 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8fbb5-cfb3-46ba-9ac6-e7e76778c8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:10.574583 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-53e8fbb5-cfb3-46ba-9ac6-e7e76778c8b1 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:32:10.575757 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-53e8fbb5-cfb3-46ba-9ac6-e7e76778c8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:32:10.584134 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1082/2177] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:32:10.588435 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60c8f1-2e4b-40fd-8435-addda9229946 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:10.598977 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60c8f1-2e4b-40fd-8435-addda9229946 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:10.603473 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46653a-f949-48a1-8f0b-819d3555fff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:10.604121 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46653a-f949-48a1-8f0b-819d3555fff0 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:10.604401 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46653a-f949-48a1-8f0b-819d3555fff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:10.604667 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46653a-f949-48a1-8f0b-819d3555fff0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:10.605299 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46653a-f949-48a1-8f0b-819d3555fff0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:32:10.605600 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46653a-f949-48a1-8f0b-819d3555fff0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:10.607269 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46653a-f949-48a1-8f0b-819d3555fff0 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:10.618750 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1096/2178] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:32:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:32:10.622901 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8fbb5-cfb3-46ba-9ac6-e7e76778c8b1 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:10.632066 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8fbb5-cfb3-46ba-9ac6-e7e76778c8b1 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:10.636591 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac291f6-a356-466c-8457-b947b32b7bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:10.637172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac291f6-a356-466c-8457-b947b32b7bb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:10.637447 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac291f6-a356-466c-8457-b947b32b7bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:10.637715 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac291f6-a356-466c-8457-b947b32b7bb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:10.638336 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac291f6-a356-466c-8457-b947b32b7bb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:10.640264 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac291f6-a356-466c-8457-b947b32b7bb4 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:10.668158 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1083/2179] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:32:10 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:32:10.672456 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46653a-f949-48a1-8f0b-819d3555fff0 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:10.682349 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46653a-f949-48a1-8f0b-819d3555fff0 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:10.706276 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:32:10.742325 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea851b1-f61b-4c51-a445-17c69692b5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:10.742929 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea851b1-f61b-4c51-a445-17c69692b5a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:10.743207 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea851b1-f61b-4c51-a445-17c69692b5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:10.743481 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea851b1-f61b-4c51-a445-17c69692b5a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:10.744146 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea851b1-f61b-4c51-a445-17c69692b5a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:10.746045 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea851b1-f61b-4c51-a445-17c69692b5a5 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:10.766656 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1097/2180] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:32:10 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:32:10.771025 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac291f6-a356-466c-8457-b947b32b7bb4 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:10.781139 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac291f6-a356-466c-8457-b947b32b7bb4 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:10.786340 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24eb37-d274-45fe-868a-b0b3421731d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:10.786900 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24eb37-d274-45fe-868a-b0b3421731d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:10.787178 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24eb37-d274-45fe-868a-b0b3421731d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:10.787450 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24eb37-d274-45fe-868a-b0b3421731d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:10.788116 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24eb37-d274-45fe-868a-b0b3421731d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:10.789694 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24eb37-d274-45fe-868a-b0b3421731d4 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:10.800031 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1084/2181] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:32:10.804068 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea851b1-f61b-4c51-a445-17c69692b5a5 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:10.813791 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea851b1-f61b-4c51-a445-17c69692b5a5 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:10.819217 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d80131-05cc-4aa3-a8b1-c1f94b73c017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:10.819806 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d80131-05cc-4aa3-a8b1-c1f94b73c017 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:10.820117 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d80131-05cc-4aa3-a8b1-c1f94b73c017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:10.820391 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d80131-05cc-4aa3-a8b1-c1f94b73c017 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:10.821024 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d80131-05cc-4aa3-a8b1-c1f94b73c017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:10.822603 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d80131-05cc-4aa3-a8b1-c1f94b73c017 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:10.833554 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1098/2182] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:32:10.837548 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24eb37-d274-45fe-868a-b0b3421731d4 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:10.847396 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24eb37-d274-45fe-868a-b0b3421731d4 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:10.852875 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa856f-237c-4ddf-88ec-c54edfc3f393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:10.853507 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa856f-237c-4ddf-88ec-c54edfc3f393 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:10.853783 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa856f-237c-4ddf-88ec-c54edfc3f393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:10.854053 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa856f-237c-4ddf-88ec-c54edfc3f393 admin admin] PATH_INFO: `/v3/projects/4dbb6817e6814bde94dccb2ffaa7afc1/users/81adbc1743c4439ba3efe559ebeecb2c/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:10.868748 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa856f-237c-4ddf-88ec-c54edfc3f393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dbb6817e6814bde94dccb2ffaa7afc1, user_id=81adbc1743c4439ba3efe559ebeecb2c, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:10.871459 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa856f-237c-4ddf-88ec-c54edfc3f393 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:10.885150 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1085/2183] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:32:10 2022] PUT /identity/v3/projects/4dbb6817e6814bde94dccb2ffaa7afc1/users/81adbc1743c4439ba3efe559ebeecb2c/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:32:10.889985 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be676dc-baae-4075-8683-80f762bf7ea4 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:10.890458 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be676dc-baae-4075-8683-80f762bf7ea4 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:10.890596 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be676dc-baae-4075-8683-80f762bf7ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:10.910825 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-8be676dc-baae-4075-8683-80f762bf7ea4 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:32:10.912069 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8be676dc-baae-4075-8683-80f762bf7ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:32:10.971033 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1099/2184] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:32:10.981179 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa856f-237c-4ddf-88ec-c54edfc3f393 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:10.982898 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-edaa856f-237c-4ddf-88ec-c54edfc3f393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:32:11.039520 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa856f-237c-4ddf-88ec-c54edfc3f393 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:11.043175 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864d6f2-f42c-44c4-82a0-e95bb6e12f66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:11.043724 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864d6f2-f42c-44c4-82a0-e95bb6e12f66 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:11.044033 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864d6f2-f42c-44c4-82a0-e95bb6e12f66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:11.044307 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864d6f2-f42c-44c4-82a0-e95bb6e12f66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:11.054480 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864d6f2-f42c-44c4-82a0-e95bb6e12f66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:11.055887 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864d6f2-f42c-44c4-82a0-e95bb6e12f66 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:11.065128 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1086/2185] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:32:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:32:11.705738 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999d4b9-e058-4d28-a40c-6b38e5a96b80 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:11.706162 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999d4b9-e058-4d28-a40c-6b38e5a96b80 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:11.706579 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999d4b9-e058-4d28-a40c-6b38e5a96b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:11.759974 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-b999d4b9-e058-4d28-a40c-6b38e5a96b80 None None] MFA Rules not processed for user `81adbc1743c4439ba3efe559ebeecb2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:32:11.761371 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b999d4b9-e058-4d28-a40c-6b38e5a96b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:32:11.835216 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1100/2186] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:32:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:32:11.846067 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864d6f2-f42c-44c4-82a0-e95bb6e12f66 service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:11.847482 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-3864d6f2-f42c-44c4-82a0-e95bb6e12f66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:32:11.906907 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864d6f2-f42c-44c4-82a0-e95bb6e12f66 service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:11.910627 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d3c6b-8674-474f-88db-d9e17d72d493 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:11.911251 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d3c6b-8674-474f-88db-d9e17d72d493 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:11.911545 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d3c6b-8674-474f-88db-d9e17d72d493 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:11.911826 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d3c6b-8674-474f-88db-d9e17d72d493 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:11.920379 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d3c6b-8674-474f-88db-d9e17d72d493 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:11.921834 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d3c6b-8674-474f-88db-d9e17d72d493 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:11.931708 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1087/2187] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:32:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:32:13.292945 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603ed85-ab9d-4e15-99f8-5140eb078891 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:13.293445 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603ed85-ab9d-4e15-99f8-5140eb078891 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:13.293540 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603ed85-ab9d-4e15-99f8-5140eb078891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:13.313388 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-8603ed85-ab9d-4e15-99f8-5140eb078891 None None] MFA Rules not processed for user `81adbc1743c4439ba3efe559ebeecb2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:32:13.314583 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8603ed85-ab9d-4e15-99f8-5140eb078891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:32:13.321604 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1101/2188] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:32:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:32:21.927761 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:32:23.308005 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=84,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:32:29.495972 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aece86-426f-4703-bc51-a1160cc98d79 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:29.496546 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aece86-426f-4703-bc51-a1160cc98d79 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:29.497063 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aece86-426f-4703-bc51-a1160cc98d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:29.539316 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-52aece86-426f-4703-bc51-a1160cc98d79 None None] MFA Rules not processed for user `9d5d4691dca848d58bd280d2fad79fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:32:29.540886 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-52aece86-426f-4703-bc51-a1160cc98d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:32:29.629481 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1088/2189] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 25 13:32:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:32:29.684842 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603ed85-ab9d-4e15-99f8-5140eb078891 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:29.686547 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8603ed85-ab9d-4e15-99f8-5140eb078891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:32:29.686801 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b8731-e600-4ca1-95dc-6c2406292574 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:29.687092 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b8731-e600-4ca1-95dc-6c2406292574 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:29.687370 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b8731-e600-4ca1-95dc-6c2406292574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:29.708230 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-7a8b8731-e600-4ca1-95dc-6c2406292574 None None] MFA Rules not processed for user `81adbc1743c4439ba3efe559ebeecb2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:32:29.709439 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-7a8b8731-e600-4ca1-95dc-6c2406292574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:32:29.736460 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1089/2190] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:32:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:32:29.805673 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603ed85-ab9d-4e15-99f8-5140eb078891 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:29.810827 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d5e0c-61c7-4a53-a030-97cf6429e2f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07413369b0c14e878d04ee528487801d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:29.811443 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d5e0c-61c7-4a53-a030-97cf6429e2f0 service swift] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:29.811736 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d5e0c-61c7-4a53-a030-97cf6429e2f0 service swift] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:29.812033 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d5e0c-61c7-4a53-a030-97cf6429e2f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:29.821037 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d5e0c-61c7-4a53-a030-97cf6429e2f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:29.822621 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d5e0c-61c7-4a53-a030-97cf6429e2f0 service swift] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:29.830649 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1102/2191] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 25 13:32:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 25 13:32:37.854840 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b8731-e600-4ca1-95dc-6c2406292574 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:37.856730 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-7a8b8731-e600-4ca1-95dc-6c2406292574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:32:38.029592 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b8731-e600-4ca1-95dc-6c2406292574 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:38.035788 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cfe2d2-8b99-4871-ac56-1592a310d3c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f10c161ef74c4a0d809346a5c4b53aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:38.037896 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfe2d2-8b99-4871-ac56-1592a310d3c2 service placement] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:38.038401 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfe2d2-8b99-4871-ac56-1592a310d3c2 service placement] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:38.039085 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfe2d2-8b99-4871-ac56-1592a310d3c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:38.041539 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-41cfe2d2-8b99-4871-ac56-1592a310d3c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:32:38.058931 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cfe2d2-8b99-4871-ac56-1592a310d3c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:38.060920 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cfe2d2-8b99-4871-ac56-1592a310d3c2 service placement] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:38.076658 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1090/2192] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:32:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:32:39.827405 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=47 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:32:47.797306 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f066ab6-3240-45f0-b79f-e404f1d09ba2 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:47.797962 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f066ab6-3240-45f0-b79f-e404f1d09ba2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:47.797962 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f066ab6-3240-45f0-b79f-e404f1d09ba2 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:47.799198 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1103/2193] 10.222.0.25 () {54 vars in 921 bytes} [Tue Oct 25 13:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:32:47.805585 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248c2e8-cdcd-4948-91fa-faf19f29169f None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:47.806075 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248c2e8-cdcd-4948-91fa-faf19f29169f None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:47.806181 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248c2e8-cdcd-4948-91fa-faf19f29169f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:47.824404 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:32:47.851034 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-3248c2e8-cdcd-4948-91fa-faf19f29169f None None] MFA Rules not processed for user `63e73c00cadb4deea934db6111ed76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:32:47.852260 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-3248c2e8-cdcd-4948-91fa-faf19f29169f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:32:47.934936 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1091/2194] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Oct 25 13:32:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:32:47.946827 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f066ab6-3240-45f0-b79f-e404f1d09ba2 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:47.948631 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6f066ab6-3240-45f0-b79f-e404f1d09ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:32:48.007877 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f066ab6-3240-45f0-b79f-e404f1d09ba2 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:48.011744 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b137c-9d1a-4aa7-b012-b9a381951adb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f67d808ffb4641b03f96406b3fe9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:48.012246 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b137c-9d1a-4aa7-b012-b9a381951adb service glance] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:48.012527 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b137c-9d1a-4aa7-b012-b9a381951adb service glance] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:48.012801 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b137c-9d1a-4aa7-b012-b9a381951adb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:48.023672 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b137c-9d1a-4aa7-b012-b9a381951adb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:48.025164 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b137c-9d1a-4aa7-b012-b9a381951adb service glance] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:48.037638 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1104/2195] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:32:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:32:48.107187 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe4872-21c1-40cd-b829-8866dcba6f05 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:48.107501 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe4872-21c1-40cd-b829-8866dcba6f05 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:48.107778 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe4872-21c1-40cd-b829-8866dcba6f05 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:48.109196 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1092/2196] 10.222.0.25 () {54 vars in 921 bytes} [Tue Oct 25 13:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:32:48.113927 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece36b3c-9c67-42dc-97d6-954933fcf090 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:48.114399 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece36b3c-9c67-42dc-97d6-954933fcf090 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:48.115050 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece36b3c-9c67-42dc-97d6-954933fcf090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:48.148044 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-ece36b3c-9c67-42dc-97d6-954933fcf090 None None] MFA Rules not processed for user `cec40e8c81fe4eafb474d40bc7bf38fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:32:48.149239 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ece36b3c-9c67-42dc-97d6-954933fcf090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:32:48.172343 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1105/2197] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Oct 25 13:32:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:32:48.184260 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe4872-21c1-40cd-b829-8866dcba6f05 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:48.196478 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe4872-21c1-40cd-b829-8866dcba6f05 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:48.200307 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092702a-9608-40ce-8847-23c494426851 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:48.203628 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092702a-9608-40ce-8847-23c494426851 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:48.203628 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092702a-9608-40ce-8847-23c494426851 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:48.203628 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092702a-9608-40ce-8847-23c494426851 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:48.210009 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1092702a-9608-40ce-8847-23c494426851 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:48.211433 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1092702a-9608-40ce-8847-23c494426851 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:48.219633 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1093/2198] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:32:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:32:48.309914 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200af543-cfb9-49b0-a793-6cb71a87e192 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:48.312280 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200af543-cfb9-49b0-a793-6cb71a87e192 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:48.312546 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200af543-cfb9-49b0-a793-6cb71a87e192 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:48.313920 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1106/2199] 10.222.0.25 () {54 vars in 921 bytes} [Tue Oct 25 13:32:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 25 13:32:48.320117 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19987ad6-c4fc-44bc-8187-fb347400e935 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:48.320290 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19987ad6-c4fc-44bc-8187-fb347400e935 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:48.320572 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19987ad6-c4fc-44bc-8187-fb347400e935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:48.341191 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-19987ad6-c4fc-44bc-8187-fb347400e935 None None] MFA Rules not processed for user `63e73c00cadb4deea934db6111ed76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:32:48.342390 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-19987ad6-c4fc-44bc-8187-fb347400e935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:32:48.353121 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1094/2200] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Oct 25 13:32:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:32:48.372519 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200af543-cfb9-49b0-a793-6cb71a87e192 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:48.372519 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-200af543-cfb9-49b0-a793-6cb71a87e192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:32:48.386776 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200af543-cfb9-49b0-a793-6cb71a87e192 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:48.390631 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9287f4-4516-4961-919d-96c962710e05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:48.391247 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9287f4-4516-4961-919d-96c962710e05 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:48.391531 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9287f4-4516-4961-919d-96c962710e05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:48.391810 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9287f4-4516-4961-919d-96c962710e05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:48.403634 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9287f4-4516-4961-919d-96c962710e05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:48.405785 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9287f4-4516-4961-919d-96c962710e05 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:48.421374 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1107/2201] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:32:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:32:49.915593 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191bb1db-bb29-4782-aa3b-f500a860f872 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:49.916146 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191bb1db-bb29-4782-aa3b-f500a860f872 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:49.916297 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191bb1db-bb29-4782-aa3b-f500a860f872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:49.937016 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-191bb1db-bb29-4782-aa3b-f500a860f872 None None] MFA Rules not processed for user `9d5d4691dca848d58bd280d2fad79fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:32:49.938337 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-191bb1db-bb29-4782-aa3b-f500a860f872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:32:49.945570 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1095/2202] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 25 13:32:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:32:49.959526 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9287f4-4516-4961-919d-96c962710e05 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:49.971015 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9287f4-4516-4961-919d-96c962710e05 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:49.977208 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903df93-066c-4272-b40e-46e3a59859e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07413369b0c14e878d04ee528487801d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:49.977942 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903df93-066c-4272-b40e-46e3a59859e9 service swift] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:49.978312 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903df93-066c-4272-b40e-46e3a59859e9 service swift] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:49.978679 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903df93-066c-4272-b40e-46e3a59859e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:49.987155 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903df93-066c-4272-b40e-46e3a59859e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:49.988773 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903df93-066c-4272-b40e-46e3a59859e9 service swift] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:49.998033 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1108/2203] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 25 13:32:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 25 13:32:50.463183 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187332f-74cb-4825-9a63-eb976114a5cf None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:50.463468 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187332f-74cb-4825-9a63-eb976114a5cf None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:50.463746 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187332f-74cb-4825-9a63-eb976114a5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:50.487432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-9187332f-74cb-4825-9a63-eb976114a5cf None None] MFA Rules not processed for user `9d5d4691dca848d58bd280d2fad79fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:32:50.488823 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-9187332f-74cb-4825-9a63-eb976114a5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:32:50.498607 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1096/2204] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 25 13:32:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:32:50.518628 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903df93-066c-4272-b40e-46e3a59859e9 service swift] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:32:50.532314 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903df93-066c-4272-b40e-46e3a59859e9 service swift] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:32:50.540006 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1fb508-7a59-4f0a-b3bb-8e1c27e8d51c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07413369b0c14e878d04ee528487801d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:32:50.540922 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1fb508-7a59-4f0a-b3bb-8e1c27e8d51c service swift] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:32:50.541261 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1fb508-7a59-4f0a-b3bb-8e1c27e8d51c service swift] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:32:50.541598 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1fb508-7a59-4f0a-b3bb-8e1c27e8d51c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:32:50.551060 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1fb508-7a59-4f0a-b3bb-8e1c27e8d51c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:32:50.553000 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1fb508-7a59-4f0a-b3bb-8e1c27e8d51c service swift] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:32:50.562426 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1109/2205] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 25 13:32:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 25 13:33:00.481999 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=54 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:33:00.558142 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=56 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:33:06.349243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1710b-b46c-4a28-8588-86cb5c46a162 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:06.349761 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1710b-b46c-4a28-8588-86cb5c46a162 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:06.349872 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1710b-b46c-4a28-8588-86cb5c46a162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:06.368421 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-cde1710b-b46c-4a28-8588-86cb5c46a162 None None] MFA Rules not processed for user `9d5d4691dca848d58bd280d2fad79fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:33:06.369605 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-cde1710b-b46c-4a28-8588-86cb5c46a162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:06.376706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1097/2206] 10.222.0.25 () {58 vars in 967 bytes} [Tue Oct 25 13:33:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:33:06.389846 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1fb508-7a59-4f0a-b3bb-8e1c27e8d51c service swift] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:06.400765 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1fb508-7a59-4f0a-b3bb-8e1c27e8d51c service swift] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:06.405671 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa0ab5-9607-400a-8ebc-aac895746f85 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07413369b0c14e878d04ee528487801d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:06.406255 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa0ab5-9607-400a-8ebc-aac895746f85 service swift] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:06.406816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa0ab5-9607-400a-8ebc-aac895746f85 service swift] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:06.407092 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa0ab5-9607-400a-8ebc-aac895746f85 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:06.414801 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa0ab5-9607-400a-8ebc-aac895746f85 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:06.416390 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa0ab5-9607-400a-8ebc-aac895746f85 service swift] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:06.425259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1110/2207] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 25 13:33:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 25 13:33:08.421916 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1710b-b46c-4a28-8588-86cb5c46a162 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:08.435352 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1710b-b46c-4a28-8588-86cb5c46a162 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:08.440762 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5decb74-17f8-489e-8236-3aea002c7656 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f10c161ef74c4a0d809346a5c4b53aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:08.441541 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5decb74-17f8-489e-8236-3aea002c7656 service placement] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:08.442694 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5decb74-17f8-489e-8236-3aea002c7656 service placement] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:08.443146 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5decb74-17f8-489e-8236-3aea002c7656 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:08.445110 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b5decb74-17f8-489e-8236-3aea002c7656 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:08.458287 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5decb74-17f8-489e-8236-3aea002c7656 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:08.459993 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5decb74-17f8-489e-8236-3aea002c7656 service placement] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:08.472824 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1098/2208] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:33:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:33:08.486558 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa0ab5-9607-400a-8ebc-aac895746f85 service swift] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:08.521480 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa0ab5-9607-400a-8ebc-aac895746f85 service swift] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:08.526213 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb3a52-0463-47eb-8dfc-75c4915b11a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:08.526843 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb3a52-0463-47eb-8dfc-75c4915b11a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:08.527121 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb3a52-0463-47eb-8dfc-75c4915b11a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:08.527395 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb3a52-0463-47eb-8dfc-75c4915b11a9 admin admin] PATH_INFO: `/v3/users/81adbc1743c4439ba3efe559ebeecb2c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:08.528534 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb3a52-0463-47eb-8dfc-75c4915b11a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81adbc1743c4439ba3efe559ebeecb2c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:08.530462 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb3a52-0463-47eb-8dfc-75c4915b11a9 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:08.577065 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-59bb3a52-0463-47eb-8dfc-75c4915b11a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81adbc1743c4439ba3efe559ebeecb2c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:08.577728 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-59bb3a52-0463-47eb-8dfc-75c4915b11a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81adbc1743c4439ba3efe559ebeecb2c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:08.590457 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-59bb3a52-0463-47eb-8dfc-75c4915b11a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81adbc1743c4439ba3efe559ebeecb2c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:08.597207 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-59bb3a52-0463-47eb-8dfc-75c4915b11a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81adbc1743c4439ba3efe559ebeecb2c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:08.604538 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-59bb3a52-0463-47eb-8dfc-75c4915b11a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81adbc1743c4439ba3efe559ebeecb2c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:08.610466 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1111/2209] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:33:08 2022] DELETE /identity/v3/users/81adbc1743c4439ba3efe559ebeecb2c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:33:08.777884 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5decb74-17f8-489e-8236-3aea002c7656 service placement] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:08.789056 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5decb74-17f8-489e-8236-3aea002c7656 service placement] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:08.846612 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1eae93-b8e2-4e8c-8bd7-3c6139603d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:08.847229 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1eae93-b8e2-4e8c-8bd7-3c6139603d18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:08.847504 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1eae93-b8e2-4e8c-8bd7-3c6139603d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:08.847773 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1eae93-b8e2-4e8c-8bd7-3c6139603d18 admin admin] PATH_INFO: `/v3/projects/4dbb6817e6814bde94dccb2ffaa7afc1` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:08.849141 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1eae93-b8e2-4e8c-8bd7-3c6139603d18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dbb6817e6814bde94dccb2ffaa7afc1)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:08.851014 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1eae93-b8e2-4e8c-8bd7-3c6139603d18 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:08.898551 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1d1eae93-b8e2-4e8c-8bd7-3c6139603d18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dbb6817e6814bde94dccb2ffaa7afc1', 'request_id': 'req-1d1eae93-b8e2-4e8c-8bd7-3c6139603d18'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:08.904666 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1d1eae93-b8e2-4e8c-8bd7-3c6139603d18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dbb6817e6814bde94dccb2ffaa7afc1', 'request_id': 'req-1d1eae93-b8e2-4e8c-8bd7-3c6139603d18'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:08.912254 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1d1eae93-b8e2-4e8c-8bd7-3c6139603d18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dbb6817e6814bde94dccb2ffaa7afc1', 'request_id': 'req-1d1eae93-b8e2-4e8c-8bd7-3c6139603d18'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:08.935641 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1d1eae93-b8e2-4e8c-8bd7-3c6139603d18 admin admin] The token cache is being invalidate because project 4dbb6817e6814bde94dccb2ffaa7afc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:33:08.935963 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1d1eae93-b8e2-4e8c-8bd7-3c6139603d18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:08.936583 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1d1eae93-b8e2-4e8c-8bd7-3c6139603d18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:08.938095 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1099/2210] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:33:08 2022] DELETE /identity/v3/projects/4dbb6817e6814bde94dccb2ffaa7afc1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:33:08.943672 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce10668-4c61-470b-84a9-1918b0e51c0f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:08.943991 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce10668-4c61-470b-84a9-1918b0e51c0f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:08.944275 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce10668-4c61-470b-84a9-1918b0e51c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:08.991251 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-cce10668-4c61-470b-84a9-1918b0e51c0f None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:33:08.992887 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cce10668-4c61-470b-84a9-1918b0e51c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:09.051938 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1112/2211] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:33:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:33:09.059428 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ded70-c6db-4a8d-a914-3240ef8eab40 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:09.059888 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ded70-c6db-4a8d-a914-3240ef8eab40 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:09.060270 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ded70-c6db-4a8d-a914-3240ef8eab40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:09.083683 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-551ded70-c6db-4a8d-a914-3240ef8eab40 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:33:09.085366 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-551ded70-c6db-4a8d-a914-3240ef8eab40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:09.094857 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1100/2212] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:33:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:33:09.099557 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce10668-4c61-470b-84a9-1918b0e51c0f None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:09.114499 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce10668-4c61-470b-84a9-1918b0e51c0f None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:09.119267 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944f2d5-aa05-4bba-99c4-8e7cb36d2b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:09.119876 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944f2d5-aa05-4bba-99c4-8e7cb36d2b5c admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:09.120188 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944f2d5-aa05-4bba-99c4-8e7cb36d2b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:09.120476 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944f2d5-aa05-4bba-99c4-8e7cb36d2b5c admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:09.121100 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944f2d5-aa05-4bba-99c4-8e7cb36d2b5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:33:09.121398 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944f2d5-aa05-4bba-99c4-8e7cb36d2b5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:09.123003 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944f2d5-aa05-4bba-99c4-8e7cb36d2b5c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:09.135968 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1113/2213] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:33:09.140133 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ded70-c6db-4a8d-a914-3240ef8eab40 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:09.150363 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ded70-c6db-4a8d-a914-3240ef8eab40 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:09.156040 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4da056-f1a2-4dca-a35a-fd7604feea71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:09.157074 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4da056-f1a2-4dca-a35a-fd7604feea71 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:09.157234 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4da056-f1a2-4dca-a35a-fd7604feea71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:09.157463 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4da056-f1a2-4dca-a35a-fd7604feea71 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:09.158093 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4da056-f1a2-4dca-a35a-fd7604feea71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:09.160889 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4da056-f1a2-4dca-a35a-fd7604feea71 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:09.204136 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1101/2214] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:33:09 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:33:09.204931 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944f2d5-aa05-4bba-99c4-8e7cb36d2b5c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:09.217705 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944f2d5-aa05-4bba-99c4-8e7cb36d2b5c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:09.224966 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:33:09.291994 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739ffc9-7ae9-48bb-ade0-ca7cc24efcc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:09.292700 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739ffc9-7ae9-48bb-ade0-ca7cc24efcc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:09.293050 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739ffc9-7ae9-48bb-ade0-ca7cc24efcc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:09.293392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739ffc9-7ae9-48bb-ade0-ca7cc24efcc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:09.294095 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6739ffc9-7ae9-48bb-ade0-ca7cc24efcc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:09.296464 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6739ffc9-7ae9-48bb-ade0-ca7cc24efcc4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:09.320747 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1114/2215] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:33:09 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:33:09.324769 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4da056-f1a2-4dca-a35a-fd7604feea71 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:09.340631 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4da056-f1a2-4dca-a35a-fd7604feea71 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:09.346020 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48816b3-889d-4474-bd73-7ff46bcf0b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:09.346732 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48816b3-889d-4474-bd73-7ff46bcf0b36 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:09.347058 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48816b3-889d-4474-bd73-7ff46bcf0b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:09.347389 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48816b3-889d-4474-bd73-7ff46bcf0b36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:09.348388 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48816b3-889d-4474-bd73-7ff46bcf0b36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:09.350605 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48816b3-889d-4474-bd73-7ff46bcf0b36 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:09.363704 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1102/2216] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:33:09.365212 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739ffc9-7ae9-48bb-ade0-ca7cc24efcc4 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:09.376242 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739ffc9-7ae9-48bb-ade0-ca7cc24efcc4 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:09.382955 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c760e33-fbd4-47d8-8268-47bc314ebfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:09.383574 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c760e33-fbd4-47d8-8268-47bc314ebfd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:09.383887 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c760e33-fbd4-47d8-8268-47bc314ebfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:09.384446 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c760e33-fbd4-47d8-8268-47bc314ebfd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:09.385300 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c760e33-fbd4-47d8-8268-47bc314ebfd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:09.386965 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c760e33-fbd4-47d8-8268-47bc314ebfd9 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:09.400292 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1115/2217] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:33:09.403757 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48816b3-889d-4474-bd73-7ff46bcf0b36 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:09.415322 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48816b3-889d-4474-bd73-7ff46bcf0b36 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:09.420102 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410d6fd-cced-443d-ba2c-398ac6eb263f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:09.421120 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410d6fd-cced-443d-ba2c-398ac6eb263f admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:09.421354 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410d6fd-cced-443d-ba2c-398ac6eb263f admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:09.421621 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410d6fd-cced-443d-ba2c-398ac6eb263f admin admin] PATH_INFO: `/v3/projects/9d45f8beafe24840911eadf88c323e07/users/e81974b148e0439c92b93b2d6481ae7e/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:09.440127 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410d6fd-cced-443d-ba2c-398ac6eb263f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d45f8beafe24840911eadf88c323e07, user_id=e81974b148e0439c92b93b2d6481ae7e, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:09.443442 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410d6fd-cced-443d-ba2c-398ac6eb263f admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:09.446528 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:33:09.459500 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1103/2218] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:33:09 2022] PUT /identity/v3/projects/9d45f8beafe24840911eadf88c323e07/users/e81974b148e0439c92b93b2d6481ae7e/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:33:09.469611 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31b69f-a442-40dd-ad65-24b4785c3c7f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:09.469898 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31b69f-a442-40dd-ad65-24b4785c3c7f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:09.470174 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31b69f-a442-40dd-ad65-24b4785c3c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:09.498347 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-bb31b69f-a442-40dd-ad65-24b4785c3c7f None None] MFA Rules not processed for user `e81974b148e0439c92b93b2d6481ae7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:33:09.499533 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-bb31b69f-a442-40dd-ad65-24b4785c3c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:09.564371 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1116/2219] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:33:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:33:09.576201 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410d6fd-cced-443d-ba2c-398ac6eb263f admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:09.577938 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-7410d6fd-cced-443d-ba2c-398ac6eb263f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:09.656294 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410d6fd-cced-443d-ba2c-398ac6eb263f admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:09.659932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6e98d-a051-43ed-8f5a-562c7f1e0a76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:09.661145 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6e98d-a051-43ed-8f5a-562c7f1e0a76 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:09.662325 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6e98d-a051-43ed-8f5a-562c7f1e0a76 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:09.662601 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6e98d-a051-43ed-8f5a-562c7f1e0a76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:09.671174 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b6e98d-a051-43ed-8f5a-562c7f1e0a76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:09.672617 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b6e98d-a051-43ed-8f5a-562c7f1e0a76 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:09.681624 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1104/2220] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:33:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:33:10.159967 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055774d5-42e6-410e-bcbf-d36e17ff46ad None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:10.160262 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055774d5-42e6-410e-bcbf-d36e17ff46ad None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:10.161178 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055774d5-42e6-410e-bcbf-d36e17ff46ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:10.181821 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-055774d5-42e6-410e-bcbf-d36e17ff46ad None None] MFA Rules not processed for user `9d5d4691dca848d58bd280d2fad79fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:33:10.183022 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-055774d5-42e6-410e-bcbf-d36e17ff46ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:10.239632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1117/2221] 10.222.0.25 () {58 vars in 967 bytes} [Tue Oct 25 13:33:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:33:10.252262 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6e98d-a051-43ed-8f5a-562c7f1e0a76 service cinder] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:10.253636 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-01b6e98d-a051-43ed-8f5a-562c7f1e0a76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:10.324503 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6e98d-a051-43ed-8f5a-562c7f1e0a76 service cinder] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:10.329856 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ab4a4-38b8-41d6-8d8c-66086931907a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07413369b0c14e878d04ee528487801d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:10.330470 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ab4a4-38b8-41d6-8d8c-66086931907a service swift] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:10.330773 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ab4a4-38b8-41d6-8d8c-66086931907a service swift] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:10.331047 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ab4a4-38b8-41d6-8d8c-66086931907a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:10.340153 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ab4a4-38b8-41d6-8d8c-66086931907a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:10.341721 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ab4a4-38b8-41d6-8d8c-66086931907a service swift] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:10.350095 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1105/2222] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 25 13:33:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 25 13:33:12.242180 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055774d5-42e6-410e-bcbf-d36e17ff46ad None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:12.267844 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:33:12.308341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055774d5-42e6-410e-bcbf-d36e17ff46ad None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:12.312831 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017ace9-d676-49ba-bdb2-4985a88c8a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:12.313448 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017ace9-d676-49ba-bdb2-4985a88c8a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:12.313727 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017ace9-d676-49ba-bdb2-4985a88c8a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:12.313996 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017ace9-d676-49ba-bdb2-4985a88c8a13 admin admin] PATH_INFO: `/v3/users/e81974b148e0439c92b93b2d6481ae7e` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:12.315122 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e017ace9-d676-49ba-bdb2-4985a88c8a13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e81974b148e0439c92b93b2d6481ae7e)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:12.317528 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e017ace9-d676-49ba-bdb2-4985a88c8a13 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:12.362638 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e017ace9-d676-49ba-bdb2-4985a88c8a13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e81974b148e0439c92b93b2d6481ae7e'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:12.364463 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e017ace9-d676-49ba-bdb2-4985a88c8a13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e81974b148e0439c92b93b2d6481ae7e'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:12.376832 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e017ace9-d676-49ba-bdb2-4985a88c8a13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e81974b148e0439c92b93b2d6481ae7e'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:12.384984 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e017ace9-d676-49ba-bdb2-4985a88c8a13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e81974b148e0439c92b93b2d6481ae7e'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:12.392944 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e017ace9-d676-49ba-bdb2-4985a88c8a13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e81974b148e0439c92b93b2d6481ae7e'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:12.399666 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1118/2223] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:33:12 2022] DELETE /identity/v3/users/e81974b148e0439c92b93b2d6481ae7e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:33:12.404101 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead2bc6-572e-4aef-98d4-80d328b19238 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:12.404568 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead2bc6-572e-4aef-98d4-80d328b19238 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:12.404809 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead2bc6-572e-4aef-98d4-80d328b19238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:12.428569 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-7ead2bc6-572e-4aef-98d4-80d328b19238 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:33:12.429794 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-7ead2bc6-572e-4aef-98d4-80d328b19238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:12.489992 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1106/2224] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:33:12.499450 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017ace9-d676-49ba-bdb2-4985a88c8a13 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:12.500888 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e017ace9-d676-49ba-bdb2-4985a88c8a13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:12.558514 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017ace9-d676-49ba-bdb2-4985a88c8a13 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:12.562183 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79451f3a-8eaa-4a20-a8d2-c99d23cb2357 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:12.562809 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79451f3a-8eaa-4a20-a8d2-c99d23cb2357 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:12.563089 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79451f3a-8eaa-4a20-a8d2-c99d23cb2357 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:12.563382 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79451f3a-8eaa-4a20-a8d2-c99d23cb2357 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:12.572205 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79451f3a-8eaa-4a20-a8d2-c99d23cb2357 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:12.573625 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79451f3a-8eaa-4a20-a8d2-c99d23cb2357 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:12.583635 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1119/2225] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:33:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:33:12.856414 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead2bc6-572e-4aef-98d4-80d328b19238 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:12.857828 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-7ead2bc6-572e-4aef-98d4-80d328b19238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:12.871915 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead2bc6-572e-4aef-98d4-80d328b19238 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:12.877436 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da93c2-07db-42bd-9cc9-474b84d60e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:12.878236 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da93c2-07db-42bd-9cc9-474b84d60e40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:12.878558 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da93c2-07db-42bd-9cc9-474b84d60e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:12.878816 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da93c2-07db-42bd-9cc9-474b84d60e40 admin admin] PATH_INFO: `/v3/projects/9d45f8beafe24840911eadf88c323e07` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:12.880190 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da93c2-07db-42bd-9cc9-474b84d60e40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d45f8beafe24840911eadf88c323e07)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:12.882155 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da93c2-07db-42bd-9cc9-474b84d60e40 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:12.884800 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:33:12.945555 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-e9da93c2-07db-42bd-9cc9-474b84d60e40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d45f8beafe24840911eadf88c323e07', 'request_id': 'req-e9da93c2-07db-42bd-9cc9-474b84d60e40'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:12.953234 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-e9da93c2-07db-42bd-9cc9-474b84d60e40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d45f8beafe24840911eadf88c323e07', 'request_id': 'req-e9da93c2-07db-42bd-9cc9-474b84d60e40'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:12.961609 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-e9da93c2-07db-42bd-9cc9-474b84d60e40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d45f8beafe24840911eadf88c323e07', 'request_id': 'req-e9da93c2-07db-42bd-9cc9-474b84d60e40'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:12.972102 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-e9da93c2-07db-42bd-9cc9-474b84d60e40 admin admin] The token cache is being invalidate because project 9d45f8beafe24840911eadf88c323e07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:33:12.972393 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-e9da93c2-07db-42bd-9cc9-474b84d60e40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:12.973100 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-e9da93c2-07db-42bd-9cc9-474b84d60e40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:12.974576 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1107/2226] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:33:12 2022] DELETE /identity/v3/projects/9d45f8beafe24840911eadf88c323e07 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:33:22.578674 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=69,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:33:22.968965 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=23,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:33:31.786591 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79451f3a-8eaa-4a20-a8d2-c99d23cb2357 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:31.788344 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-79451f3a-8eaa-4a20-a8d2-c99d23cb2357 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:31.800374 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79451f3a-8eaa-4a20-a8d2-c99d23cb2357 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:31.851240 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd9ea0-da4a-47da-b5fd-2e1836517be1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:31.851775 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd9ea0-da4a-47da-b5fd-2e1836517be1 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:31.852090 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd9ea0-da4a-47da-b5fd-2e1836517be1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:31.852365 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd9ea0-da4a-47da-b5fd-2e1836517be1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:31.854182 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b2fd9ea0-da4a-47da-b5fd-2e1836517be1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:31.918265 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd9ea0-da4a-47da-b5fd-2e1836517be1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:31.919695 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd9ea0-da4a-47da-b5fd-2e1836517be1 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:31.930179 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1120/2227] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:33:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:33:35.065853 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da93c2-07db-42bd-9cc9-474b84d60e40 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:35.067264 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-e9da93c2-07db-42bd-9cc9-474b84d60e40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:35.134910 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd9ea0-da4a-47da-b5fd-2e1836517be1 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:35.137129 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b2fd9ea0-da4a-47da-b5fd-2e1836517be1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:35.145280 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da93c2-07db-42bd-9cc9-474b84d60e40 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:35.152258 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd9ea0-da4a-47da-b5fd-2e1836517be1 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:35.152443 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0bf0f-1c46-45ba-af9e-a23bdf2eb040 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f10c161ef74c4a0d809346a5c4b53aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:35.153108 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0bf0f-1c46-45ba-af9e-a23bdf2eb040 service placement] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:35.153390 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0bf0f-1c46-45ba-af9e-a23bdf2eb040 service placement] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:35.153666 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0bf0f-1c46-45ba-af9e-a23bdf2eb040 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:35.155387 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-30f0bf0f-1c46-45ba-af9e-a23bdf2eb040 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:35.157132 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77a38f-ee9c-4e42-a057-ecfdc48d1751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:35.157786 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77a38f-ee9c-4e42-a057-ecfdc48d1751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:35.158067 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77a38f-ee9c-4e42-a057-ecfdc48d1751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:35.158336 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77a38f-ee9c-4e42-a057-ecfdc48d1751 admin admin] PATH_INFO: `/v3/users/2a2ed118a399479ab355bfd5734d04d8` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:35.159459 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77a38f-ee9c-4e42-a057-ecfdc48d1751 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a2ed118a399479ab355bfd5734d04d8)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:35.162213 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77a38f-ee9c-4e42-a057-ecfdc48d1751 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:35.168666 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0bf0f-1c46-45ba-af9e-a23bdf2eb040 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:35.170446 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0bf0f-1c46-45ba-af9e-a23bdf2eb040 service placement] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:35.181031 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1108/2228] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:33:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:33:35.220332 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2b77a38f-ee9c-4e42-a057-ecfdc48d1751 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a2ed118a399479ab355bfd5734d04d8'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:35.220982 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2b77a38f-ee9c-4e42-a057-ecfdc48d1751 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a2ed118a399479ab355bfd5734d04d8'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:35.233307 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2b77a38f-ee9c-4e42-a057-ecfdc48d1751 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a2ed118a399479ab355bfd5734d04d8'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:35.241661 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2b77a38f-ee9c-4e42-a057-ecfdc48d1751 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a2ed118a399479ab355bfd5734d04d8'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:35.248718 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2b77a38f-ee9c-4e42-a057-ecfdc48d1751 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a2ed118a399479ab355bfd5734d04d8'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:35.256334 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1121/2229] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:33:35 2022] DELETE /identity/v3/users/2a2ed118a399479ab355bfd5734d04d8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:33:35.424458 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0bf0f-1c46-45ba-af9e-a23bdf2eb040 service placement] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:35.437906 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0bf0f-1c46-45ba-af9e-a23bdf2eb040 service placement] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:35.495958 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9f8cb-846f-4f0b-99b4-64ffb23e419f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:35.496586 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9f8cb-846f-4f0b-99b4-64ffb23e419f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:35.496864 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9f8cb-846f-4f0b-99b4-64ffb23e419f admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:35.497136 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9f8cb-846f-4f0b-99b4-64ffb23e419f admin admin] PATH_INFO: `/v3/projects/dc5c8bd3b87a40aaad153b8454296ee7` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:35.498239 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd9f8cb-846f-4f0b-99b4-64ffb23e419f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc5c8bd3b87a40aaad153b8454296ee7)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:35.500173 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd9f8cb-846f-4f0b-99b4-64ffb23e419f admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:35.546937 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-fcd9f8cb-846f-4f0b-99b4-64ffb23e419f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc5c8bd3b87a40aaad153b8454296ee7', 'request_id': 'req-fcd9f8cb-846f-4f0b-99b4-64ffb23e419f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:35.553835 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-fcd9f8cb-846f-4f0b-99b4-64ffb23e419f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc5c8bd3b87a40aaad153b8454296ee7', 'request_id': 'req-fcd9f8cb-846f-4f0b-99b4-64ffb23e419f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:35.561940 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-fcd9f8cb-846f-4f0b-99b4-64ffb23e419f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc5c8bd3b87a40aaad153b8454296ee7', 'request_id': 'req-fcd9f8cb-846f-4f0b-99b4-64ffb23e419f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:35.572772 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-fcd9f8cb-846f-4f0b-99b4-64ffb23e419f admin admin] The token cache is being invalidate because project dc5c8bd3b87a40aaad153b8454296ee7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:33:35.573061 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-fcd9f8cb-846f-4f0b-99b4-64ffb23e419f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:35.573706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-fcd9f8cb-846f-4f0b-99b4-64ffb23e419f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:35.575173 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1109/2230] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:33:35 2022] DELETE /identity/v3/projects/dc5c8bd3b87a40aaad153b8454296ee7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:33:35.580111 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791e78f-d52e-4ca6-be96-02371a29fa74 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:35.580529 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791e78f-d52e-4ca6-be96-02371a29fa74 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:35.580704 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791e78f-d52e-4ca6-be96-02371a29fa74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:35.601069 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e791e78f-d52e-4ca6-be96-02371a29fa74 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:33:35.602319 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e791e78f-d52e-4ca6-be96-02371a29fa74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:35.620434 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:33:35.667190 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1122/2231] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:33:35.675242 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1eacb4-bb23-400b-a678-92390bb40500 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:35.675567 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1eacb4-bb23-400b-a678-92390bb40500 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:35.676433 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1eacb4-bb23-400b-a678-92390bb40500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:35.696748 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-7b1eacb4-bb23-400b-a678-92390bb40500 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:33:35.697959 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-7b1eacb4-bb23-400b-a678-92390bb40500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:35.706327 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1110/2232] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:33:35.710711 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791e78f-d52e-4ca6-be96-02371a29fa74 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:35.720646 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791e78f-d52e-4ca6-be96-02371a29fa74 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:35.727418 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af64be-0a51-4908-8f84-0c3d446a26b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:35.728074 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af64be-0a51-4908-8f84-0c3d446a26b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:35.728490 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af64be-0a51-4908-8f84-0c3d446a26b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:35.728778 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af64be-0a51-4908-8f84-0c3d446a26b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:35.729435 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af64be-0a51-4908-8f84-0c3d446a26b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:33:35.729742 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af64be-0a51-4908-8f84-0c3d446a26b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:35.731366 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af64be-0a51-4908-8f84-0c3d446a26b5 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:35.744368 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1123/2233] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:33:35.748570 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1eacb4-bb23-400b-a678-92390bb40500 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:35.757878 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1eacb4-bb23-400b-a678-92390bb40500 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:35.762645 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881159ac-2f06-458d-9a1c-63f65a235b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:35.763237 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881159ac-2f06-458d-9a1c-63f65a235b1e admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:35.763516 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881159ac-2f06-458d-9a1c-63f65a235b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:35.763800 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881159ac-2f06-458d-9a1c-63f65a235b1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:35.764486 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881159ac-2f06-458d-9a1c-63f65a235b1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:35.766411 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881159ac-2f06-458d-9a1c-63f65a235b1e admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:35.777605 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:33:35.796234 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1111/2234] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:33:35 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:33:35.800129 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af64be-0a51-4908-8f84-0c3d446a26b5 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:35.810738 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af64be-0a51-4908-8f84-0c3d446a26b5 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:35.866204 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640416d-6f0c-416f-b136-d93c9c62a3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:35.866817 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640416d-6f0c-416f-b136-d93c9c62a3ec admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:35.867102 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640416d-6f0c-416f-b136-d93c9c62a3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:35.867378 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640416d-6f0c-416f-b136-d93c9c62a3ec admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:35.868053 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d640416d-6f0c-416f-b136-d93c9c62a3ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:35.869979 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d640416d-6f0c-416f-b136-d93c9c62a3ec admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:35.890801 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1124/2235] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:33:35 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:33:35.895606 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881159ac-2f06-458d-9a1c-63f65a235b1e admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:35.906024 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881159ac-2f06-458d-9a1c-63f65a235b1e admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:35.911235 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099fabc6-873d-4265-b8f8-7b458fc17af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:35.912132 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fabc6-873d-4265-b8f8-7b458fc17af1 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:35.912432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fabc6-873d-4265-b8f8-7b458fc17af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:35.912700 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fabc6-873d-4265-b8f8-7b458fc17af1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:35.913330 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099fabc6-873d-4265-b8f8-7b458fc17af1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:35.914890 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099fabc6-873d-4265-b8f8-7b458fc17af1 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:35.925315 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1112/2236] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:33:35.929215 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640416d-6f0c-416f-b136-d93c9c62a3ec admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:35.939135 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640416d-6f0c-416f-b136-d93c9c62a3ec admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:35.943979 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136b8b8-6315-4c74-822e-fe6b4ff04a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:35.944578 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136b8b8-6315-4c74-822e-fe6b4ff04a3e admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:35.944863 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136b8b8-6315-4c74-822e-fe6b4ff04a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:35.945141 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136b8b8-6315-4c74-822e-fe6b4ff04a3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:35.945774 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7136b8b8-6315-4c74-822e-fe6b4ff04a3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:35.947361 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7136b8b8-6315-4c74-822e-fe6b4ff04a3e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:35.958626 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1125/2237] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:33:35.962685 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099fabc6-873d-4265-b8f8-7b458fc17af1 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:35.973182 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099fabc6-873d-4265-b8f8-7b458fc17af1 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:35.977845 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e972b-3512-4497-ad05-0e71bf0c29ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:35.978481 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e972b-3512-4497-ad05-0e71bf0c29ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:35.978758 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e972b-3512-4497-ad05-0e71bf0c29ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:35.979031 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e972b-3512-4497-ad05-0e71bf0c29ef admin admin] PATH_INFO: `/v3/projects/57671642e5684118beb6192627ea2a69/users/a023ac605ae94293a0b93cedb3198ed0/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:35.993441 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e972b-3512-4497-ad05-0e71bf0c29ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=57671642e5684118beb6192627ea2a69, user_id=a023ac605ae94293a0b93cedb3198ed0, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:35.996087 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e972b-3512-4497-ad05-0e71bf0c29ef admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:36.009529 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1113/2238] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:33:35 2022] PUT /identity/v3/projects/57671642e5684118beb6192627ea2a69/users/a023ac605ae94293a0b93cedb3198ed0/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:33:36.021389 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde8ade-94f0-4759-baff-998b4420a96b None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:36.021679 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde8ade-94f0-4759-baff-998b4420a96b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:36.021959 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde8ade-94f0-4759-baff-998b4420a96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:36.049968 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-1dde8ade-94f0-4759-baff-998b4420a96b None None] MFA Rules not processed for user `a023ac605ae94293a0b93cedb3198ed0`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:33:36.051401 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1dde8ade-94f0-4759-baff-998b4420a96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:36.115964 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1126/2239] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:33:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:33:36.120358 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e972b-3512-4497-ad05-0e71bf0c29ef admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:36.181284 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e972b-3512-4497-ad05-0e71bf0c29ef admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:36.185828 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a603476-ba0c-42fb-980a-d12cfbdce4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:36.186448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a603476-ba0c-42fb-980a-d12cfbdce4f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:36.186725 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a603476-ba0c-42fb-980a-d12cfbdce4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:36.186995 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a603476-ba0c-42fb-980a-d12cfbdce4f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:36.187626 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a603476-ba0c-42fb-980a-d12cfbdce4f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:36.189548 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a603476-ba0c-42fb-980a-d12cfbdce4f1 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:36.216764 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1114/2240] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:33:36 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:33:36.220781 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde8ade-94f0-4759-baff-998b4420a96b None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:36.231481 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde8ade-94f0-4759-baff-998b4420a96b None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:36.243937 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:33:36.288915 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a59ead-f483-497e-be90-0be29646012f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:36.289520 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a59ead-f483-497e-be90-0be29646012f admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:36.289795 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a59ead-f483-497e-be90-0be29646012f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:36.290066 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a59ead-f483-497e-be90-0be29646012f admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:36.290694 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a59ead-f483-497e-be90-0be29646012f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:36.292634 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a59ead-f483-497e-be90-0be29646012f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:36.314433 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1127/2241] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:33:36 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:33:36.319336 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a603476-ba0c-42fb-980a-d12cfbdce4f1 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:36.329946 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a603476-ba0c-42fb-980a-d12cfbdce4f1 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:36.335275 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30101a04-6cd0-4538-8544-770d317d7cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:36.335881 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30101a04-6cd0-4538-8544-770d317d7cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:36.336190 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30101a04-6cd0-4538-8544-770d317d7cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:36.336465 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30101a04-6cd0-4538-8544-770d317d7cf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:36.337109 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30101a04-6cd0-4538-8544-770d317d7cf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:36.338733 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30101a04-6cd0-4538-8544-770d317d7cf7 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:36.349789 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1115/2242] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:33:36.353926 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a59ead-f483-497e-be90-0be29646012f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:36.366682 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a59ead-f483-497e-be90-0be29646012f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:36.371205 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf23d892-c06f-4d08-bb64-d794d9b04e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:36.371819 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23d892-c06f-4d08-bb64-d794d9b04e52 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:36.372183 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23d892-c06f-4d08-bb64-d794d9b04e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:36.372461 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23d892-c06f-4d08-bb64-d794d9b04e52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:36.373107 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf23d892-c06f-4d08-bb64-d794d9b04e52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:36.374755 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf23d892-c06f-4d08-bb64-d794d9b04e52 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:36.385479 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1128/2243] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:33:36.389576 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30101a04-6cd0-4538-8544-770d317d7cf7 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:36.399945 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30101a04-6cd0-4538-8544-770d317d7cf7 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:36.404584 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd1d9e-7aa3-4370-b026-6b59e696fa18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:36.405440 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd1d9e-7aa3-4370-b026-6b59e696fa18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:36.405744 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd1d9e-7aa3-4370-b026-6b59e696fa18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:36.406078 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd1d9e-7aa3-4370-b026-6b59e696fa18 admin admin] PATH_INFO: `/v3/projects/50b8b61bbbc242559be9a761484ff727/users/335f1d48c8a44f92aa9719f39cd61ffb/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:36.425564 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd1d9e-7aa3-4370-b026-6b59e696fa18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50b8b61bbbc242559be9a761484ff727, user_id=335f1d48c8a44f92aa9719f39cd61ffb, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:36.429399 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd1d9e-7aa3-4370-b026-6b59e696fa18 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:36.442108 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1116/2244] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:33:36 2022] PUT /identity/v3/projects/50b8b61bbbc242559be9a761484ff727/users/335f1d48c8a44f92aa9719f39cd61ffb/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:33:36.452094 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ceb22-cd8a-487c-b8cb-00f077277f3d None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:36.452380 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ceb22-cd8a-487c-b8cb-00f077277f3d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:36.452654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ceb22-cd8a-487c-b8cb-00f077277f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:36.482005 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-707ceb22-cd8a-487c-b8cb-00f077277f3d None None] MFA Rules not processed for user `335f1d48c8a44f92aa9719f39cd61ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:33:36.483299 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-707ceb22-cd8a-487c-b8cb-00f077277f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:36.549842 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1129/2245] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:33:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:33:36.555081 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd1d9e-7aa3-4370-b026-6b59e696fa18 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:36.616527 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd1d9e-7aa3-4370-b026-6b59e696fa18 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:36.621017 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f0389-a2ae-4a32-b9f7-562a40c51bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:36.621615 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f0389-a2ae-4a32-b9f7-562a40c51bfa admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:36.621895 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f0389-a2ae-4a32-b9f7-562a40c51bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:36.622170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f0389-a2ae-4a32-b9f7-562a40c51bfa admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:36.622798 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479f0389-a2ae-4a32-b9f7-562a40c51bfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:36.624713 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479f0389-a2ae-4a32-b9f7-562a40c51bfa admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:36.635674 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:33:36.652288 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1117/2246] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:33:36 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:33:36.656467 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ceb22-cd8a-487c-b8cb-00f077277f3d None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:36.667740 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ceb22-cd8a-487c-b8cb-00f077277f3d None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:36.725259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764bebb8-e832-489d-9aa4-c11c8229d39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:36.725873 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764bebb8-e832-489d-9aa4-c11c8229d39a admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:36.726152 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764bebb8-e832-489d-9aa4-c11c8229d39a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:36.726424 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764bebb8-e832-489d-9aa4-c11c8229d39a admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:36.727562 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764bebb8-e832-489d-9aa4-c11c8229d39a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:36.729012 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764bebb8-e832-489d-9aa4-c11c8229d39a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:36.750006 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1130/2247] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:33:36 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:33:36.754869 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f0389-a2ae-4a32-b9f7-562a40c51bfa admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:36.765088 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f0389-a2ae-4a32-b9f7-562a40c51bfa admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:36.769706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac091cd0-2cf7-4972-adad-ce18f7f6e742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:36.770299 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac091cd0-2cf7-4972-adad-ce18f7f6e742 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:36.770578 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac091cd0-2cf7-4972-adad-ce18f7f6e742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:36.770853 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac091cd0-2cf7-4972-adad-ce18f7f6e742 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:36.771489 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac091cd0-2cf7-4972-adad-ce18f7f6e742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:36.773109 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac091cd0-2cf7-4972-adad-ce18f7f6e742 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:36.782848 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1118/2248] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:33:36.786914 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764bebb8-e832-489d-9aa4-c11c8229d39a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:36.796952 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764bebb8-e832-489d-9aa4-c11c8229d39a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:36.802071 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceafb58b-9dc0-4ff6-a4ff-47adc7ebe2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:36.802706 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceafb58b-9dc0-4ff6-a4ff-47adc7ebe2f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:36.802998 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceafb58b-9dc0-4ff6-a4ff-47adc7ebe2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:36.803265 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceafb58b-9dc0-4ff6-a4ff-47adc7ebe2f4 admin admin] PATH_INFO: `/v3/projects/3418600b48534da3bf46f6afb9b0bae9/users/7ca34ffc4684445586b8c0311cced22b/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:36.815228 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:33:36.819420 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceafb58b-9dc0-4ff6-a4ff-47adc7ebe2f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3418600b48534da3bf46f6afb9b0bae9, user_id=7ca34ffc4684445586b8c0311cced22b, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:36.822749 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceafb58b-9dc0-4ff6-a4ff-47adc7ebe2f4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:36.836435 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1131/2249] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:33:36 2022] PUT /identity/v3/projects/3418600b48534da3bf46f6afb9b0bae9/users/7ca34ffc4684445586b8c0311cced22b/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:33:36.840368 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac091cd0-2cf7-4972-adad-ce18f7f6e742 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:36.850418 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac091cd0-2cf7-4972-adad-ce18f7f6e742 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:36.908063 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a964387-9f4b-43fa-88df-6b0de91b65a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:36.908681 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a964387-9f4b-43fa-88df-6b0de91b65a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:36.908960 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a964387-9f4b-43fa-88df-6b0de91b65a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:36.909232 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a964387-9f4b-43fa-88df-6b0de91b65a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:36.909908 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a964387-9f4b-43fa-88df-6b0de91b65a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:36.911547 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a964387-9f4b-43fa-88df-6b0de91b65a8 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:36.922540 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1119/2250] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:33:36.931228 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceafb58b-9dc0-4ff6-a4ff-47adc7ebe2f4 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:36.937715 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceafb58b-9dc0-4ff6-a4ff-47adc7ebe2f4 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:36.942916 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93832d-9ac4-48c5-aa8b-b99c1c361511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:36.943567 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93832d-9ac4-48c5-aa8b-b99c1c361511 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:36.943847 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93832d-9ac4-48c5-aa8b-b99c1c361511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:36.944152 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93832d-9ac4-48c5-aa8b-b99c1c361511 admin admin] PATH_INFO: `/v3/projects/3418600b48534da3bf46f6afb9b0bae9/users/7ca34ffc4684445586b8c0311cced22b/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:36.946076 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d93832d-9ac4-48c5-aa8b-b99c1c361511 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3418600b48534da3bf46f6afb9b0bae9, user_id=7ca34ffc4684445586b8c0311cced22b, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:36.948742 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d93832d-9ac4-48c5-aa8b-b99c1c361511 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:36.958992 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1132/2251] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:33:36 2022] PUT /identity/v3/projects/3418600b48534da3bf46f6afb9b0bae9/users/7ca34ffc4684445586b8c0311cced22b/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:33:36.970350 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081c68f-9034-4107-a89d-9ccf679fcdb6 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:36.970671 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081c68f-9034-4107-a89d-9ccf679fcdb6 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:36.970954 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081c68f-9034-4107-a89d-9ccf679fcdb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:36.999389 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-4081c68f-9034-4107-a89d-9ccf679fcdb6 None None] MFA Rules not processed for user `7ca34ffc4684445586b8c0311cced22b`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:33:37.000638 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-4081c68f-9034-4107-a89d-9ccf679fcdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:37.074986 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1120/2252] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:33:36 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:33:37.087017 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93832d-9ac4-48c5-aa8b-b99c1c361511 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:37.088783 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5d93832d-9ac4-48c5-aa8b-b99c1c361511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:37.163263 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93832d-9ac4-48c5-aa8b-b99c1c361511 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:37.171187 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e55249-4282-41d3-b625-3f8e2c541866 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:37.171745 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e55249-4282-41d3-b625-3f8e2c541866 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:37.172094 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e55249-4282-41d3-b625-3f8e2c541866 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:37.172372 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e55249-4282-41d3-b625-3f8e2c541866 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:37.184458 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e55249-4282-41d3-b625-3f8e2c541866 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:37.184619 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e55249-4282-41d3-b625-3f8e2c541866 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:37.198274 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1133/2253] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:33:37 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:33:37.240462 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081c68f-9034-4107-a89d-9ccf679fcdb6 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:37.241919 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-4081c68f-9034-4107-a89d-9ccf679fcdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:37.254623 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081c68f-9034-4107-a89d-9ccf679fcdb6 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:37.258645 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21098e54-9796-4008-a934-64e7f653875f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:37.259267 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21098e54-9796-4008-a934-64e7f653875f service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:37.259582 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21098e54-9796-4008-a934-64e7f653875f service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:37.259933 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21098e54-9796-4008-a934-64e7f653875f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:37.318165 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21098e54-9796-4008-a934-64e7f653875f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:37.319586 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21098e54-9796-4008-a934-64e7f653875f service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:37.324056 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:33:37.329162 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1121/2254] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:33:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:33:40.206310 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e55249-4282-41d3-b625-3f8e2c541866 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:40.276831 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e55249-4282-41d3-b625-3f8e2c541866 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:40.281504 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc132398-4768-4136-89e3-49216618b8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:40.282147 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc132398-4768-4136-89e3-49216618b8d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:40.282430 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc132398-4768-4136-89e3-49216618b8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:40.282707 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc132398-4768-4136-89e3-49216618b8d1 admin admin] PATH_INFO: `/v3/users/a023ac605ae94293a0b93cedb3198ed0` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:40.283846 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc132398-4768-4136-89e3-49216618b8d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a023ac605ae94293a0b93cedb3198ed0)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:40.286392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc132398-4768-4136-89e3-49216618b8d1 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:40.342954 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-fc132398-4768-4136-89e3-49216618b8d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a023ac605ae94293a0b93cedb3198ed0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:40.343616 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-fc132398-4768-4136-89e3-49216618b8d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a023ac605ae94293a0b93cedb3198ed0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:40.356515 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-fc132398-4768-4136-89e3-49216618b8d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a023ac605ae94293a0b93cedb3198ed0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:40.366134 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-fc132398-4768-4136-89e3-49216618b8d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a023ac605ae94293a0b93cedb3198ed0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:40.373360 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-fc132398-4768-4136-89e3-49216618b8d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a023ac605ae94293a0b93cedb3198ed0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:40.375574 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:33:40.380894 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1134/2255] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:33:40 2022] DELETE /identity/v3/users/a023ac605ae94293a0b93cedb3198ed0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:33:40.385647 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af445d9d-a298-47e8-b2ba-c94b9f2f97f9 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:40.386119 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af445d9d-a298-47e8-b2ba-c94b9f2f97f9 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:40.386247 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af445d9d-a298-47e8-b2ba-c94b9f2f97f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:40.406473 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-af445d9d-a298-47e8-b2ba-c94b9f2f97f9 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:33:40.407688 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-af445d9d-a298-47e8-b2ba-c94b9f2f97f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:40.475587 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1122/2256] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:33:40.485847 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc132398-4768-4136-89e3-49216618b8d1 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:40.487359 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fc132398-4768-4136-89e3-49216618b8d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:40.545533 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc132398-4768-4136-89e3-49216618b8d1 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:40.549436 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265e61a-7001-4494-b885-6f0ab24f82c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:40.550037 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265e61a-7001-4494-b885-6f0ab24f82c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:40.550319 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265e61a-7001-4494-b885-6f0ab24f82c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:40.550632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265e61a-7001-4494-b885-6f0ab24f82c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:40.559595 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9265e61a-7001-4494-b885-6f0ab24f82c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:40.561063 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9265e61a-7001-4494-b885-6f0ab24f82c5 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:40.570511 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1135/2257] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:33:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 13:33:40.842957 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af445d9d-a298-47e8-b2ba-c94b9f2f97f9 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:40.844500 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-af445d9d-a298-47e8-b2ba-c94b9f2f97f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:40.858316 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af445d9d-a298-47e8-b2ba-c94b9f2f97f9 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:40.863126 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd7bba-86f2-4d04-adf9-f93ebda00037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:40.864327 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd7bba-86f2-4d04-adf9-f93ebda00037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:40.864625 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd7bba-86f2-4d04-adf9-f93ebda00037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:40.864889 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd7bba-86f2-4d04-adf9-f93ebda00037 admin admin] PATH_INFO: `/v3/projects/57671642e5684118beb6192627ea2a69` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:40.866022 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd7bba-86f2-4d04-adf9-f93ebda00037 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57671642e5684118beb6192627ea2a69)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:40.868020 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd7bba-86f2-4d04-adf9-f93ebda00037 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:40.917783 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-e1dd7bba-86f2-4d04-adf9-f93ebda00037 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57671642e5684118beb6192627ea2a69', 'request_id': 'req-e1dd7bba-86f2-4d04-adf9-f93ebda00037'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:40.924864 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-e1dd7bba-86f2-4d04-adf9-f93ebda00037 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57671642e5684118beb6192627ea2a69', 'request_id': 'req-e1dd7bba-86f2-4d04-adf9-f93ebda00037'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:40.933830 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-e1dd7bba-86f2-4d04-adf9-f93ebda00037 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57671642e5684118beb6192627ea2a69', 'request_id': 'req-e1dd7bba-86f2-4d04-adf9-f93ebda00037'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:40.945759 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-e1dd7bba-86f2-4d04-adf9-f93ebda00037 admin admin] The token cache is being invalidate because project 57671642e5684118beb6192627ea2a69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:33:40.946048 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-e1dd7bba-86f2-4d04-adf9-f93ebda00037 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:40.946936 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-e1dd7bba-86f2-4d04-adf9-f93ebda00037 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:40.948690 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1123/2258] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:33:40 2022] DELETE /identity/v3/projects/57671642e5684118beb6192627ea2a69 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:33:40.952375 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265e61a-7001-4494-b885-6f0ab24f82c5 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:40.962360 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265e61a-7001-4494-b885-6f0ab24f82c5 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:41.019271 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b02c5-63ad-468e-b1f5-b9679e35f98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:41.019880 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b02c5-63ad-468e-b1f5-b9679e35f98f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:41.020202 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b02c5-63ad-468e-b1f5-b9679e35f98f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:41.020480 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b02c5-63ad-468e-b1f5-b9679e35f98f admin admin] PATH_INFO: `/v3/users/335f1d48c8a44f92aa9719f39cd61ffb` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:41.021604 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b02c5-63ad-468e-b1f5-b9679e35f98f admin admin] RBAC: Authorizing `identity:delete_user(user_id=335f1d48c8a44f92aa9719f39cd61ffb)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:41.023642 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b02c5-63ad-468e-b1f5-b9679e35f98f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:41.075605 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-334b02c5-63ad-468e-b1f5-b9679e35f98f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '335f1d48c8a44f92aa9719f39cd61ffb'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:41.076275 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-334b02c5-63ad-468e-b1f5-b9679e35f98f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '335f1d48c8a44f92aa9719f39cd61ffb'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:41.092675 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-334b02c5-63ad-468e-b1f5-b9679e35f98f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '335f1d48c8a44f92aa9719f39cd61ffb'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:41.101849 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-334b02c5-63ad-468e-b1f5-b9679e35f98f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '335f1d48c8a44f92aa9719f39cd61ffb'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:41.108970 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-334b02c5-63ad-468e-b1f5-b9679e35f98f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '335f1d48c8a44f92aa9719f39cd61ffb'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:41.115753 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1136/2259] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:33:40 2022] DELETE /identity/v3/users/335f1d48c8a44f92aa9719f39cd61ffb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:33:41.403687 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd7bba-86f2-4d04-adf9-f93ebda00037 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:41.405214 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-e1dd7bba-86f2-4d04-adf9-f93ebda00037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:41.419379 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd7bba-86f2-4d04-adf9-f93ebda00037 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:41.481565 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f315b90-f281-4e5d-bae7-9cba37ae1f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:41.482187 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f315b90-f281-4e5d-bae7-9cba37ae1f22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:41.482463 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f315b90-f281-4e5d-bae7-9cba37ae1f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:41.482734 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f315b90-f281-4e5d-bae7-9cba37ae1f22 admin admin] PATH_INFO: `/v3/projects/50b8b61bbbc242559be9a761484ff727` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:41.483820 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f315b90-f281-4e5d-bae7-9cba37ae1f22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50b8b61bbbc242559be9a761484ff727)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:41.485735 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f315b90-f281-4e5d-bae7-9cba37ae1f22 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:41.516093 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:33:41.534178 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2f315b90-f281-4e5d-bae7-9cba37ae1f22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50b8b61bbbc242559be9a761484ff727', 'request_id': 'req-2f315b90-f281-4e5d-bae7-9cba37ae1f22'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:41.540343 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2f315b90-f281-4e5d-bae7-9cba37ae1f22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50b8b61bbbc242559be9a761484ff727', 'request_id': 'req-2f315b90-f281-4e5d-bae7-9cba37ae1f22'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:41.547690 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2f315b90-f281-4e5d-bae7-9cba37ae1f22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50b8b61bbbc242559be9a761484ff727', 'request_id': 'req-2f315b90-f281-4e5d-bae7-9cba37ae1f22'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:41.557780 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2f315b90-f281-4e5d-bae7-9cba37ae1f22 admin admin] The token cache is being invalidate because project 50b8b61bbbc242559be9a761484ff727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:33:41.558066 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2f315b90-f281-4e5d-bae7-9cba37ae1f22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:41.558681 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2f315b90-f281-4e5d-bae7-9cba37ae1f22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:41.560183 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1124/2260] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:33:41 2022] DELETE /identity/v3/projects/50b8b61bbbc242559be9a761484ff727 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:33:41.564143 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b02c5-63ad-468e-b1f5-b9679e35f98f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:41.565526 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-334b02c5-63ad-468e-b1f5-b9679e35f98f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:41.578420 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b02c5-63ad-468e-b1f5-b9679e35f98f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:41.597054 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:33:41.636571 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9ee67-ca39-4554-a7fa-1e013abe27ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:41.637194 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9ee67-ca39-4554-a7fa-1e013abe27ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:41.637474 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9ee67-ca39-4554-a7fa-1e013abe27ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:41.637748 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9ee67-ca39-4554-a7fa-1e013abe27ea admin admin] PATH_INFO: `/v3/users/7ca34ffc4684445586b8c0311cced22b` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:41.638850 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee9ee67-ca39-4554-a7fa-1e013abe27ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ca34ffc4684445586b8c0311cced22b)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:41.640798 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee9ee67-ca39-4554-a7fa-1e013abe27ea admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:41.686035 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2ee9ee67-ca39-4554-a7fa-1e013abe27ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ca34ffc4684445586b8c0311cced22b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:41.686597 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2ee9ee67-ca39-4554-a7fa-1e013abe27ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ca34ffc4684445586b8c0311cced22b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:41.698667 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2ee9ee67-ca39-4554-a7fa-1e013abe27ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ca34ffc4684445586b8c0311cced22b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:41.705981 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2ee9ee67-ca39-4554-a7fa-1e013abe27ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ca34ffc4684445586b8c0311cced22b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:41.713452 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2ee9ee67-ca39-4554-a7fa-1e013abe27ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ca34ffc4684445586b8c0311cced22b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:41.719206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1137/2261] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:33:41 2022] DELETE /identity/v3/users/7ca34ffc4684445586b8c0311cced22b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:33:42.008243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f315b90-f281-4e5d-bae7-9cba37ae1f22 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:42.010906 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2f315b90-f281-4e5d-bae7-9cba37ae1f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:42.034376 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f315b90-f281-4e5d-bae7-9cba37ae1f22 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:42.110498 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b447359-bf41-48b4-acf4-ae88128741b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:42.111130 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b447359-bf41-48b4-acf4-ae88128741b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:42.111405 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b447359-bf41-48b4-acf4-ae88128741b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:42.111741 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b447359-bf41-48b4-acf4-ae88128741b6 admin admin] PATH_INFO: `/v3/projects/3418600b48534da3bf46f6afb9b0bae9` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:42.112918 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b447359-bf41-48b4-acf4-ae88128741b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3418600b48534da3bf46f6afb9b0bae9)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:42.115134 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b447359-bf41-48b4-acf4-ae88128741b6 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:42.172020 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2b447359-bf41-48b4-acf4-ae88128741b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3418600b48534da3bf46f6afb9b0bae9', 'request_id': 'req-2b447359-bf41-48b4-acf4-ae88128741b6'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:42.180811 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2b447359-bf41-48b4-acf4-ae88128741b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3418600b48534da3bf46f6afb9b0bae9', 'request_id': 'req-2b447359-bf41-48b4-acf4-ae88128741b6'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:42.195506 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2b447359-bf41-48b4-acf4-ae88128741b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3418600b48534da3bf46f6afb9b0bae9', 'request_id': 'req-2b447359-bf41-48b4-acf4-ae88128741b6'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:42.208771 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2b447359-bf41-48b4-acf4-ae88128741b6 admin admin] The token cache is being invalidate because project 3418600b48534da3bf46f6afb9b0bae9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:33:42.209153 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2b447359-bf41-48b4-acf4-ae88128741b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:42.209897 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2b447359-bf41-48b4-acf4-ae88128741b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:42.211520 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1125/2262] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:33:42 2022] DELETE /identity/v3/projects/3418600b48534da3bf46f6afb9b0bae9 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:33:42.218718 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18da50-13ab-419c-83f2-f6885cc7cd07 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:42.219182 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18da50-13ab-419c-83f2-f6885cc7cd07 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:42.219649 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18da50-13ab-419c-83f2-f6885cc7cd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:42.241583 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-2d18da50-13ab-419c-83f2-f6885cc7cd07 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:33:42.242897 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2d18da50-13ab-419c-83f2-f6885cc7cd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:42.311976 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1138/2263] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:33:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:33:42.322957 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96451210-d4f3-4e68-a01a-085e335fa7f9 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:42.323241 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96451210-d4f3-4e68-a01a-085e335fa7f9 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:42.323525 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96451210-d4f3-4e68-a01a-085e335fa7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:42.346429 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-96451210-d4f3-4e68-a01a-085e335fa7f9 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:33:42.348296 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-96451210-d4f3-4e68-a01a-085e335fa7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:42.357017 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1126/2264] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:33:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:33:42.361512 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18da50-13ab-419c-83f2-f6885cc7cd07 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:42.374077 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18da50-13ab-419c-83f2-f6885cc7cd07 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:42.379680 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301eee76-8a36-4bb9-85a2-5593a391b4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:42.380627 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301eee76-8a36-4bb9-85a2-5593a391b4d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:42.380906 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301eee76-8a36-4bb9-85a2-5593a391b4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:42.381175 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301eee76-8a36-4bb9-85a2-5593a391b4d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:42.381823 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301eee76-8a36-4bb9-85a2-5593a391b4d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:33:42.382123 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301eee76-8a36-4bb9-85a2-5593a391b4d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:42.383720 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301eee76-8a36-4bb9-85a2-5593a391b4d0 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:42.396622 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1139/2265] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:33:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:33:42.401489 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96451210-d4f3-4e68-a01a-085e335fa7f9 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:42.413571 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96451210-d4f3-4e68-a01a-085e335fa7f9 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:42.420030 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a7010-7037-4daf-bb13-ec9b16efe8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:42.420631 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a7010-7037-4daf-bb13-ec9b16efe8e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:42.421219 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a7010-7037-4daf-bb13-ec9b16efe8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:42.421489 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a7010-7037-4daf-bb13-ec9b16efe8e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:42.422804 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a7010-7037-4daf-bb13-ec9b16efe8e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:42.424186 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a7010-7037-4daf-bb13-ec9b16efe8e2 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:42.454467 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1127/2266] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:33:42 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:33:42.459547 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301eee76-8a36-4bb9-85a2-5593a391b4d0 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:42.469846 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301eee76-8a36-4bb9-85a2-5593a391b4d0 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:42.500876 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:33:42.538396 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703aa07-ddfa-4b4e-90db-30d4cdffd383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:42.538994 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703aa07-ddfa-4b4e-90db-30d4cdffd383 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:42.539271 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703aa07-ddfa-4b4e-90db-30d4cdffd383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:42.539543 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703aa07-ddfa-4b4e-90db-30d4cdffd383 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:42.540217 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703aa07-ddfa-4b4e-90db-30d4cdffd383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:42.542911 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703aa07-ddfa-4b4e-90db-30d4cdffd383 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:42.571152 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1140/2267] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:33:42 2022] POST /identity/v3/users => generated 283 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:33:42.572399 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a7010-7037-4daf-bb13-ec9b16efe8e2 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:42.583032 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a7010-7037-4daf-bb13-ec9b16efe8e2 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:42.587798 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bacee5-337b-44fb-9125-c89c1bcf0016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:42.588421 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bacee5-337b-44fb-9125-c89c1bcf0016 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:42.588696 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bacee5-337b-44fb-9125-c89c1bcf0016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:42.588963 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bacee5-337b-44fb-9125-c89c1bcf0016 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:42.589596 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bacee5-337b-44fb-9125-c89c1bcf0016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:42.591917 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bacee5-337b-44fb-9125-c89c1bcf0016 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:42.603037 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1128/2268] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:33:42.607260 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703aa07-ddfa-4b4e-90db-30d4cdffd383 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:42.619010 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703aa07-ddfa-4b4e-90db-30d4cdffd383 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:42.624760 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ebc50-52c4-4a2f-9fb4-7015c8fec44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:42.625382 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ebc50-52c4-4a2f-9fb4-7015c8fec44b admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:42.625853 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ebc50-52c4-4a2f-9fb4-7015c8fec44b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:42.626141 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ebc50-52c4-4a2f-9fb4-7015c8fec44b admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:42.626789 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ebc50-52c4-4a2f-9fb4-7015c8fec44b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:42.628421 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ebc50-52c4-4a2f-9fb4-7015c8fec44b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:42.645127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1141/2269] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:33:42.650122 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bacee5-337b-44fb-9125-c89c1bcf0016 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:42.657205 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:33:42.660934 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bacee5-337b-44fb-9125-c89c1bcf0016 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:42.667032 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37318fb-b866-4029-b3a3-3f3f004b945b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:42.667809 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37318fb-b866-4029-b3a3-3f3f004b945b admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:42.668383 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37318fb-b866-4029-b3a3-3f3f004b945b admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:42.668648 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37318fb-b866-4029-b3a3-3f3f004b945b admin admin] PATH_INFO: `/v3/projects/afc39ed61dee4b2d83137c23a0eb8c91/users/289602705eb04b30b4c4c99338336cdc/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:42.686742 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37318fb-b866-4029-b3a3-3f3f004b945b admin admin] RBAC: Authorizing `identity:create_grant(project_id=afc39ed61dee4b2d83137c23a0eb8c91, user_id=289602705eb04b30b4c4c99338336cdc, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:42.689467 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37318fb-b866-4029-b3a3-3f3f004b945b admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:42.705131 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1129/2270] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:33:42 2022] PUT /identity/v3/projects/afc39ed61dee4b2d83137c23a0eb8c91/users/289602705eb04b30b4c4c99338336cdc/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:33:42.719270 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c5066-70c9-47e3-a208-b6940f452934 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:42.719583 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c5066-70c9-47e3-a208-b6940f452934 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:42.719862 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c5066-70c9-47e3-a208-b6940f452934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:42.754355 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-743c5066-70c9-47e3-a208-b6940f452934 None None] MFA Rules not processed for user `289602705eb04b30b4c4c99338336cdc`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:33:42.756079 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-743c5066-70c9-47e3-a208-b6940f452934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:42.823613 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1142/2271] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:33:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:33:42.828132 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37318fb-b866-4029-b3a3-3f3f004b945b admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:42.889060 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37318fb-b866-4029-b3a3-3f3f004b945b admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:42.893619 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7f736-3eb4-46de-a3d1-3481e883ccab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:42.894207 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7f736-3eb4-46de-a3d1-3481e883ccab admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:42.894470 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7f736-3eb4-46de-a3d1-3481e883ccab admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:42.894734 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7f736-3eb4-46de-a3d1-3481e883ccab admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:42.895347 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a7f736-3eb4-46de-a3d1-3481e883ccab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:42.897243 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a7f736-3eb4-46de-a3d1-3481e883ccab admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:42.923407 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1130/2272] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:33:42 2022] POST /identity/v3/projects => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:33:42.927943 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c5066-70c9-47e3-a208-b6940f452934 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:42.938571 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c5066-70c9-47e3-a208-b6940f452934 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:42.996748 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857273d-25f1-42ab-bde2-6ecded4bc842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:42.997355 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857273d-25f1-42ab-bde2-6ecded4bc842 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:42.997635 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857273d-25f1-42ab-bde2-6ecded4bc842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:42.997909 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857273d-25f1-42ab-bde2-6ecded4bc842 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:42.998544 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857273d-25f1-42ab-bde2-6ecded4bc842 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:43.000572 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857273d-25f1-42ab-bde2-6ecded4bc842 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:43.024206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1143/2273] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:33:42 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:33:43.028236 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7f736-3eb4-46de-a3d1-3481e883ccab admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:43.038986 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7f736-3eb4-46de-a3d1-3481e883ccab admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:43.043590 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d43a5f-4d1d-4a91-a723-d7cde7cf2dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:43.044213 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d43a5f-4d1d-4a91-a723-d7cde7cf2dff admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:43.044492 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d43a5f-4d1d-4a91-a723-d7cde7cf2dff admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:43.044762 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d43a5f-4d1d-4a91-a723-d7cde7cf2dff admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:43.045390 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d43a5f-4d1d-4a91-a723-d7cde7cf2dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:43.047230 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d43a5f-4d1d-4a91-a723-d7cde7cf2dff admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:43.058431 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1131/2274] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:33:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:33:43.062527 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857273d-25f1-42ab-bde2-6ecded4bc842 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:43.072729 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857273d-25f1-42ab-bde2-6ecded4bc842 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:43.077329 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf7e3c-6c4e-4d82-8583-b8455951e921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:43.077972 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf7e3c-6c4e-4d82-8583-b8455951e921 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:43.078254 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf7e3c-6c4e-4d82-8583-b8455951e921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:43.078534 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf7e3c-6c4e-4d82-8583-b8455951e921 admin admin] PATH_INFO: `/v3/projects/fcc755c158954d89aaa96dfd5fce6d2d/users/809dfc40bdac4ac08da1b0455e8ffb0d/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:43.093722 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf7e3c-6c4e-4d82-8583-b8455951e921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcc755c158954d89aaa96dfd5fce6d2d, user_id=809dfc40bdac4ac08da1b0455e8ffb0d, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:43.096411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf7e3c-6c4e-4d82-8583-b8455951e921 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:43.109852 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1144/2275] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:33:43 2022] PUT /identity/v3/projects/fcc755c158954d89aaa96dfd5fce6d2d/users/809dfc40bdac4ac08da1b0455e8ffb0d/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:33:43.114885 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d43a5f-4d1d-4a91-a723-d7cde7cf2dff admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:43.124834 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d43a5f-4d1d-4a91-a723-d7cde7cf2dff admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:43.181028 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29dca16-8eb4-4354-9032-d92678902e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:43.181697 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29dca16-8eb4-4354-9032-d92678902e35 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:43.181975 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29dca16-8eb4-4354-9032-d92678902e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:43.182245 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29dca16-8eb4-4354-9032-d92678902e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:43.182917 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29dca16-8eb4-4354-9032-d92678902e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:43.184580 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29dca16-8eb4-4354-9032-d92678902e35 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:43.194849 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1132/2276] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:33:43 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:33:43.198915 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf7e3c-6c4e-4d82-8583-b8455951e921 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:43.204300 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:33:43.210910 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf7e3c-6c4e-4d82-8583-b8455951e921 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:43.216194 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb125038-aa1e-425b-84fb-1ffce1a721ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:43.216850 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb125038-aa1e-425b-84fb-1ffce1a721ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:43.217153 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb125038-aa1e-425b-84fb-1ffce1a721ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:43.217424 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb125038-aa1e-425b-84fb-1ffce1a721ab admin admin] PATH_INFO: `/v3/projects/fcc755c158954d89aaa96dfd5fce6d2d/users/809dfc40bdac4ac08da1b0455e8ffb0d/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:43.219325 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb125038-aa1e-425b-84fb-1ffce1a721ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcc755c158954d89aaa96dfd5fce6d2d, user_id=809dfc40bdac4ac08da1b0455e8ffb0d, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:43.221963 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb125038-aa1e-425b-84fb-1ffce1a721ab admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:43.233602 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1145/2277] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:33:43 2022] PUT /identity/v3/projects/fcc755c158954d89aaa96dfd5fce6d2d/users/809dfc40bdac4ac08da1b0455e8ffb0d/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:33:43.245293 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577451d5-0eee-465c-9810-c2c1c8f6ecbc None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:43.245662 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577451d5-0eee-465c-9810-c2c1c8f6ecbc None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:43.246009 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577451d5-0eee-465c-9810-c2c1c8f6ecbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:43.275071 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-577451d5-0eee-465c-9810-c2c1c8f6ecbc None None] MFA Rules not processed for user `809dfc40bdac4ac08da1b0455e8ffb0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:33:43.276303 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-577451d5-0eee-465c-9810-c2c1c8f6ecbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:43.318629 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:33:43.351172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1133/2278] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:33:43 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:33:43.363218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb125038-aa1e-425b-84fb-1ffce1a721ab admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:43.365049 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cb125038-aa1e-425b-84fb-1ffce1a721ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:43.429504 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb125038-aa1e-425b-84fb-1ffce1a721ab admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:43.433905 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195ceb4-87c8-4ffc-9fec-ea9e66c0d8d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:43.434569 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195ceb4-87c8-4ffc-9fec-ea9e66c0d8d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:43.434919 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195ceb4-87c8-4ffc-9fec-ea9e66c0d8d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:43.435303 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195ceb4-87c8-4ffc-9fec-ea9e66c0d8d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:43.446931 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195ceb4-87c8-4ffc-9fec-ea9e66c0d8d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:43.448692 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195ceb4-87c8-4ffc-9fec-ea9e66c0d8d3 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:43.460047 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1146/2279] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:33:43 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:33:43.554885 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577451d5-0eee-465c-9810-c2c1c8f6ecbc None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:43.565479 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577451d5-0eee-465c-9810-c2c1c8f6ecbc None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:43.569250 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56159ccc-750d-473a-bd3f-7911c375ef5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:43.569879 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56159ccc-750d-473a-bd3f-7911c375ef5a service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:43.570160 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56159ccc-750d-473a-bd3f-7911c375ef5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:43.570435 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56159ccc-750d-473a-bd3f-7911c375ef5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:43.637672 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56159ccc-750d-473a-bd3f-7911c375ef5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:43.639099 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56159ccc-750d-473a-bd3f-7911c375ef5a service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:43.648495 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1134/2280] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:33:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 13:33:48.518694 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195ceb4-87c8-4ffc-9fec-ea9e66c0d8d3 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:48.583919 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195ceb4-87c8-4ffc-9fec-ea9e66c0d8d3 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:48.588499 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a707d61-55fc-4b9e-bb4e-d77553741b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:48.589127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a707d61-55fc-4b9e-bb4e-d77553741b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:48.589407 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a707d61-55fc-4b9e-bb4e-d77553741b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:48.589681 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a707d61-55fc-4b9e-bb4e-d77553741b5e admin admin] PATH_INFO: `/v3/users/289602705eb04b30b4c4c99338336cdc` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:48.590797 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a707d61-55fc-4b9e-bb4e-d77553741b5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=289602705eb04b30b4c4c99338336cdc)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:48.592756 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a707d61-55fc-4b9e-bb4e-d77553741b5e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:48.657031 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9a707d61-55fc-4b9e-bb4e-d77553741b5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '289602705eb04b30b4c4c99338336cdc'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:48.657690 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9a707d61-55fc-4b9e-bb4e-d77553741b5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '289602705eb04b30b4c4c99338336cdc'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:48.670094 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9a707d61-55fc-4b9e-bb4e-d77553741b5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '289602705eb04b30b4c4c99338336cdc'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:48.679818 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9a707d61-55fc-4b9e-bb4e-d77553741b5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '289602705eb04b30b4c4c99338336cdc'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:48.687190 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9a707d61-55fc-4b9e-bb4e-d77553741b5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '289602705eb04b30b4c4c99338336cdc'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:48.693797 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1147/2281] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:33:48 2022] DELETE /identity/v3/users/289602705eb04b30b4c4c99338336cdc => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:33:48.698194 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d629a2-b65c-425d-a25c-dc710f8c4092 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:48.698654 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d629a2-b65c-425d-a25c-dc710f8c4092 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:48.698780 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d629a2-b65c-425d-a25c-dc710f8c4092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:48.720757 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-18d629a2-b65c-425d-a25c-dc710f8c4092 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:33:48.722533 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-18d629a2-b65c-425d-a25c-dc710f8c4092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:48.786713 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1135/2282] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:33:48.796898 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a707d61-55fc-4b9e-bb4e-d77553741b5e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:48.798587 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9a707d61-55fc-4b9e-bb4e-d77553741b5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:48.813194 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:33:48.861247 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a707d61-55fc-4b9e-bb4e-d77553741b5e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:48.865000 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52680017-0d3d-430d-8368-3cb1a2cae9fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:48.865608 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52680017-0d3d-430d-8368-3cb1a2cae9fe service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:48.865890 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52680017-0d3d-430d-8368-3cb1a2cae9fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:48.866162 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52680017-0d3d-430d-8368-3cb1a2cae9fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:48.875320 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52680017-0d3d-430d-8368-3cb1a2cae9fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:48.876789 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52680017-0d3d-430d-8368-3cb1a2cae9fe service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:48.886272 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1148/2283] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:33:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:33:49.174279 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d629a2-b65c-425d-a25c-dc710f8c4092 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:49.176564 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-18d629a2-b65c-425d-a25c-dc710f8c4092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:49.201119 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d629a2-b65c-425d-a25c-dc710f8c4092 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:49.214734 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d86ac-d32d-4664-977c-4712999b2ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:49.215363 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d86ac-d32d-4664-977c-4712999b2ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:49.215780 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d86ac-d32d-4664-977c-4712999b2ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:49.216084 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d86ac-d32d-4664-977c-4712999b2ad6 admin admin] PATH_INFO: `/v3/projects/afc39ed61dee4b2d83137c23a0eb8c91` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:49.217195 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d86ac-d32d-4664-977c-4712999b2ad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afc39ed61dee4b2d83137c23a0eb8c91)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:49.219312 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d86ac-d32d-4664-977c-4712999b2ad6 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:49.267031 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-938d86ac-d32d-4664-977c-4712999b2ad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afc39ed61dee4b2d83137c23a0eb8c91', 'request_id': 'req-938d86ac-d32d-4664-977c-4712999b2ad6'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:49.273190 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-938d86ac-d32d-4664-977c-4712999b2ad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afc39ed61dee4b2d83137c23a0eb8c91', 'request_id': 'req-938d86ac-d32d-4664-977c-4712999b2ad6'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:49.280484 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-938d86ac-d32d-4664-977c-4712999b2ad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afc39ed61dee4b2d83137c23a0eb8c91', 'request_id': 'req-938d86ac-d32d-4664-977c-4712999b2ad6'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:49.287189 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:33:49.292743 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-938d86ac-d32d-4664-977c-4712999b2ad6 admin admin] The token cache is being invalidate because project afc39ed61dee4b2d83137c23a0eb8c91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:33:49.293131 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-938d86ac-d32d-4664-977c-4712999b2ad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:49.293954 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-938d86ac-d32d-4664-977c-4712999b2ad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:49.296494 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1136/2284] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:33:49 2022] DELETE /identity/v3/projects/afc39ed61dee4b2d83137c23a0eb8c91 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:33:49.302252 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52680017-0d3d-430d-8368-3cb1a2cae9fe service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:49.312780 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52680017-0d3d-430d-8368-3cb1a2cae9fe service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:49.372514 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a4cf5-c042-49f7-9e49-a3ae9682ede8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:49.373145 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a4cf5-c042-49f7-9e49-a3ae9682ede8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:49.373426 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a4cf5-c042-49f7-9e49-a3ae9682ede8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:49.373709 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a4cf5-c042-49f7-9e49-a3ae9682ede8 admin admin] PATH_INFO: `/v3/users/809dfc40bdac4ac08da1b0455e8ffb0d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:49.374841 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61a4cf5-c042-49f7-9e49-a3ae9682ede8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=809dfc40bdac4ac08da1b0455e8ffb0d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:49.376780 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61a4cf5-c042-49f7-9e49-a3ae9682ede8 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:49.423484 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d61a4cf5-c042-49f7-9e49-a3ae9682ede8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '809dfc40bdac4ac08da1b0455e8ffb0d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:49.424181 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d61a4cf5-c042-49f7-9e49-a3ae9682ede8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '809dfc40bdac4ac08da1b0455e8ffb0d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:49.437218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d61a4cf5-c042-49f7-9e49-a3ae9682ede8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '809dfc40bdac4ac08da1b0455e8ffb0d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:49.445961 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d61a4cf5-c042-49f7-9e49-a3ae9682ede8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '809dfc40bdac4ac08da1b0455e8ffb0d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:49.453551 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d61a4cf5-c042-49f7-9e49-a3ae9682ede8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '809dfc40bdac4ac08da1b0455e8ffb0d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:49.462053 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1149/2285] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:33:49 2022] DELETE /identity/v3/users/809dfc40bdac4ac08da1b0455e8ffb0d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:33:49.743102 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d86ac-d32d-4664-977c-4712999b2ad6 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:49.744623 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-938d86ac-d32d-4664-977c-4712999b2ad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:49.758414 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d86ac-d32d-4664-977c-4712999b2ad6 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:49.814842 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c548c77-ff07-42a4-b176-4c1ee78a11fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:49.815392 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c548c77-ff07-42a4-b176-4c1ee78a11fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:49.815680 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c548c77-ff07-42a4-b176-4c1ee78a11fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:49.816612 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c548c77-ff07-42a4-b176-4c1ee78a11fe admin admin] PATH_INFO: `/v3/projects/fcc755c158954d89aaa96dfd5fce6d2d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:49.818039 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c548c77-ff07-42a4-b176-4c1ee78a11fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcc755c158954d89aaa96dfd5fce6d2d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:49.819951 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c548c77-ff07-42a4-b176-4c1ee78a11fe admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:49.865409 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1c548c77-ff07-42a4-b176-4c1ee78a11fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcc755c158954d89aaa96dfd5fce6d2d', 'request_id': 'req-1c548c77-ff07-42a4-b176-4c1ee78a11fe'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:49.871550 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1c548c77-ff07-42a4-b176-4c1ee78a11fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcc755c158954d89aaa96dfd5fce6d2d', 'request_id': 'req-1c548c77-ff07-42a4-b176-4c1ee78a11fe'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:49.879308 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1c548c77-ff07-42a4-b176-4c1ee78a11fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcc755c158954d89aaa96dfd5fce6d2d', 'request_id': 'req-1c548c77-ff07-42a4-b176-4c1ee78a11fe'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:49.890091 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1c548c77-ff07-42a4-b176-4c1ee78a11fe admin admin] The token cache is being invalidate because project fcc755c158954d89aaa96dfd5fce6d2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:33:49.890381 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1c548c77-ff07-42a4-b176-4c1ee78a11fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:49.891022 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1c548c77-ff07-42a4-b176-4c1ee78a11fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:49.892526 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1137/2286] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:33:49 2022] DELETE /identity/v3/projects/fcc755c158954d89aaa96dfd5fce6d2d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:33:49.898059 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d38b4-3892-4089-a8db-b98873441161 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:49.898664 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d38b4-3892-4089-a8db-b98873441161 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:49.898664 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d38b4-3892-4089-a8db-b98873441161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:49.918363 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e16d38b4-3892-4089-a8db-b98873441161 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:33:49.919547 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e16d38b4-3892-4089-a8db-b98873441161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:49.949924 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:33:49.981914 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1150/2287] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:33:49.989966 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a2e7e-89bd-45b3-9111-876d22d0ae9f None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:49.990256 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a2e7e-89bd-45b3-9111-876d22d0ae9f None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:49.990535 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a2e7e-89bd-45b3-9111-876d22d0ae9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:50.010208 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-689a2e7e-89bd-45b3-9111-876d22d0ae9f None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:33:50.011404 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-689a2e7e-89bd-45b3-9111-876d22d0ae9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:50.019849 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1138/2288] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:33:50.023874 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d38b4-3892-4089-a8db-b98873441161 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:50.033366 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d38b4-3892-4089-a8db-b98873441161 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:50.038080 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b1827-d717-4d2a-8e55-f9b1a6f97fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:50.038707 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b1827-d717-4d2a-8e55-f9b1a6f97fbc admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:50.038991 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b1827-d717-4d2a-8e55-f9b1a6f97fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:50.039268 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b1827-d717-4d2a-8e55-f9b1a6f97fbc admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:50.039916 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b1827-d717-4d2a-8e55-f9b1a6f97fbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:33:50.040259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b1827-d717-4d2a-8e55-f9b1a6f97fbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:50.041844 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b1827-d717-4d2a-8e55-f9b1a6f97fbc admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:50.053977 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1151/2289] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:33:50.058297 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a2e7e-89bd-45b3-9111-876d22d0ae9f None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:50.067428 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a2e7e-89bd-45b3-9111-876d22d0ae9f None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:50.071922 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a258bd-6598-4d9c-9fa8-99598f964977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:50.072504 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a258bd-6598-4d9c-9fa8-99598f964977 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:50.072781 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a258bd-6598-4d9c-9fa8-99598f964977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:50.073049 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a258bd-6598-4d9c-9fa8-99598f964977 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:50.073670 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a258bd-6598-4d9c-9fa8-99598f964977 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:50.075540 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a258bd-6598-4d9c-9fa8-99598f964977 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:50.104145 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1139/2290] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:33:50 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:33:50.108242 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b1827-d717-4d2a-8e55-f9b1a6f97fbc admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:50.118297 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b1827-d717-4d2a-8e55-f9b1a6f97fbc admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:50.175140 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b88a0-d2d3-454e-8c59-26cf19d8514d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:50.175881 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b88a0-d2d3-454e-8c59-26cf19d8514d admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:50.176192 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b88a0-d2d3-454e-8c59-26cf19d8514d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:50.176467 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b88a0-d2d3-454e-8c59-26cf19d8514d admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:50.177110 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b88a0-d2d3-454e-8c59-26cf19d8514d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:50.179016 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b88a0-d2d3-454e-8c59-26cf19d8514d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:50.200452 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1152/2291] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:33:50 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:33:50.204483 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a258bd-6598-4d9c-9fa8-99598f964977 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:50.215132 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a258bd-6598-4d9c-9fa8-99598f964977 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:50.220134 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5ac98-4890-44ed-b1a4-8ddabd4101c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:50.220293 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5ac98-4890-44ed-b1a4-8ddabd4101c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:50.220505 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5ac98-4890-44ed-b1a4-8ddabd4101c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:50.220777 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5ac98-4890-44ed-b1a4-8ddabd4101c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:50.221404 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5ac98-4890-44ed-b1a4-8ddabd4101c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:50.223062 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5ac98-4890-44ed-b1a4-8ddabd4101c7 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:50.233404 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1140/2292] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:33:50.237441 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b88a0-d2d3-454e-8c59-26cf19d8514d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:50.249016 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b88a0-d2d3-454e-8c59-26cf19d8514d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:50.254233 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e317fd-c385-4b5d-b9a2-adcf163dd50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:50.255469 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e317fd-c385-4b5d-b9a2-adcf163dd50b admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:50.255664 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e317fd-c385-4b5d-b9a2-adcf163dd50b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:50.256105 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e317fd-c385-4b5d-b9a2-adcf163dd50b admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:50.256624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e317fd-c385-4b5d-b9a2-adcf163dd50b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:50.258198 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e317fd-c385-4b5d-b9a2-adcf163dd50b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:50.270346 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1153/2293] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:33:50.278914 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5ac98-4890-44ed-b1a4-8ddabd4101c7 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:50.287296 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5ac98-4890-44ed-b1a4-8ddabd4101c7 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:50.292302 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0d319-745c-4fe1-b794-d60edd2aa8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:50.292949 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0d319-745c-4fe1-b794-d60edd2aa8fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:50.293227 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0d319-745c-4fe1-b794-d60edd2aa8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:50.293500 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0d319-745c-4fe1-b794-d60edd2aa8fe admin admin] PATH_INFO: `/v3/projects/86b37b0d6ab64f9aad5d41dcab94abd5/users/3dc742c46a1a44a192323f3d8e16b9e4/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:50.311546 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0d319-745c-4fe1-b794-d60edd2aa8fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=86b37b0d6ab64f9aad5d41dcab94abd5, user_id=3dc742c46a1a44a192323f3d8e16b9e4, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:50.315301 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0d319-745c-4fe1-b794-d60edd2aa8fe admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:50.330090 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1141/2294] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:33:50 2022] PUT /identity/v3/projects/86b37b0d6ab64f9aad5d41dcab94abd5/users/3dc742c46a1a44a192323f3d8e16b9e4/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:33:50.342593 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f11c01-bfa8-4bb3-ba36-faa9781f11b3 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:50.342880 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f11c01-bfa8-4bb3-ba36-faa9781f11b3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:50.343157 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f11c01-bfa8-4bb3-ba36-faa9781f11b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:50.373097 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a4f11c01-bfa8-4bb3-ba36-faa9781f11b3 None None] MFA Rules not processed for user `3dc742c46a1a44a192323f3d8e16b9e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:33:50.374867 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a4f11c01-bfa8-4bb3-ba36-faa9781f11b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:50.450511 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1154/2295] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:33:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:33:50.455044 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0d319-745c-4fe1-b794-d60edd2aa8fe admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:50.482639 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:33:50.518611 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0d319-745c-4fe1-b794-d60edd2aa8fe admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:50.524183 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbdee31-fda5-442e-b008-f4f3c7d94b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:50.524838 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbdee31-fda5-442e-b008-f4f3c7d94b6d admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:50.525118 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbdee31-fda5-442e-b008-f4f3c7d94b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:50.525395 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbdee31-fda5-442e-b008-f4f3c7d94b6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:50.526032 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbdee31-fda5-442e-b008-f4f3c7d94b6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:50.528071 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbdee31-fda5-442e-b008-f4f3c7d94b6d admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:50.556158 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1142/2296] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:33:50 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:33:50.560237 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f11c01-bfa8-4bb3-ba36-faa9781f11b3 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:50.571545 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f11c01-bfa8-4bb3-ba36-faa9781f11b3 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:50.599059 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:33:50.632578 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de14772b-8b52-4f25-8e30-6f74a2f87c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:50.633190 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14772b-8b52-4f25-8e30-6f74a2f87c23 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:50.633499 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14772b-8b52-4f25-8e30-6f74a2f87c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:50.633773 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14772b-8b52-4f25-8e30-6f74a2f87c23 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:50.634406 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de14772b-8b52-4f25-8e30-6f74a2f87c23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:50.636377 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de14772b-8b52-4f25-8e30-6f74a2f87c23 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:50.657469 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1155/2297] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:33:50 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:33:50.661519 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbdee31-fda5-442e-b008-f4f3c7d94b6d admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:50.674493 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbdee31-fda5-442e-b008-f4f3c7d94b6d admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:50.679121 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73d1d1-f9f7-40d0-930e-ccfb2cae5a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:50.679718 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73d1d1-f9f7-40d0-930e-ccfb2cae5a65 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:50.680091 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73d1d1-f9f7-40d0-930e-ccfb2cae5a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:50.680402 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73d1d1-f9f7-40d0-930e-ccfb2cae5a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:50.681207 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc73d1d1-f9f7-40d0-930e-ccfb2cae5a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:50.683138 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc73d1d1-f9f7-40d0-930e-ccfb2cae5a65 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:50.694897 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1143/2298] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:33:50.698838 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de14772b-8b52-4f25-8e30-6f74a2f87c23 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:50.709489 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de14772b-8b52-4f25-8e30-6f74a2f87c23 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:50.714070 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618e51b-f069-44d2-8c5c-ddbc32813123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:50.714686 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618e51b-f069-44d2-8c5c-ddbc32813123 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:50.714968 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618e51b-f069-44d2-8c5c-ddbc32813123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:50.715245 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618e51b-f069-44d2-8c5c-ddbc32813123 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:50.715939 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a618e51b-f069-44d2-8c5c-ddbc32813123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:50.717545 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a618e51b-f069-44d2-8c5c-ddbc32813123 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:50.727948 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1156/2299] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:33:50.731983 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73d1d1-f9f7-40d0-930e-ccfb2cae5a65 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:50.741992 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73d1d1-f9f7-40d0-930e-ccfb2cae5a65 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:50.746504 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed1209-b9d2-4fd1-bbb8-3082df4bc1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:50.747118 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed1209-b9d2-4fd1-bbb8-3082df4bc1a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:50.747398 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed1209-b9d2-4fd1-bbb8-3082df4bc1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:50.747667 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed1209-b9d2-4fd1-bbb8-3082df4bc1a0 admin admin] PATH_INFO: `/v3/projects/2bcce8b7b35a4403bb114094f388f55c/users/c169de6acce842058c726bef9aa40e44/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:50.762867 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed1209-b9d2-4fd1-bbb8-3082df4bc1a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bcce8b7b35a4403bb114094f388f55c, user_id=c169de6acce842058c726bef9aa40e44, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:50.765556 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed1209-b9d2-4fd1-bbb8-3082df4bc1a0 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:50.778985 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1144/2300] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:33:50 2022] PUT /identity/v3/projects/2bcce8b7b35a4403bb114094f388f55c/users/c169de6acce842058c726bef9aa40e44/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:33:50.789443 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f2d48-e170-436e-a844-03d9e6ac8bfb None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:50.789734 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f2d48-e170-436e-a844-03d9e6ac8bfb None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:50.790089 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f2d48-e170-436e-a844-03d9e6ac8bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:50.818861 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c56f2d48-e170-436e-a844-03d9e6ac8bfb None None] MFA Rules not processed for user `c169de6acce842058c726bef9aa40e44`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:33:50.820103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c56f2d48-e170-436e-a844-03d9e6ac8bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:50.888889 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1157/2301] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:33:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:33:50.893363 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed1209-b9d2-4fd1-bbb8-3082df4bc1a0 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:50.954414 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed1209-b9d2-4fd1-bbb8-3082df4bc1a0 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:50.959538 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c4588-89cc-425f-8530-0a5cdc5dd694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:50.960153 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c4588-89cc-425f-8530-0a5cdc5dd694 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:50.960429 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c4588-89cc-425f-8530-0a5cdc5dd694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:50.960698 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c4588-89cc-425f-8530-0a5cdc5dd694 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:50.961308 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c4588-89cc-425f-8530-0a5cdc5dd694 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:50.963182 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c4588-89cc-425f-8530-0a5cdc5dd694 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:50.989611 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1145/2302] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:33:50 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:33:50.993650 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f2d48-e170-436e-a844-03d9e6ac8bfb None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:51.004690 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f2d48-e170-436e-a844-03d9e6ac8bfb None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:51.060150 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c691045-adc3-4f38-aef0-f5b1e1a25223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:51.060758 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c691045-adc3-4f38-aef0-f5b1e1a25223 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:51.061039 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c691045-adc3-4f38-aef0-f5b1e1a25223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:51.061316 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c691045-adc3-4f38-aef0-f5b1e1a25223 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:51.061949 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c691045-adc3-4f38-aef0-f5b1e1a25223 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:51.063865 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c691045-adc3-4f38-aef0-f5b1e1a25223 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:51.085213 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1158/2303] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:33:50 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:33:51.089151 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c4588-89cc-425f-8530-0a5cdc5dd694 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:51.099922 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c4588-89cc-425f-8530-0a5cdc5dd694 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:51.104503 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352f432-8304-4ceb-9f83-f6b4dbfb4ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:51.105091 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352f432-8304-4ceb-9f83-f6b4dbfb4ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:51.105377 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352f432-8304-4ceb-9f83-f6b4dbfb4ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:51.105653 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352f432-8304-4ceb-9f83-f6b4dbfb4ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:51.106287 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1352f432-8304-4ceb-9f83-f6b4dbfb4ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:51.107869 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1352f432-8304-4ceb-9f83-f6b4dbfb4ee7 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:51.118497 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1146/2304] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:33:51.122420 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c691045-adc3-4f38-aef0-f5b1e1a25223 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:51.132391 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c691045-adc3-4f38-aef0-f5b1e1a25223 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:51.137016 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98817c58-27ae-4d89-918c-c182d6b95d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:51.137662 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98817c58-27ae-4d89-918c-c182d6b95d83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:51.137943 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98817c58-27ae-4d89-918c-c182d6b95d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:51.138218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98817c58-27ae-4d89-918c-c182d6b95d83 admin admin] PATH_INFO: `/v3/projects/acbe2b235ea0401cac5347d70e5fb260/users/d4638c1a140a40f08fdb6b2c5e859f2f/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:51.153738 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98817c58-27ae-4d89-918c-c182d6b95d83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acbe2b235ea0401cac5347d70e5fb260, user_id=d4638c1a140a40f08fdb6b2c5e859f2f, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:51.156398 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98817c58-27ae-4d89-918c-c182d6b95d83 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:51.169730 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1159/2305] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:33:51 2022] PUT /identity/v3/projects/acbe2b235ea0401cac5347d70e5fb260/users/d4638c1a140a40f08fdb6b2c5e859f2f/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:33:51.173835 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352f432-8304-4ceb-9f83-f6b4dbfb4ee7 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:51.183780 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352f432-8304-4ceb-9f83-f6b4dbfb4ee7 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:51.228473 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:33:51.241154 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743cec91-1a11-411d-b21f-619b352e2750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:51.241753 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cec91-1a11-411d-b21f-619b352e2750 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:51.242032 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cec91-1a11-411d-b21f-619b352e2750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:51.242306 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cec91-1a11-411d-b21f-619b352e2750 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:51.242931 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743cec91-1a11-411d-b21f-619b352e2750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:51.244544 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743cec91-1a11-411d-b21f-619b352e2750 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:51.254598 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1147/2306] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:33:51.258963 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98817c58-27ae-4d89-918c-c182d6b95d83 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:51.264336 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:33:51.271439 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98817c58-27ae-4d89-918c-c182d6b95d83 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:51.276219 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e68546-8e03-4776-89f2-3d7030112895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:51.276860 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e68546-8e03-4776-89f2-3d7030112895 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:51.277137 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e68546-8e03-4776-89f2-3d7030112895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:51.277694 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e68546-8e03-4776-89f2-3d7030112895 admin admin] PATH_INFO: `/v3/projects/acbe2b235ea0401cac5347d70e5fb260/users/d4638c1a140a40f08fdb6b2c5e859f2f/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:51.279583 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e68546-8e03-4776-89f2-3d7030112895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acbe2b235ea0401cac5347d70e5fb260, user_id=d4638c1a140a40f08fdb6b2c5e859f2f, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:51.282229 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e68546-8e03-4776-89f2-3d7030112895 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:51.292138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1160/2307] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:33:51 2022] PUT /identity/v3/projects/acbe2b235ea0401cac5347d70e5fb260/users/d4638c1a140a40f08fdb6b2c5e859f2f/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:33:51.303113 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316bde3-e6a3-47aa-92c0-dd198151ab34 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:51.303113 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316bde3-e6a3-47aa-92c0-dd198151ab34 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:51.303387 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316bde3-e6a3-47aa-92c0-dd198151ab34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:51.332475 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-6316bde3-e6a3-47aa-92c0-dd198151ab34 None None] MFA Rules not processed for user `d4638c1a140a40f08fdb6b2c5e859f2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:33:51.333822 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-6316bde3-e6a3-47aa-92c0-dd198151ab34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:51.400856 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1148/2308] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:33:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:33:51.412269 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e68546-8e03-4776-89f2-3d7030112895 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:51.413978 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e7e68546-8e03-4776-89f2-3d7030112895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:51.475330 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e68546-8e03-4776-89f2-3d7030112895 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:51.479510 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eedf791-6ff2-4bff-8e83-946902b271b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:51.480232 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eedf791-6ff2-4bff-8e83-946902b271b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:51.480579 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eedf791-6ff2-4bff-8e83-946902b271b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:51.480921 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eedf791-6ff2-4bff-8e83-946902b271b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:51.548335 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eedf791-6ff2-4bff-8e83-946902b271b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:51.550893 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eedf791-6ff2-4bff-8e83-946902b271b7 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:51.560006 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1161/2309] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:33:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:33:52.824323 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316bde3-e6a3-47aa-92c0-dd198151ab34 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:52.825716 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-6316bde3-e6a3-47aa-92c0-dd198151ab34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:52.881936 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316bde3-e6a3-47aa-92c0-dd198151ab34 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:52.885458 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f0d39-810e-4468-8176-cce3b4f2297f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:52.886056 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f0d39-810e-4468-8176-cce3b4f2297f service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:52.886335 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f0d39-810e-4468-8176-cce3b4f2297f service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:52.886914 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f0d39-810e-4468-8176-cce3b4f2297f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:52.888315 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b62f0d39-810e-4468-8176-cce3b4f2297f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:52.954435 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f0d39-810e-4468-8176-cce3b4f2297f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:52.955883 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f0d39-810e-4468-8176-cce3b4f2297f service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:52.965555 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1149/2310] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:33:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:33:53.093211 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eedf791-6ff2-4bff-8e83-946902b271b7 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:53.102045 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eedf791-6ff2-4bff-8e83-946902b271b7 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:53.105851 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9d458-b5ba-4132-a601-78e64c5cf3f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:53.106557 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9d458-b5ba-4132-a601-78e64c5cf3f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:53.106898 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9d458-b5ba-4132-a601-78e64c5cf3f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:53.107238 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9d458-b5ba-4132-a601-78e64c5cf3f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:53.166365 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d9d458-b5ba-4132-a601-78e64c5cf3f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:53.167795 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d9d458-b5ba-4132-a601-78e64c5cf3f7 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:53.178248 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1162/2311] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:33:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:33:53.730441 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f0d39-810e-4468-8176-cce3b4f2297f service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:53.740314 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f0d39-810e-4468-8176-cce3b4f2297f service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:53.743857 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12745644-84cd-4c6c-a615-01e93438d439 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:53.744483 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12745644-84cd-4c6c-a615-01e93438d439 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:53.744762 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12745644-84cd-4c6c-a615-01e93438d439 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:53.745036 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12745644-84cd-4c6c-a615-01e93438d439 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:53.754066 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12745644-84cd-4c6c-a615-01e93438d439 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:53.755595 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12745644-84cd-4c6c-a615-01e93438d439 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:53.767763 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1150/2312] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:33:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:33:56.007972 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9d458-b5ba-4132-a601-78e64c5cf3f7 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:56.009533 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-70d9d458-b5ba-4132-a601-78e64c5cf3f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:56.024906 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9d458-b5ba-4132-a601-78e64c5cf3f7 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:56.029593 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c660d1-6cd9-4e86-8cef-035f28b49c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:56.030305 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c660d1-6cd9-4e86-8cef-035f28b49c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:56.030655 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c660d1-6cd9-4e86-8cef-035f28b49c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:56.031000 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c660d1-6cd9-4e86-8cef-035f28b49c32 admin admin] PATH_INFO: `/v3/users/b45585ee97774a5fa704eac9e992adcb` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:56.032788 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c660d1-6cd9-4e86-8cef-035f28b49c32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b45585ee97774a5fa704eac9e992adcb)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:56.037576 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c660d1-6cd9-4e86-8cef-035f28b49c32 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:56.075650 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:33:56.086461 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d6c660d1-6cd9-4e86-8cef-035f28b49c32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b45585ee97774a5fa704eac9e992adcb'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:56.087333 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d6c660d1-6cd9-4e86-8cef-035f28b49c32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b45585ee97774a5fa704eac9e992adcb'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:56.100234 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d6c660d1-6cd9-4e86-8cef-035f28b49c32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b45585ee97774a5fa704eac9e992adcb'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:56.107170 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d6c660d1-6cd9-4e86-8cef-035f28b49c32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b45585ee97774a5fa704eac9e992adcb'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:56.114790 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d6c660d1-6cd9-4e86-8cef-035f28b49c32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b45585ee97774a5fa704eac9e992adcb'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:56.120626 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1163/2313] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:33:56 2022] DELETE /identity/v3/users/b45585ee97774a5fa704eac9e992adcb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:33:56.299297 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12745644-84cd-4c6c-a615-01e93438d439 service cinder] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:56.319443 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12745644-84cd-4c6c-a615-01e93438d439 service cinder] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:56.337650 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:33:56.409404 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222fb5a-7ae5-4697-b36b-037559e157bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:56.410107 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222fb5a-7ae5-4697-b36b-037559e157bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:56.410490 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222fb5a-7ae5-4697-b36b-037559e157bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:56.410762 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222fb5a-7ae5-4697-b36b-037559e157bf admin admin] PATH_INFO: `/v3/projects/134aa379644b45898097564584a883a6` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:56.412145 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222fb5a-7ae5-4697-b36b-037559e157bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=134aa379644b45898097564584a883a6)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:56.414714 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222fb5a-7ae5-4697-b36b-037559e157bf admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:56.490832 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b222fb5a-7ae5-4697-b36b-037559e157bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '134aa379644b45898097564584a883a6', 'request_id': 'req-b222fb5a-7ae5-4697-b36b-037559e157bf'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:56.498184 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b222fb5a-7ae5-4697-b36b-037559e157bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '134aa379644b45898097564584a883a6', 'request_id': 'req-b222fb5a-7ae5-4697-b36b-037559e157bf'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:56.507294 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b222fb5a-7ae5-4697-b36b-037559e157bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '134aa379644b45898097564584a883a6', 'request_id': 'req-b222fb5a-7ae5-4697-b36b-037559e157bf'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:56.518386 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b222fb5a-7ae5-4697-b36b-037559e157bf admin admin] The token cache is being invalidate because project 134aa379644b45898097564584a883a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:33:56.518672 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b222fb5a-7ae5-4697-b36b-037559e157bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:56.520431 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b222fb5a-7ae5-4697-b36b-037559e157bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:56.521895 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1151/2314] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:33:56 2022] DELETE /identity/v3/projects/134aa379644b45898097564584a883a6 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:33:56.530699 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacaa4f-e7e9-4a37-81aa-da504e0d74db None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:56.530986 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacaa4f-e7e9-4a37-81aa-da504e0d74db None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:56.531264 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacaa4f-e7e9-4a37-81aa-da504e0d74db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:56.552433 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-ebacaa4f-e7e9-4a37-81aa-da504e0d74db None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:33:56.553648 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ebacaa4f-e7e9-4a37-81aa-da504e0d74db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:56.618812 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1164/2315] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:33:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:33:56.626405 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b9eed-ba80-4c26-a6e3-a8baafc69024 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:56.626760 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b9eed-ba80-4c26-a6e3-a8baafc69024 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:56.627193 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b9eed-ba80-4c26-a6e3-a8baafc69024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:56.651121 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-646b9eed-ba80-4c26-a6e3-a8baafc69024 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:33:56.652360 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-646b9eed-ba80-4c26-a6e3-a8baafc69024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:56.660449 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1152/2316] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:33:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:33:56.664949 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebacaa4f-e7e9-4a37-81aa-da504e0d74db None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:56.674657 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebacaa4f-e7e9-4a37-81aa-da504e0d74db None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:56.679679 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1421cc4b-9924-4a95-9965-cc7c3fa67ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:56.680299 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421cc4b-9924-4a95-9965-cc7c3fa67ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:56.680580 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421cc4b-9924-4a95-9965-cc7c3fa67ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:56.680851 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421cc4b-9924-4a95-9965-cc7c3fa67ed5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:56.681503 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1421cc4b-9924-4a95-9965-cc7c3fa67ed5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:33:56.681802 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1421cc4b-9924-4a95-9965-cc7c3fa67ed5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:56.683375 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1421cc4b-9924-4a95-9965-cc7c3fa67ed5 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:56.695173 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1165/2317] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:33:56.699558 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b9eed-ba80-4c26-a6e3-a8baafc69024 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:56.709467 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b9eed-ba80-4c26-a6e3-a8baafc69024 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:56.714168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86422562-d25e-479b-b103-bafaf88f1164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:56.714761 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86422562-d25e-479b-b103-bafaf88f1164 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:56.715043 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86422562-d25e-479b-b103-bafaf88f1164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:56.715316 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86422562-d25e-479b-b103-bafaf88f1164 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:56.715984 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86422562-d25e-479b-b103-bafaf88f1164 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:56.717884 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86422562-d25e-479b-b103-bafaf88f1164 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:56.746652 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1153/2318] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:33:56 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:33:56.751074 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1421cc4b-9924-4a95-9965-cc7c3fa67ed5 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:56.762689 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1421cc4b-9924-4a95-9965-cc7c3fa67ed5 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:56.822829 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cbd736-c08e-4dfc-a4df-4298f07b23ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:56.823426 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbd736-c08e-4dfc-a4df-4298f07b23ed admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:56.823702 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbd736-c08e-4dfc-a4df-4298f07b23ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:56.824011 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbd736-c08e-4dfc-a4df-4298f07b23ed admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:56.824636 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cbd736-c08e-4dfc-a4df-4298f07b23ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:56.826552 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cbd736-c08e-4dfc-a4df-4298f07b23ed admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:56.849957 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1166/2319] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:33:56 2022] POST /identity/v3/users => generated 303 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:33:56.853774 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86422562-d25e-479b-b103-bafaf88f1164 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:56.865884 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86422562-d25e-479b-b103-bafaf88f1164 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:56.870586 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b4abb-61c4-49de-a1e4-5ff239316858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:56.871177 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b4abb-61c4-49de-a1e4-5ff239316858 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:56.871455 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b4abb-61c4-49de-a1e4-5ff239316858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:56.871726 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b4abb-61c4-49de-a1e4-5ff239316858 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:56.872433 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b4abb-61c4-49de-a1e4-5ff239316858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:56.874063 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b4abb-61c4-49de-a1e4-5ff239316858 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:56.884366 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1154/2320] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:33:56.888462 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cbd736-c08e-4dfc-a4df-4298f07b23ed admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:56.899364 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cbd736-c08e-4dfc-a4df-4298f07b23ed admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:56.904010 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa6c44-7dbd-488d-be73-ddda16df141c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:56.904597 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa6c44-7dbd-488d-be73-ddda16df141c admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:56.904870 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa6c44-7dbd-488d-be73-ddda16df141c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:56.905138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa6c44-7dbd-488d-be73-ddda16df141c admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:56.905797 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa6c44-7dbd-488d-be73-ddda16df141c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:56.907428 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa6c44-7dbd-488d-be73-ddda16df141c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:56.918912 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1167/2321] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:33:56.923353 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b4abb-61c4-49de-a1e4-5ff239316858 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:56.933385 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b4abb-61c4-49de-a1e4-5ff239316858 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:56.938209 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e46911-0b4a-48fe-9da3-432a6a2a21bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:56.938847 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e46911-0b4a-48fe-9da3-432a6a2a21bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:56.939129 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e46911-0b4a-48fe-9da3-432a6a2a21bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:56.939400 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e46911-0b4a-48fe-9da3-432a6a2a21bf admin admin] PATH_INFO: `/v3/projects/cf864c955b30411aa4e9797d84df3012/users/f1439cbb367646d980ff52a1e7aa573f/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:56.954187 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e46911-0b4a-48fe-9da3-432a6a2a21bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf864c955b30411aa4e9797d84df3012, user_id=f1439cbb367646d980ff52a1e7aa573f, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:56.957505 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e46911-0b4a-48fe-9da3-432a6a2a21bf admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:56.970524 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1155/2322] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:33:56 2022] PUT /identity/v3/projects/cf864c955b30411aa4e9797d84df3012/users/f1439cbb367646d980ff52a1e7aa573f/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:33:56.981600 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c986fe7-8209-4dc4-aa97-4cf0ef04977e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:56.981827 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c986fe7-8209-4dc4-aa97-4cf0ef04977e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:56.982129 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c986fe7-8209-4dc4-aa97-4cf0ef04977e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:57.010058 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-3c986fe7-8209-4dc4-aa97-4cf0ef04977e None None] MFA Rules not processed for user `f1439cbb367646d980ff52a1e7aa573f`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:33:57.011245 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3c986fe7-8209-4dc4-aa97-4cf0ef04977e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:57.019742 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:33:57.077211 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1168/2323] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:33:56 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:33:57.082235 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e46911-0b4a-48fe-9da3-432a6a2a21bf admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:57.116566 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:33:57.145608 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e46911-0b4a-48fe-9da3-432a6a2a21bf admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:57.150248 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df184e-e234-4dfe-bded-ac394f6ed6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:57.150850 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df184e-e234-4dfe-bded-ac394f6ed6ca admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:57.151132 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df184e-e234-4dfe-bded-ac394f6ed6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:57.151405 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df184e-e234-4dfe-bded-ac394f6ed6ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:57.152072 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df184e-e234-4dfe-bded-ac394f6ed6ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:57.153964 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df184e-e234-4dfe-bded-ac394f6ed6ca admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:57.180645 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1156/2324] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:33:57 2022] POST /identity/v3/projects => generated 403 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:33:57.184640 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c986fe7-8209-4dc4-aa97-4cf0ef04977e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:57.195691 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c986fe7-8209-4dc4-aa97-4cf0ef04977e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:57.249926 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa0994-d81c-4c4b-9502-abeba1e3886e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:57.250452 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa0994-d81c-4c4b-9502-abeba1e3886e admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:57.250730 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa0994-d81c-4c4b-9502-abeba1e3886e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:57.251000 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa0994-d81c-4c4b-9502-abeba1e3886e admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:57.251624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa0994-d81c-4c4b-9502-abeba1e3886e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:57.254134 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa0994-d81c-4c4b-9502-abeba1e3886e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:57.275075 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1169/2325] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:33:57 2022] POST /identity/v3/users => generated 308 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:33:57.279105 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df184e-e234-4dfe-bded-ac394f6ed6ca admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:57.293642 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df184e-e234-4dfe-bded-ac394f6ed6ca admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:57.298669 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa98a17-5c30-430a-b728-fb8910005d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:57.299341 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa98a17-5c30-430a-b728-fb8910005d87 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:57.299857 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa98a17-5c30-430a-b728-fb8910005d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:57.299857 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa98a17-5c30-430a-b728-fb8910005d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:57.300814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa98a17-5c30-430a-b728-fb8910005d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:57.302589 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa98a17-5c30-430a-b728-fb8910005d87 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:57.313389 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1157/2326] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:33:57.318100 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa0994-d81c-4c4b-9502-abeba1e3886e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:57.327778 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa0994-d81c-4c4b-9502-abeba1e3886e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:57.333255 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33c3f6-4df7-4c66-8583-e18e8d4d6545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:57.334059 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33c3f6-4df7-4c66-8583-e18e8d4d6545 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:57.334341 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33c3f6-4df7-4c66-8583-e18e8d4d6545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:57.334614 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33c3f6-4df7-4c66-8583-e18e8d4d6545 admin admin] PATH_INFO: `/v3/projects/9275929c70094deab47568f2763cece1/users/d95565c210514488919ea58b1a04442b/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:57.349374 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a33c3f6-4df7-4c66-8583-e18e8d4d6545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9275929c70094deab47568f2763cece1, user_id=d95565c210514488919ea58b1a04442b, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:57.352051 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a33c3f6-4df7-4c66-8583-e18e8d4d6545 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:57.364700 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1170/2327] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:33:57 2022] PUT /identity/v3/projects/9275929c70094deab47568f2763cece1/users/d95565c210514488919ea58b1a04442b/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:33:57.368757 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa98a17-5c30-430a-b728-fb8910005d87 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:57.379407 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa98a17-5c30-430a-b728-fb8910005d87 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:57.436272 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb0a42-0e1c-4074-8d60-911d2405d23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:57.436877 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb0a42-0e1c-4074-8d60-911d2405d23a admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:57.437157 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb0a42-0e1c-4074-8d60-911d2405d23a admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:57.437431 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb0a42-0e1c-4074-8d60-911d2405d23a admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:57.438064 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb0a42-0e1c-4074-8d60-911d2405d23a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:57.439650 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb0a42-0e1c-4074-8d60-911d2405d23a admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:57.450042 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1158/2328] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:33:57.454374 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33c3f6-4df7-4c66-8583-e18e8d4d6545 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:57.465383 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33c3f6-4df7-4c66-8583-e18e8d4d6545 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:57.470086 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd021a17-ab7b-4ab9-bae4-d1918bd4321b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:57.470742 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd021a17-ab7b-4ab9-bae4-d1918bd4321b admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:57.471022 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd021a17-ab7b-4ab9-bae4-d1918bd4321b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:57.471298 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd021a17-ab7b-4ab9-bae4-d1918bd4321b admin admin] PATH_INFO: `/v3/projects/9275929c70094deab47568f2763cece1/users/d95565c210514488919ea58b1a04442b/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:57.473491 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd021a17-ab7b-4ab9-bae4-d1918bd4321b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9275929c70094deab47568f2763cece1, user_id=d95565c210514488919ea58b1a04442b, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:57.476207 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd021a17-ab7b-4ab9-bae4-d1918bd4321b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:57.486353 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1171/2329] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:33:57 2022] PUT /identity/v3/projects/9275929c70094deab47568f2763cece1/users/d95565c210514488919ea58b1a04442b/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:33:57.497893 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87898e-2a78-4fe5-bea4-42bb3d24ddba None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:57.498181 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87898e-2a78-4fe5-bea4-42bb3d24ddba None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:57.498461 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87898e-2a78-4fe5-bea4-42bb3d24ddba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:57.527062 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-fb87898e-2a78-4fe5-bea4-42bb3d24ddba None None] MFA Rules not processed for user `d95565c210514488919ea58b1a04442b`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:33:57.528234 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-fb87898e-2a78-4fe5-bea4-42bb3d24ddba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:57.599530 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1159/2330] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:33:57 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:33:57.610192 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd021a17-ab7b-4ab9-bae4-d1918bd4321b admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:57.611888 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fd021a17-ab7b-4ab9-bae4-d1918bd4321b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:57.670160 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd021a17-ab7b-4ab9-bae4-d1918bd4321b admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:57.674089 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56912a-e484-4ea6-b78d-3abd8d668310 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:57.674700 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56912a-e484-4ea6-b78d-3abd8d668310 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:57.674981 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56912a-e484-4ea6-b78d-3abd8d668310 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:57.675254 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56912a-e484-4ea6-b78d-3abd8d668310 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:57.685682 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec56912a-e484-4ea6-b78d-3abd8d668310 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:57.687847 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec56912a-e484-4ea6-b78d-3abd8d668310 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:57.697991 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1172/2331] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:33:57 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:33:57.739108 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87898e-2a78-4fe5-bea4-42bb3d24ddba None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:57.740534 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-fb87898e-2a78-4fe5-bea4-42bb3d24ddba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:57.774407 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:33:57.810515 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87898e-2a78-4fe5-bea4-42bb3d24ddba None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:57.815206 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa3390-aa12-45fc-ba8c-eca979e56ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:57.815828 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa3390-aa12-45fc-ba8c-eca979e56ff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:57.816321 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa3390-aa12-45fc-ba8c-eca979e56ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:57.816596 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa3390-aa12-45fc-ba8c-eca979e56ff8 admin admin] PATH_INFO: `/v3/users/3dc742c46a1a44a192323f3d8e16b9e4` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:57.817777 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa3390-aa12-45fc-ba8c-eca979e56ff8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dc742c46a1a44a192323f3d8e16b9e4)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:57.819687 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa3390-aa12-45fc-ba8c-eca979e56ff8 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:57.850120 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56912a-e484-4ea6-b78d-3abd8d668310 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:57.857032 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:33:57.861578 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56912a-e484-4ea6-b78d-3abd8d668310 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:57.868105 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a781e7f-e7ab-479a-b651-c912a57529db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:57.868735 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a781e7f-e7ab-479a-b651-c912a57529db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:57.869020 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a781e7f-e7ab-479a-b651-c912a57529db admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:57.869323 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a781e7f-e7ab-479a-b651-c912a57529db admin admin] PATH_INFO: `/v3/users/f1439cbb367646d980ff52a1e7aa573f` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:57.870750 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a781e7f-e7ab-479a-b651-c912a57529db admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1439cbb367646d980ff52a1e7aa573f)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:57.871500 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2caa3390-aa12-45fc-ba8c-eca979e56ff8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dc742c46a1a44a192323f3d8e16b9e4'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:57.872817 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a781e7f-e7ab-479a-b651-c912a57529db admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:57.883443 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2caa3390-aa12-45fc-ba8c-eca979e56ff8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dc742c46a1a44a192323f3d8e16b9e4'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:57.884217 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2caa3390-aa12-45fc-ba8c-eca979e56ff8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dc742c46a1a44a192323f3d8e16b9e4'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:57.892558 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2caa3390-aa12-45fc-ba8c-eca979e56ff8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dc742c46a1a44a192323f3d8e16b9e4'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:57.893231 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2caa3390-aa12-45fc-ba8c-eca979e56ff8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dc742c46a1a44a192323f3d8e16b9e4'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:57.915719 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1160/2332] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:33:57 2022] DELETE /identity/v3/users/3dc742c46a1a44a192323f3d8e16b9e4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:33:57.917318 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ec667-5672-4bfd-a797-2dd40544f4af None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:57.917640 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ec667-5672-4bfd-a797-2dd40544f4af None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:57.917920 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ec667-5672-4bfd-a797-2dd40544f4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:57.935264 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9a781e7f-e7ab-479a-b651-c912a57529db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1439cbb367646d980ff52a1e7aa573f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:57.935950 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9a781e7f-e7ab-479a-b651-c912a57529db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1439cbb367646d980ff52a1e7aa573f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:57.941673 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-414ec667-5672-4bfd-a797-2dd40544f4af None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:33:57.943012 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-414ec667-5672-4bfd-a797-2dd40544f4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:57.949413 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9a781e7f-e7ab-479a-b651-c912a57529db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1439cbb367646d980ff52a1e7aa573f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:57.957777 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9a781e7f-e7ab-479a-b651-c912a57529db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1439cbb367646d980ff52a1e7aa573f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:57.964970 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9a781e7f-e7ab-479a-b651-c912a57529db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1439cbb367646d980ff52a1e7aa573f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:57.971311 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1173/2333] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:33:57 2022] DELETE /identity/v3/users/f1439cbb367646d980ff52a1e7aa573f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:33:57.976363 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db4885-8965-4428-84ad-5ba50aaadc36 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:57.976648 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db4885-8965-4428-84ad-5ba50aaadc36 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:57.976921 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db4885-8965-4428-84ad-5ba50aaadc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:57.995446 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e9db4885-8965-4428-84ad-5ba50aaadc36 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:33:57.996682 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e9db4885-8965-4428-84ad-5ba50aaadc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:58.005881 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1161/2334] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:33:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:33:58.015491 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ec667-5672-4bfd-a797-2dd40544f4af None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:58.016843 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-414ec667-5672-4bfd-a797-2dd40544f4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:58.061257 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1174/2335] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:33:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:33:58.071647 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db4885-8965-4428-84ad-5ba50aaadc36 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:58.074599 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:33:58.079255 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ec667-5672-4bfd-a797-2dd40544f4af None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:58.125914 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db4885-8965-4428-84ad-5ba50aaadc36 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:58.130644 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff42e2d-4ff7-427e-a7b1-72f5b484eaf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:58.131244 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff42e2d-4ff7-427e-a7b1-72f5b484eaf8 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:58.131353 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96af774-6ff2-4f3a-a207-f69abdab5b2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:58.131522 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff42e2d-4ff7-427e-a7b1-72f5b484eaf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:58.131795 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff42e2d-4ff7-427e-a7b1-72f5b484eaf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:58.131917 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96af774-6ff2-4f3a-a207-f69abdab5b2f service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:58.132141 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96af774-6ff2-4f3a-a207-f69abdab5b2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:58.132525 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96af774-6ff2-4f3a-a207-f69abdab5b2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:58.140975 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff42e2d-4ff7-427e-a7b1-72f5b484eaf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:58.142345 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96af774-6ff2-4f3a-a207-f69abdab5b2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:58.142469 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff42e2d-4ff7-427e-a7b1-72f5b484eaf8 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:58.143845 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96af774-6ff2-4f3a-a207-f69abdab5b2f service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:58.152519 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1175/2336] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:33:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 13:33:58.153872 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1162/2337] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:33:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 13:33:58.609474 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff42e2d-4ff7-427e-a7b1-72f5b484eaf8 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:58.611042 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8ff42e2d-4ff7-427e-a7b1-72f5b484eaf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:58.615923 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96af774-6ff2-4f3a-a207-f69abdab5b2f service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:58.617437 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a96af774-6ff2-4f3a-a207-f69abdab5b2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:58.629496 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff42e2d-4ff7-427e-a7b1-72f5b484eaf8 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:58.635523 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0fada6-dd5a-4c92-890e-cb56dd6404b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:58.636431 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fada6-dd5a-4c92-890e-cb56dd6404b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:58.636885 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fada6-dd5a-4c92-890e-cb56dd6404b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:58.637316 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fada6-dd5a-4c92-890e-cb56dd6404b1 admin admin] PATH_INFO: `/v3/projects/cf864c955b30411aa4e9797d84df3012` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:58.638625 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0fada6-dd5a-4c92-890e-cb56dd6404b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf864c955b30411aa4e9797d84df3012)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:58.640722 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0fada6-dd5a-4c92-890e-cb56dd6404b1 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:58.653658 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96af774-6ff2-4f3a-a207-f69abdab5b2f service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:58.657571 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:33:58.663007 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d89bf2-b1ee-4c76-ab19-ebc471f1de49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:58.663656 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d89bf2-b1ee-4c76-ab19-ebc471f1de49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:58.663966 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d89bf2-b1ee-4c76-ab19-ebc471f1de49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:58.664245 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d89bf2-b1ee-4c76-ab19-ebc471f1de49 admin admin] PATH_INFO: `/v3/projects/86b37b0d6ab64f9aad5d41dcab94abd5` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:58.665396 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d89bf2-b1ee-4c76-ab19-ebc471f1de49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86b37b0d6ab64f9aad5d41dcab94abd5)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:58.667387 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d89bf2-b1ee-4c76-ab19-ebc471f1de49 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:58.694345 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-fc0fada6-dd5a-4c92-890e-cb56dd6404b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf864c955b30411aa4e9797d84df3012', 'request_id': 'req-fc0fada6-dd5a-4c92-890e-cb56dd6404b1'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:58.702844 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-fc0fada6-dd5a-4c92-890e-cb56dd6404b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf864c955b30411aa4e9797d84df3012', 'request_id': 'req-fc0fada6-dd5a-4c92-890e-cb56dd6404b1'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:58.708704 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-fc0fada6-dd5a-4c92-890e-cb56dd6404b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf864c955b30411aa4e9797d84df3012', 'request_id': 'req-fc0fada6-dd5a-4c92-890e-cb56dd6404b1'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:58.725160 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-fc0fada6-dd5a-4c92-890e-cb56dd6404b1 admin admin] The token cache is being invalidate because project cf864c955b30411aa4e9797d84df3012 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:33:58.725388 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-fc0fada6-dd5a-4c92-890e-cb56dd6404b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:58.725920 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-fc0fada6-dd5a-4c92-890e-cb56dd6404b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:58.727763 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1176/2338] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:33:58 2022] DELETE /identity/v3/projects/cf864c955b30411aa4e9797d84df3012 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:33:58.730773 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-36d89bf2-b1ee-4c76-ab19-ebc471f1de49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86b37b0d6ab64f9aad5d41dcab94abd5', 'request_id': 'req-36d89bf2-b1ee-4c76-ab19-ebc471f1de49'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:58.731502 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0fada6-dd5a-4c92-890e-cb56dd6404b1 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:58.733406 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fc0fada6-dd5a-4c92-890e-cb56dd6404b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:58.739143 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-36d89bf2-b1ee-4c76-ab19-ebc471f1de49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86b37b0d6ab64f9aad5d41dcab94abd5', 'request_id': 'req-36d89bf2-b1ee-4c76-ab19-ebc471f1de49'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:58.747171 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-36d89bf2-b1ee-4c76-ab19-ebc471f1de49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86b37b0d6ab64f9aad5d41dcab94abd5', 'request_id': 'req-36d89bf2-b1ee-4c76-ab19-ebc471f1de49'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:58.758876 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-36d89bf2-b1ee-4c76-ab19-ebc471f1de49 admin admin] The token cache is being invalidate because project 86b37b0d6ab64f9aad5d41dcab94abd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:33:58.759166 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-36d89bf2-b1ee-4c76-ab19-ebc471f1de49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:58.765247 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-36d89bf2-b1ee-4c76-ab19-ebc471f1de49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:58.766814 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1163/2339] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:33:58 2022] DELETE /identity/v3/projects/86b37b0d6ab64f9aad5d41dcab94abd5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:33:58.772083 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d89bf2-b1ee-4c76-ab19-ebc471f1de49 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:58.774169 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-36d89bf2-b1ee-4c76-ab19-ebc471f1de49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:58.806665 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0fada6-dd5a-4c92-890e-cb56dd6404b1 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:58.839307 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d89bf2-b1ee-4c76-ab19-ebc471f1de49 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:58.844442 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d9b94-ff2e-45b3-a1e0-4b35d5db8a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:58.845066 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d9b94-ff2e-45b3-a1e0-4b35d5db8a1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:58.845348 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d9b94-ff2e-45b3-a1e0-4b35d5db8a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:58.845809 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d9b94-ff2e-45b3-a1e0-4b35d5db8a1c admin admin] PATH_INFO: `/v3/users/c169de6acce842058c726bef9aa40e44` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:58.846975 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d9b94-ff2e-45b3-a1e0-4b35d5db8a1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c169de6acce842058c726bef9aa40e44)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:58.849555 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d9b94-ff2e-45b3-a1e0-4b35d5db8a1c admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:58.865166 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78b6e0-09b3-4f81-ab4e-1005418d5a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:58.865727 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78b6e0-09b3-4f81-ab4e-1005418d5a5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:58.866016 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78b6e0-09b3-4f81-ab4e-1005418d5a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:58.866311 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78b6e0-09b3-4f81-ab4e-1005418d5a5c admin admin] PATH_INFO: `/v3/users/d95565c210514488919ea58b1a04442b` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:58.867441 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78b6e0-09b3-4f81-ab4e-1005418d5a5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d95565c210514488919ea58b1a04442b)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:58.869391 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78b6e0-09b3-4f81-ab4e-1005418d5a5c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:58.886086 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:33:58.902245 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3f8d9b94-ff2e-45b3-a1e0-4b35d5db8a1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c169de6acce842058c726bef9aa40e44'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:58.915927 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3f8d9b94-ff2e-45b3-a1e0-4b35d5db8a1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c169de6acce842058c726bef9aa40e44'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:58.916691 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3f8d9b94-ff2e-45b3-a1e0-4b35d5db8a1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c169de6acce842058c726bef9aa40e44'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:58.920456 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0c78b6e0-09b3-4f81-ab4e-1005418d5a5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd95565c210514488919ea58b1a04442b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:58.921515 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0c78b6e0-09b3-4f81-ab4e-1005418d5a5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd95565c210514488919ea58b1a04442b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:58.924929 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3f8d9b94-ff2e-45b3-a1e0-4b35d5db8a1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c169de6acce842058c726bef9aa40e44'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:58.925689 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3f8d9b94-ff2e-45b3-a1e0-4b35d5db8a1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c169de6acce842058c726bef9aa40e44'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:58.927527 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:33:58.938259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0c78b6e0-09b3-4f81-ab4e-1005418d5a5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd95565c210514488919ea58b1a04442b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:58.939766 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1164/2340] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:33:58 2022] DELETE /identity/v3/users/c169de6acce842058c726bef9aa40e44 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:33:58.950581 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0c78b6e0-09b3-4f81-ab4e-1005418d5a5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd95565c210514488919ea58b1a04442b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:58.958966 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0c78b6e0-09b3-4f81-ab4e-1005418d5a5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd95565c210514488919ea58b1a04442b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:58.966251 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1177/2341] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:33:58 2022] DELETE /identity/v3/users/d95565c210514488919ea58b1a04442b => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:33:59.237427 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d9b94-ff2e-45b3-a1e0-4b35d5db8a1c admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:59.240467 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-3f8d9b94-ff2e-45b3-a1e0-4b35d5db8a1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:59.257596 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78b6e0-09b3-4f81-ab4e-1005418d5a5c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:59.259123 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0c78b6e0-09b3-4f81-ab4e-1005418d5a5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:59.317589 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d9b94-ff2e-45b3-a1e0-4b35d5db8a1c admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:59.334451 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78b6e0-09b3-4f81-ab4e-1005418d5a5c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:59.339572 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b492fc-66b7-4951-bd7b-b54e4e1440f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:59.340386 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b492fc-66b7-4951-bd7b-b54e4e1440f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:59.340646 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b492fc-66b7-4951-bd7b-b54e4e1440f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:59.341020 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b492fc-66b7-4951-bd7b-b54e4e1440f1 admin admin] PATH_INFO: `/v3/projects/9275929c70094deab47568f2763cece1` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:59.342225 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b492fc-66b7-4951-bd7b-b54e4e1440f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9275929c70094deab47568f2763cece1)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:59.344223 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b492fc-66b7-4951-bd7b-b54e4e1440f1 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:59.376555 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0a530-1206-4806-8a51-2912b1da697e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:59.377109 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0a530-1206-4806-8a51-2912b1da697e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:59.377381 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0a530-1206-4806-8a51-2912b1da697e admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:59.377650 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0a530-1206-4806-8a51-2912b1da697e admin admin] PATH_INFO: `/v3/projects/2bcce8b7b35a4403bb114094f388f55c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:59.379328 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0a530-1206-4806-8a51-2912b1da697e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bcce8b7b35a4403bb114094f388f55c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:59.381261 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0a530-1206-4806-8a51-2912b1da697e admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:59.393027 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-49b492fc-66b7-4951-bd7b-b54e4e1440f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9275929c70094deab47568f2763cece1', 'request_id': 'req-49b492fc-66b7-4951-bd7b-b54e4e1440f1'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:59.401135 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-49b492fc-66b7-4951-bd7b-b54e4e1440f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9275929c70094deab47568f2763cece1', 'request_id': 'req-49b492fc-66b7-4951-bd7b-b54e4e1440f1'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:59.407124 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-49b492fc-66b7-4951-bd7b-b54e4e1440f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9275929c70094deab47568f2763cece1', 'request_id': 'req-49b492fc-66b7-4951-bd7b-b54e4e1440f1'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:59.419871 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-49b492fc-66b7-4951-bd7b-b54e4e1440f1 admin admin] The token cache is being invalidate because project 9275929c70094deab47568f2763cece1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:33:59.420195 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-49b492fc-66b7-4951-bd7b-b54e4e1440f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:59.420889 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-49b492fc-66b7-4951-bd7b-b54e4e1440f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:59.424101 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1178/2342] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:33:59 2022] DELETE /identity/v3/projects/9275929c70094deab47568f2763cece1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:33:59.431031 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-51b0a530-1206-4806-8a51-2912b1da697e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bcce8b7b35a4403bb114094f388f55c', 'request_id': 'req-51b0a530-1206-4806-8a51-2912b1da697e'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:59.431266 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596cfbf9-138b-4644-8522-4653b74081e8 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:59.431598 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596cfbf9-138b-4644-8522-4653b74081e8 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:59.432001 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596cfbf9-138b-4644-8522-4653b74081e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:59.438100 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-51b0a530-1206-4806-8a51-2912b1da697e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bcce8b7b35a4403bb114094f388f55c', 'request_id': 'req-51b0a530-1206-4806-8a51-2912b1da697e'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:59.442856 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:33:59.447710 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-51b0a530-1206-4806-8a51-2912b1da697e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bcce8b7b35a4403bb114094f388f55c', 'request_id': 'req-51b0a530-1206-4806-8a51-2912b1da697e'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:59.454020 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-596cfbf9-138b-4644-8522-4653b74081e8 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:33:59.455243 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-596cfbf9-138b-4644-8522-4653b74081e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:59.461903 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-51b0a530-1206-4806-8a51-2912b1da697e admin admin] The token cache is being invalidate because project 2bcce8b7b35a4403bb114094f388f55c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:33:59.462196 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-51b0a530-1206-4806-8a51-2912b1da697e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:59.462835 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-51b0a530-1206-4806-8a51-2912b1da697e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:59.464440 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1165/2343] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:33:59 2022] DELETE /identity/v3/projects/2bcce8b7b35a4403bb114094f388f55c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:33:59.468407 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0a530-1206-4806-8a51-2912b1da697e admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:59.469717 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-51b0a530-1206-4806-8a51-2912b1da697e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:59.513009 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:33:59.528036 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1179/2344] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:33:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:33:59.531098 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693cb0d-6fca-4c8c-ba23-8c35210dcaca None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:59.531403 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693cb0d-6fca-4c8c-ba23-8c35210dcaca None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:59.531679 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693cb0d-6fca-4c8c-ba23-8c35210dcaca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:59.537017 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0a530-1206-4806-8a51-2912b1da697e admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:59.541822 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550dcc15-3212-4e73-9bc9-a3408ddf327d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:59.542440 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550dcc15-3212-4e73-9bc9-a3408ddf327d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:59.542726 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550dcc15-3212-4e73-9bc9-a3408ddf327d admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:59.543025 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550dcc15-3212-4e73-9bc9-a3408ddf327d admin admin] PATH_INFO: `/v3/users/d4638c1a140a40f08fdb6b2c5e859f2f` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:59.544195 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550dcc15-3212-4e73-9bc9-a3408ddf327d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4638c1a140a40f08fdb6b2c5e859f2f)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:59.546122 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550dcc15-3212-4e73-9bc9-a3408ddf327d admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:59.559875 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-7693cb0d-6fca-4c8c-ba23-8c35210dcaca None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:33:59.561105 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7693cb0d-6fca-4c8c-ba23-8c35210dcaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:59.570127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1180/2345] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:33:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:33:59.574456 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693cb0d-6fca-4c8c-ba23-8c35210dcaca None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:59.585608 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693cb0d-6fca-4c8c-ba23-8c35210dcaca None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:59.590593 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38eb3a8-aa24-4983-a18f-a77a98176485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:59.591222 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38eb3a8-aa24-4983-a18f-a77a98176485 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:59.591502 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38eb3a8-aa24-4983-a18f-a77a98176485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:59.591776 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38eb3a8-aa24-4983-a18f-a77a98176485 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:59.592473 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38eb3a8-aa24-4983-a18f-a77a98176485 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:33:59.592781 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38eb3a8-aa24-4983-a18f-a77a98176485 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:59.594395 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38eb3a8-aa24-4983-a18f-a77a98176485 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:59.604687 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-550dcc15-3212-4e73-9bc9-a3408ddf327d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4638c1a140a40f08fdb6b2c5e859f2f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:59.607047 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1181/2346] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:33:59.611281 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38eb3a8-aa24-4983-a18f-a77a98176485 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:59.618268 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-550dcc15-3212-4e73-9bc9-a3408ddf327d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4638c1a140a40f08fdb6b2c5e859f2f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:59.619015 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-550dcc15-3212-4e73-9bc9-a3408ddf327d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4638c1a140a40f08fdb6b2c5e859f2f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:59.620952 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38eb3a8-aa24-4983-a18f-a77a98176485 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:59.625871 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f329b47-fd83-4267-8523-cf1d2813148c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:59.626543 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f329b47-fd83-4267-8523-cf1d2813148c admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:59.626880 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f329b47-fd83-4267-8523-cf1d2813148c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:59.627111 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f329b47-fd83-4267-8523-cf1d2813148c admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:59.627806 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f329b47-fd83-4267-8523-cf1d2813148c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:59.628034 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-550dcc15-3212-4e73-9bc9-a3408ddf327d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4638c1a140a40f08fdb6b2c5e859f2f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:59.629269 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-550dcc15-3212-4e73-9bc9-a3408ddf327d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4638c1a140a40f08fdb6b2c5e859f2f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:33:59.630422 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f329b47-fd83-4267-8523-cf1d2813148c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:59.642146 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1166/2347] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:33:59 2022] DELETE /identity/v3/users/d4638c1a140a40f08fdb6b2c5e859f2f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:33:59.665788 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1182/2348] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:33:59 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:33:59.666903 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550dcc15-3212-4e73-9bc9-a3408ddf327d admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:59.668417 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-550dcc15-3212-4e73-9bc9-a3408ddf327d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:59.740871 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550dcc15-3212-4e73-9bc9-a3408ddf327d admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:59.750141 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:33:59.803030 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af07c7-4999-4d6d-a5a4-dc0a9380144f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:59.803711 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af07c7-4999-4d6d-a5a4-dc0a9380144f admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:59.804033 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af07c7-4999-4d6d-a5a4-dc0a9380144f admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:59.804292 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af07c7-4999-4d6d-a5a4-dc0a9380144f admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:59.804976 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54af07c7-4999-4d6d-a5a4-dc0a9380144f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:59.806871 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54af07c7-4999-4d6d-a5a4-dc0a9380144f admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:59.830230 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1167/2349] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:33:59 2022] POST /identity/v3/users => generated 290 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:33:59.836006 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f329b47-fd83-4267-8523-cf1d2813148c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:59.846907 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f329b47-fd83-4267-8523-cf1d2813148c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:59.852318 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc06b3-be72-4f37-bda7-77234dc985e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:59.853048 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc06b3-be72-4f37-bda7-77234dc985e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:59.853364 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc06b3-be72-4f37-bda7-77234dc985e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:59.853642 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc06b3-be72-4f37-bda7-77234dc985e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:59.854283 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc06b3-be72-4f37-bda7-77234dc985e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:59.855931 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc06b3-be72-4f37-bda7-77234dc985e3 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:59.866709 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1183/2350] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:33:59.870696 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af07c7-4999-4d6d-a5a4-dc0a9380144f admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:59.880733 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af07c7-4999-4d6d-a5a4-dc0a9380144f admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:59.885478 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711769f1-dfd0-4683-9deb-d00a10ede1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:59.886118 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711769f1-dfd0-4683-9deb-d00a10ede1da admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:59.886478 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711769f1-dfd0-4683-9deb-d00a10ede1da admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:59.886749 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711769f1-dfd0-4683-9deb-d00a10ede1da admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:59.887408 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711769f1-dfd0-4683-9deb-d00a10ede1da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:59.889076 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711769f1-dfd0-4683-9deb-d00a10ede1da admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:59.900330 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1168/2351] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:33:59.904206 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc06b3-be72-4f37-bda7-77234dc985e3 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:59.914829 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc06b3-be72-4f37-bda7-77234dc985e3 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:59.919538 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a01b99-43ef-43b4-884f-5cedff5ff4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:59.920257 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a01b99-43ef-43b4-884f-5cedff5ff4ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:59.920538 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a01b99-43ef-43b4-884f-5cedff5ff4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:59.920811 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a01b99-43ef-43b4-884f-5cedff5ff4ca admin admin] PATH_INFO: `/v3/projects/caceea82dc7c4310ac5b2c617005b1e3/users/03444c84a0244a58a32be5b69d8ac692/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:59.937592 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711769f1-dfd0-4683-9deb-d00a10ede1da admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:33:59.939820 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-711769f1-dfd0-4683-9deb-d00a10ede1da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:33:59.941594 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a01b99-43ef-43b4-884f-5cedff5ff4ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=caceea82dc7c4310ac5b2c617005b1e3, user_id=03444c84a0244a58a32be5b69d8ac692, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:59.944436 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a01b99-43ef-43b4-884f-5cedff5ff4ca admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:59.954466 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711769f1-dfd0-4683-9deb-d00a10ede1da admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:33:59.961230 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921cca11-1d7f-4ba7-90d2-e5a98aa19895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:33:59.961513 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cca11-1d7f-4ba7-90d2-e5a98aa19895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:59.961783 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cca11-1d7f-4ba7-90d2-e5a98aa19895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:59.962058 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cca11-1d7f-4ba7-90d2-e5a98aa19895 admin admin] PATH_INFO: `/v3/projects/acbe2b235ea0401cac5347d70e5fb260` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:33:59.963180 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921cca11-1d7f-4ba7-90d2-e5a98aa19895 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acbe2b235ea0401cac5347d70e5fb260)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:33:59.965110 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921cca11-1d7f-4ba7-90d2-e5a98aa19895 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:33:59.971872 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1184/2352] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:33:59 2022] PUT /identity/v3/projects/caceea82dc7c4310ac5b2c617005b1e3/users/03444c84a0244a58a32be5b69d8ac692/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:33:59.973998 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29357e5-9e02-4c68-ad50-11265efedb19 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:33:59.974286 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29357e5-9e02-4c68-ad50-11265efedb19 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:33:59.974563 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29357e5-9e02-4c68-ad50-11265efedb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:00.004250 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e29357e5-9e02-4c68-ad50-11265efedb19 None None] MFA Rules not processed for user `03444c84a0244a58a32be5b69d8ac692`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:34:00.005551 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e29357e5-9e02-4c68-ad50-11265efedb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:00.015665 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-921cca11-1d7f-4ba7-90d2-e5a98aa19895 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acbe2b235ea0401cac5347d70e5fb260', 'request_id': 'req-921cca11-1d7f-4ba7-90d2-e5a98aa19895'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:00.023267 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-921cca11-1d7f-4ba7-90d2-e5a98aa19895 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acbe2b235ea0401cac5347d70e5fb260', 'request_id': 'req-921cca11-1d7f-4ba7-90d2-e5a98aa19895'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:00.031494 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-921cca11-1d7f-4ba7-90d2-e5a98aa19895 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acbe2b235ea0401cac5347d70e5fb260', 'request_id': 'req-921cca11-1d7f-4ba7-90d2-e5a98aa19895'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:00.043616 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-921cca11-1d7f-4ba7-90d2-e5a98aa19895 admin admin] The token cache is being invalidate because project acbe2b235ea0401cac5347d70e5fb260 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:34:00.043978 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-921cca11-1d7f-4ba7-90d2-e5a98aa19895 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:00.044629 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-921cca11-1d7f-4ba7-90d2-e5a98aa19895 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:00.046136 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1169/2353] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:33:59 2022] DELETE /identity/v3/projects/acbe2b235ea0401cac5347d70e5fb260 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:34:00.052738 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a17ec-87b9-4c71-8b2d-e8ea819754a2 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:00.053012 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a17ec-87b9-4c71-8b2d-e8ea819754a2 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:00.053445 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a17ec-87b9-4c71-8b2d-e8ea819754a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:00.072906 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-512a17ec-87b9-4c71-8b2d-e8ea819754a2 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:34:00.074099 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-512a17ec-87b9-4c71-8b2d-e8ea819754a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:00.075727 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1185/2354] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:33:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:34:00.080134 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29357e5-9e02-4c68-ad50-11265efedb19 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:00.082213 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e29357e5-9e02-4c68-ad50-11265efedb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:00.137951 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1170/2355] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:34:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:34:00.147091 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff96ea8-6af0-4ea9-ad32-3d0fe3ecafa9 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:00.147372 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff96ea8-6af0-4ea9-ad32-3d0fe3ecafa9 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:00.147696 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff96ea8-6af0-4ea9-ad32-3d0fe3ecafa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:00.153355 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29357e5-9e02-4c68-ad50-11265efedb19 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:00.158834 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c496e6b-403e-4314-a3b6-a1b31cfbe3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:00.159473 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c496e6b-403e-4314-a3b6-a1b31cfbe3c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:00.159948 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c496e6b-403e-4314-a3b6-a1b31cfbe3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:00.160192 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c496e6b-403e-4314-a3b6-a1b31cfbe3c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:00.160826 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c496e6b-403e-4314-a3b6-a1b31cfbe3c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:00.162744 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c496e6b-403e-4314-a3b6-a1b31cfbe3c3 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:00.167384 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-8ff96ea8-6af0-4ea9-ad32-3d0fe3ecafa9 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:34:00.168610 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-8ff96ea8-6af0-4ea9-ad32-3d0fe3ecafa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:00.177815 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1171/2356] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:34:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:34:00.182175 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff96ea8-6af0-4ea9-ad32-3d0fe3ecafa9 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:00.184296 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:34:00.196686 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1186/2357] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:34:00 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:34:00.196864 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff96ea8-6af0-4ea9-ad32-3d0fe3ecafa9 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:00.197785 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c496e6b-403e-4314-a3b6-a1b31cfbe3c3 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:00.198688 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:34:00.254822 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca383b-10bd-4268-9997-d2fc1e37e96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:00.255520 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca383b-10bd-4268-9997-d2fc1e37e96b admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:00.255863 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca383b-10bd-4268-9997-d2fc1e37e96b admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:00.256230 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca383b-10bd-4268-9997-d2fc1e37e96b admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:00.256935 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca383b-10bd-4268-9997-d2fc1e37e96b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:34:00.257300 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca383b-10bd-4268-9997-d2fc1e37e96b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:00.258953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca383b-10bd-4268-9997-d2fc1e37e96b admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:00.260680 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c496e6b-403e-4314-a3b6-a1b31cfbe3c3 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:00.265550 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f76c3-01de-4d1b-bfd4-cdd7e0382b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:00.266156 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f76c3-01de-4d1b-bfd4-cdd7e0382b34 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:00.266441 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f76c3-01de-4d1b-bfd4-cdd7e0382b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:00.266716 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f76c3-01de-4d1b-bfd4-cdd7e0382b34 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:00.267348 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f76c3-01de-4d1b-bfd4-cdd7e0382b34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:00.269393 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f76c3-01de-4d1b-bfd4-cdd7e0382b34 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:00.270707 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1172/2358] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:34:00.275153 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca383b-10bd-4268-9997-d2fc1e37e96b admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:00.286511 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca383b-10bd-4268-9997-d2fc1e37e96b admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:00.293874 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1187/2359] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:34:00 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:34:00.294013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2dfbb-c247-41da-a523-7d352166da7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:00.294013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2dfbb-c247-41da-a523-7d352166da7f admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:00.294013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2dfbb-c247-41da-a523-7d352166da7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:00.294013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2dfbb-c247-41da-a523-7d352166da7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:00.294395 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2dfbb-c247-41da-a523-7d352166da7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:00.295074 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2dfbb-c247-41da-a523-7d352166da7f admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:00.295527 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f76c3-01de-4d1b-bfd4-cdd7e0382b34 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:00.305509 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f76c3-01de-4d1b-bfd4-cdd7e0382b34 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:00.310281 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08906164-ecc7-4bbc-8e02-32290770b2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:00.310874 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08906164-ecc7-4bbc-8e02-32290770b2fc admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:00.311159 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08906164-ecc7-4bbc-8e02-32290770b2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:00.311437 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08906164-ecc7-4bbc-8e02-32290770b2fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:00.312245 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08906164-ecc7-4bbc-8e02-32290770b2fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:00.314368 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08906164-ecc7-4bbc-8e02-32290770b2fc admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:00.326843 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1173/2360] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:34:00 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:34:00.327321 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1188/2361] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:34:00.328117 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2dfbb-c247-41da-a523-7d352166da7f admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:00.329998 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08906164-ecc7-4bbc-8e02-32290770b2fc admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:00.339804 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08906164-ecc7-4bbc-8e02-32290770b2fc admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:00.396513 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293f886-baa5-4bc6-9f0a-919cbee1fb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:00.396736 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2dfbb-c247-41da-a523-7d352166da7f admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:00.397372 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293f886-baa5-4bc6-9f0a-919cbee1fb95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:00.397661 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293f886-baa5-4bc6-9f0a-919cbee1fb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:00.397939 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293f886-baa5-4bc6-9f0a-919cbee1fb95 admin admin] PATH_INFO: `/v3/projects/a23d0e647120411fb2030a759fbc06a5/users/53fefd7330b64e8da75e648678491b3c/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:00.401409 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8261a31-29ee-4e5d-a56f-02a74bfcb924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:00.402005 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8261a31-29ee-4e5d-a56f-02a74bfcb924 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:00.402288 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8261a31-29ee-4e5d-a56f-02a74bfcb924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:00.402560 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8261a31-29ee-4e5d-a56f-02a74bfcb924 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:00.403183 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8261a31-29ee-4e5d-a56f-02a74bfcb924 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:00.405137 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8261a31-29ee-4e5d-a56f-02a74bfcb924 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:00.413396 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293f886-baa5-4bc6-9f0a-919cbee1fb95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a23d0e647120411fb2030a759fbc06a5, user_id=53fefd7330b64e8da75e648678491b3c, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:00.416131 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293f886-baa5-4bc6-9f0a-919cbee1fb95 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:00.429864 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1174/2362] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:34:00 2022] POST /identity/v3/users => generated 283 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:34:00.430907 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1189/2363] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:34:00 2022] PUT /identity/v3/projects/a23d0e647120411fb2030a759fbc06a5/users/53fefd7330b64e8da75e648678491b3c/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:34:00.434142 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8261a31-29ee-4e5d-a56f-02a74bfcb924 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:00.434772 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293f886-baa5-4bc6-9f0a-919cbee1fb95 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:00.443742 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8261a31-29ee-4e5d-a56f-02a74bfcb924 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:00.497085 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293f886-baa5-4bc6-9f0a-919cbee1fb95 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:00.501721 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66efebe-7e5c-49b9-9c41-73bc76adf9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:00.502317 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66efebe-7e5c-49b9-9c41-73bc76adf9fe admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:00.502597 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66efebe-7e5c-49b9-9c41-73bc76adf9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:00.502876 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66efebe-7e5c-49b9-9c41-73bc76adf9fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:00.503562 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66efebe-7e5c-49b9-9c41-73bc76adf9fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:00.505340 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66efebe-7e5c-49b9-9c41-73bc76adf9fe admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:00.506584 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:34:00.507598 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45dd0ab-5bd7-48ce-b3d8-d0c2a35537a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:00.508265 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45dd0ab-5bd7-48ce-b3d8-d0c2a35537a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:00.508587 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45dd0ab-5bd7-48ce-b3d8-d0c2a35537a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:00.508898 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45dd0ab-5bd7-48ce-b3d8-d0c2a35537a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:00.509572 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45dd0ab-5bd7-48ce-b3d8-d0c2a35537a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:00.511560 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45dd0ab-5bd7-48ce-b3d8-d0c2a35537a5 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:00.519846 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1190/2364] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:34:00.525254 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1175/2365] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:34:00.525392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66efebe-7e5c-49b9-9c41-73bc76adf9fe admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:00.526571 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45dd0ab-5bd7-48ce-b3d8-d0c2a35537a5 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:00.533099 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66efebe-7e5c-49b9-9c41-73bc76adf9fe admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:00.536585 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45dd0ab-5bd7-48ce-b3d8-d0c2a35537a5 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:00.538325 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f1bfa-42c7-4982-8841-ac7071ed744a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:00.538969 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f1bfa-42c7-4982-8841-ac7071ed744a admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:00.539251 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f1bfa-42c7-4982-8841-ac7071ed744a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:00.539527 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f1bfa-42c7-4982-8841-ac7071ed744a admin admin] PATH_INFO: `/v3/projects/a23d0e647120411fb2030a759fbc06a5/users/53fefd7330b64e8da75e648678491b3c/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:00.541438 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d47d98-b1be-4a1c-aaa6-e321a2f4b6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:00.541604 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f1bfa-42c7-4982-8841-ac7071ed744a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a23d0e647120411fb2030a759fbc06a5, user_id=53fefd7330b64e8da75e648678491b3c, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:00.542008 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d47d98-b1be-4a1c-aaa6-e321a2f4b6af admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:00.542286 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d47d98-b1be-4a1c-aaa6-e321a2f4b6af admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:00.542554 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d47d98-b1be-4a1c-aaa6-e321a2f4b6af admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:00.543170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d47d98-b1be-4a1c-aaa6-e321a2f4b6af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:00.544104 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f1bfa-42c7-4982-8841-ac7071ed744a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:00.544803 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d47d98-b1be-4a1c-aaa6-e321a2f4b6af admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:00.546071 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:34:00.556302 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1191/2366] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:34:00 2022] PUT /identity/v3/projects/a23d0e647120411fb2030a759fbc06a5/users/53fefd7330b64e8da75e648678491b3c/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:34:00.558608 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1176/2367] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:34:00.562161 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f1bfa-42c7-4982-8841-ac7071ed744a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:00.568049 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a883df9-152a-48a7-919c-72cf89593574 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:00.568336 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a883df9-152a-48a7-919c-72cf89593574 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:00.568610 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a883df9-152a-48a7-919c-72cf89593574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:00.605121 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-2a883df9-152a-48a7-919c-72cf89593574 None None] MFA Rules not processed for user `53fefd7330b64e8da75e648678491b3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:34:00.606718 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2a883df9-152a-48a7-919c-72cf89593574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:00.626990 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f1bfa-42c7-4982-8841-ac7071ed744a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:00.632316 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f116b7-57c3-495a-a4e5-a52425f05bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:00.633002 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f116b7-57c3-495a-a4e5-a52425f05bc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:00.633413 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f116b7-57c3-495a-a4e5-a52425f05bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:00.633686 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f116b7-57c3-495a-a4e5-a52425f05bc6 admin admin] PATH_INFO: `/v3/projects/5febc28424d449fe9dd602a3c24d50f2/users/6cbe4dacb6e94ea1a9161d2ff375a13c/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:00.648274 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f116b7-57c3-495a-a4e5-a52425f05bc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5febc28424d449fe9dd602a3c24d50f2, user_id=6cbe4dacb6e94ea1a9161d2ff375a13c, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:00.651082 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f116b7-57c3-495a-a4e5-a52425f05bc6 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:00.666781 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1192/2368] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:34:00 2022] PUT /identity/v3/projects/5febc28424d449fe9dd602a3c24d50f2/users/6cbe4dacb6e94ea1a9161d2ff375a13c/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:34:00.678151 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae98452-2c29-4ce2-a572-f362948fe364 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:00.683350 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae98452-2c29-4ce2-a572-f362948fe364 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:00.683481 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1177/2369] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:34:00 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:34:00.683941 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae98452-2c29-4ce2-a572-f362948fe364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:00.692080 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a883df9-152a-48a7-919c-72cf89593574 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:00.693938 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2a883df9-152a-48a7-919c-72cf89593574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:00.707717 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-9ae98452-2c29-4ce2-a572-f362948fe364 None None] MFA Rules not processed for user `6cbe4dacb6e94ea1a9161d2ff375a13c`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:34:00.708925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9ae98452-2c29-4ce2-a572-f362948fe364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:00.752592 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a883df9-152a-48a7-919c-72cf89593574 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:00.776176 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1193/2370] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:34:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:34:00.787752 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae98452-2c29-4ce2-a572-f362948fe364 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:00.789198 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9ae98452-2c29-4ce2-a572-f362948fe364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:00.803359 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed8505-344f-44a5-94ce-f082bf426c44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:00.803995 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed8505-344f-44a5-94ce-f082bf426c44 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:00.804272 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed8505-344f-44a5-94ce-f082bf426c44 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:00.804545 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed8505-344f-44a5-94ce-f082bf426c44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:00.847021 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae98452-2c29-4ce2-a572-f362948fe364 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:00.850899 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2214a0-6265-4151-9126-c77e490fbabc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:00.851511 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2214a0-6265-4151-9126-c77e490fbabc service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:00.851796 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2214a0-6265-4151-9126-c77e490fbabc service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:00.851952 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:34:00.852225 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2214a0-6265-4151-9126-c77e490fbabc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:00.860985 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2214a0-6265-4151-9126-c77e490fbabc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:00.862407 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2214a0-6265-4151-9126-c77e490fbabc service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:00.865840 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed8505-344f-44a5-94ce-f082bf426c44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:00.866383 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:34:00.867278 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed8505-344f-44a5-94ce-f082bf426c44 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:00.874310 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1194/2371] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:34:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 13:34:00.878582 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1178/2372] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:34:00 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:34:01.213955 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2214a0-6265-4151-9126-c77e490fbabc service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:01.225645 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2214a0-6265-4151-9126-c77e490fbabc service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:01.230239 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c997d-4c77-4699-a2cb-a2fedc86f8de tempest-VolumeQuotaClassesTest-119269929 tempest-VolumeQuotaClassesTest-119269929-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53fefd7330b64e8da75e648678491b3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a23d0e647120411fb2030a759fbc06a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:01.230867 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c997d-4c77-4699-a2cb-a2fedc86f8de tempest-VolumeQuotaClassesTest-119269929 tempest-VolumeQuotaClassesTest-119269929-project-admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:01.231190 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c997d-4c77-4699-a2cb-a2fedc86f8de tempest-VolumeQuotaClassesTest-119269929 tempest-VolumeQuotaClassesTest-119269929-project-admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:01.231468 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c997d-4c77-4699-a2cb-a2fedc86f8de tempest-VolumeQuotaClassesTest-119269929 tempest-VolumeQuotaClassesTest-119269929-project-admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:01.232184 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c997d-4c77-4699-a2cb-a2fedc86f8de tempest-VolumeQuotaClassesTest-119269929 tempest-VolumeQuotaClassesTest-119269929-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:34:01.232507 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c997d-4c77-4699-a2cb-a2fedc86f8de tempest-VolumeQuotaClassesTest-119269929 tempest-VolumeQuotaClassesTest-119269929-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:01.234579 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c997d-4c77-4699-a2cb-a2fedc86f8de tempest-VolumeQuotaClassesTest-119269929 tempest-VolumeQuotaClassesTest-119269929-project-admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:01.246269 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1195/2373] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:34:01.250397 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed8505-344f-44a5-94ce-f082bf426c44 service cinder] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:01.260290 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed8505-344f-44a5-94ce-f082bf426c44 service cinder] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:01.264874 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fceccf-caa5-4fa5-be4e-ae5cf30e8c27 tempest-VolumeQuotaClassesTest-119269929 tempest-VolumeQuotaClassesTest-119269929-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53fefd7330b64e8da75e648678491b3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a23d0e647120411fb2030a759fbc06a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:01.265496 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fceccf-caa5-4fa5-be4e-ae5cf30e8c27 tempest-VolumeQuotaClassesTest-119269929 tempest-VolumeQuotaClassesTest-119269929-project-admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:01.265783 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fceccf-caa5-4fa5-be4e-ae5cf30e8c27 tempest-VolumeQuotaClassesTest-119269929 tempest-VolumeQuotaClassesTest-119269929-project-admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:01.266061 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fceccf-caa5-4fa5-be4e-ae5cf30e8c27 tempest-VolumeQuotaClassesTest-119269929 tempest-VolumeQuotaClassesTest-119269929-project-admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:01.266696 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fceccf-caa5-4fa5-be4e-ae5cf30e8c27 tempest-VolumeQuotaClassesTest-119269929 tempest-VolumeQuotaClassesTest-119269929-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:01.268660 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fceccf-caa5-4fa5-be4e-ae5cf30e8c27 tempest-VolumeQuotaClassesTest-119269929 tempest-VolumeQuotaClassesTest-119269929-project-admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:01.298082 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1179/2374] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:34:01 2022] POST /identity/v3/projects => generated 355 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:34:01.302688 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c997d-4c77-4699-a2cb-a2fedc86f8de tempest-VolumeQuotaClassesTest-119269929 tempest-VolumeQuotaClassesTest-119269929-project-admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:01.320658 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c997d-4c77-4699-a2cb-a2fedc86f8de tempest-VolumeQuotaClassesTest-119269929 tempest-VolumeQuotaClassesTest-119269929-project-admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:01.378463 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74be04-3277-45de-93a3-00308cc95714 tempest-VolumeQuotaClassesTest-119269929 tempest-VolumeQuotaClassesTest-119269929-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53fefd7330b64e8da75e648678491b3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a23d0e647120411fb2030a759fbc06a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:01.379250 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74be04-3277-45de-93a3-00308cc95714 tempest-VolumeQuotaClassesTest-119269929 tempest-VolumeQuotaClassesTest-119269929-project-admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:01.379654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74be04-3277-45de-93a3-00308cc95714 tempest-VolumeQuotaClassesTest-119269929 tempest-VolumeQuotaClassesTest-119269929-project-admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:01.379971 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74be04-3277-45de-93a3-00308cc95714 tempest-VolumeQuotaClassesTest-119269929 tempest-VolumeQuotaClassesTest-119269929-project-admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:01.380613 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c74be04-3277-45de-93a3-00308cc95714 tempest-VolumeQuotaClassesTest-119269929 tempest-VolumeQuotaClassesTest-119269929-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:34:01.380923 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c74be04-3277-45de-93a3-00308cc95714 tempest-VolumeQuotaClassesTest-119269929 tempest-VolumeQuotaClassesTest-119269929-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:01.382511 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c74be04-3277-45de-93a3-00308cc95714 tempest-VolumeQuotaClassesTest-119269929 tempest-VolumeQuotaClassesTest-119269929-project-admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:01.394558 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1196/2375] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:34:01.434292 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fceccf-caa5-4fa5-be4e-ae5cf30e8c27 tempest-VolumeQuotaClassesTest-119269929 tempest-VolumeQuotaClassesTest-119269929-project-admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:01.444775 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fceccf-caa5-4fa5-be4e-ae5cf30e8c27 tempest-VolumeQuotaClassesTest-119269929 tempest-VolumeQuotaClassesTest-119269929-project-admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:01.449353 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eacdc64-fb71-4d2d-b405-8ba879591577 tempest-VolumeQuotaClassesTest-119269929 tempest-VolumeQuotaClassesTest-119269929-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53fefd7330b64e8da75e648678491b3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a23d0e647120411fb2030a759fbc06a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:01.449970 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacdc64-fb71-4d2d-b405-8ba879591577 tempest-VolumeQuotaClassesTest-119269929 tempest-VolumeQuotaClassesTest-119269929-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:01.450254 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacdc64-fb71-4d2d-b405-8ba879591577 tempest-VolumeQuotaClassesTest-119269929 tempest-VolumeQuotaClassesTest-119269929-project-admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:01.450531 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacdc64-fb71-4d2d-b405-8ba879591577 tempest-VolumeQuotaClassesTest-119269929 tempest-VolumeQuotaClassesTest-119269929-project-admin] PATH_INFO: `/v3/projects/48644cc1caee4679878e08475e37c7a5` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:01.451648 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eacdc64-fb71-4d2d-b405-8ba879591577 tempest-VolumeQuotaClassesTest-119269929 tempest-VolumeQuotaClassesTest-119269929-project-admin] RBAC: Authorizing `identity:delete_project(project_id=48644cc1caee4679878e08475e37c7a5)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:01.453594 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eacdc64-fb71-4d2d-b405-8ba879591577 tempest-VolumeQuotaClassesTest-119269929 tempest-VolumeQuotaClassesTest-119269929-project-admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:01.500507 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1eacdc64-fb71-4d2d-b405-8ba879591577 tempest-VolumeQuotaClassesTest-119269929 tempest-VolumeQuotaClassesTest-119269929-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48644cc1caee4679878e08475e37c7a5', 'request_id': 'req-1eacdc64-fb71-4d2d-b405-8ba879591577'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:01.507033 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1eacdc64-fb71-4d2d-b405-8ba879591577 tempest-VolumeQuotaClassesTest-119269929 tempest-VolumeQuotaClassesTest-119269929-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48644cc1caee4679878e08475e37c7a5', 'request_id': 'req-1eacdc64-fb71-4d2d-b405-8ba879591577'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:01.514361 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1eacdc64-fb71-4d2d-b405-8ba879591577 tempest-VolumeQuotaClassesTest-119269929 tempest-VolumeQuotaClassesTest-119269929-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48644cc1caee4679878e08475e37c7a5', 'request_id': 'req-1eacdc64-fb71-4d2d-b405-8ba879591577'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:01.525043 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1eacdc64-fb71-4d2d-b405-8ba879591577 tempest-VolumeQuotaClassesTest-119269929 tempest-VolumeQuotaClassesTest-119269929-project-admin] The token cache is being invalidate because project 48644cc1caee4679878e08475e37c7a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:34:01.525331 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1eacdc64-fb71-4d2d-b405-8ba879591577 tempest-VolumeQuotaClassesTest-119269929 tempest-VolumeQuotaClassesTest-119269929-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:01.525970 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1eacdc64-fb71-4d2d-b405-8ba879591577 tempest-VolumeQuotaClassesTest-119269929 tempest-VolumeQuotaClassesTest-119269929-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:01.527444 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1180/2376] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:34:01 2022] DELETE /identity/v3/projects/48644cc1caee4679878e08475e37c7a5 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:34:01.710905 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74be04-3277-45de-93a3-00308cc95714 tempest-VolumeQuotaClassesTest-119269929 tempest-VolumeQuotaClassesTest-119269929-project-admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:01.712661 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6c74be04-3277-45de-93a3-00308cc95714 tempest-VolumeQuotaClassesTest-119269929 tempest-VolumeQuotaClassesTest-119269929-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:01.777495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74be04-3277-45de-93a3-00308cc95714 tempest-VolumeQuotaClassesTest-119269929 tempest-VolumeQuotaClassesTest-119269929-project-admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:01.833293 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ba57d-e7d4-473a-ab8d-ca47a2621507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:01.833979 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ba57d-e7d4-473a-ab8d-ca47a2621507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:01.834310 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ba57d-e7d4-473a-ab8d-ca47a2621507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:01.834576 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ba57d-e7d4-473a-ab8d-ca47a2621507 admin admin] PATH_INFO: `/v3/users/03444c84a0244a58a32be5b69d8ac692` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:01.835715 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ba57d-e7d4-473a-ab8d-ca47a2621507 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03444c84a0244a58a32be5b69d8ac692)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:01.837659 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ba57d-e7d4-473a-ab8d-ca47a2621507 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:01.866756 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:34:01.885641 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-769ba57d-e7d4-473a-ab8d-ca47a2621507 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03444c84a0244a58a32be5b69d8ac692'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:01.886281 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-769ba57d-e7d4-473a-ab8d-ca47a2621507 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03444c84a0244a58a32be5b69d8ac692'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:01.897953 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-769ba57d-e7d4-473a-ab8d-ca47a2621507 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03444c84a0244a58a32be5b69d8ac692'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:01.905408 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-769ba57d-e7d4-473a-ab8d-ca47a2621507 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03444c84a0244a58a32be5b69d8ac692'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:01.913575 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-769ba57d-e7d4-473a-ab8d-ca47a2621507 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03444c84a0244a58a32be5b69d8ac692'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:01.919509 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1197/2377] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:34:01 2022] DELETE /identity/v3/users/03444c84a0244a58a32be5b69d8ac692 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:34:01.924256 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a741b20-48fc-4e66-9962-0e4f3cc27bf4 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:01.924734 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a741b20-48fc-4e66-9962-0e4f3cc27bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:01.924910 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a741b20-48fc-4e66-9962-0e4f3cc27bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:01.944917 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-8a741b20-48fc-4e66-9962-0e4f3cc27bf4 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:34:01.946024 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-8a741b20-48fc-4e66-9962-0e4f3cc27bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:02.009052 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1181/2378] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:34:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:34:02.018495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ba57d-e7d4-473a-ab8d-ca47a2621507 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:02.020221 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-769ba57d-e7d4-473a-ab8d-ca47a2621507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:02.078901 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ba57d-e7d4-473a-ab8d-ca47a2621507 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:02.083181 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac92caa-4d2b-4686-87b8-d2f68be55a38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:02.083809 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac92caa-4d2b-4686-87b8-d2f68be55a38 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:02.084116 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac92caa-4d2b-4686-87b8-d2f68be55a38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:02.084394 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac92caa-4d2b-4686-87b8-d2f68be55a38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:02.093308 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac92caa-4d2b-4686-87b8-d2f68be55a38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:02.094720 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac92caa-4d2b-4686-87b8-d2f68be55a38 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:02.104623 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1198/2379] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:34:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:34:02.376459 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a741b20-48fc-4e66-9962-0e4f3cc27bf4 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:02.377984 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-8a741b20-48fc-4e66-9962-0e4f3cc27bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:02.390507 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a741b20-48fc-4e66-9962-0e4f3cc27bf4 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:02.396688 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ade57-e2a2-4754-aa64-c2a258b0158e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:02.397331 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ade57-e2a2-4754-aa64-c2a258b0158e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:02.397626 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ade57-e2a2-4754-aa64-c2a258b0158e admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:02.397881 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ade57-e2a2-4754-aa64-c2a258b0158e admin admin] PATH_INFO: `/v3/projects/caceea82dc7c4310ac5b2c617005b1e3` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:02.399012 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ade57-e2a2-4754-aa64-c2a258b0158e admin admin] RBAC: Authorizing `identity:delete_project(project_id=caceea82dc7c4310ac5b2c617005b1e3)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:02.400953 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ade57-e2a2-4754-aa64-c2a258b0158e admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:02.451014 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:34:02.457408 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5e5ade57-e2a2-4754-aa64-c2a258b0158e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caceea82dc7c4310ac5b2c617005b1e3', 'request_id': 'req-5e5ade57-e2a2-4754-aa64-c2a258b0158e'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:02.465248 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5e5ade57-e2a2-4754-aa64-c2a258b0158e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caceea82dc7c4310ac5b2c617005b1e3', 'request_id': 'req-5e5ade57-e2a2-4754-aa64-c2a258b0158e'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:02.479729 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5e5ade57-e2a2-4754-aa64-c2a258b0158e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caceea82dc7c4310ac5b2c617005b1e3', 'request_id': 'req-5e5ade57-e2a2-4754-aa64-c2a258b0158e'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:02.491055 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5e5ade57-e2a2-4754-aa64-c2a258b0158e admin admin] The token cache is being invalidate because project caceea82dc7c4310ac5b2c617005b1e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:34:02.491350 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5e5ade57-e2a2-4754-aa64-c2a258b0158e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:02.492023 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5e5ade57-e2a2-4754-aa64-c2a258b0158e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:02.493557 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1182/2380] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:34:02 2022] DELETE /identity/v3/projects/caceea82dc7c4310ac5b2c617005b1e3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:34:02.497506 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac92caa-4d2b-4686-87b8-d2f68be55a38 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:02.507038 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac92caa-4d2b-4686-87b8-d2f68be55a38 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:02.565106 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab544cf2-b5e4-4f77-a643-819bd4750830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:02.565739 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab544cf2-b5e4-4f77-a643-819bd4750830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:02.566552 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab544cf2-b5e4-4f77-a643-819bd4750830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:02.566814 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab544cf2-b5e4-4f77-a643-819bd4750830 admin admin] PATH_INFO: `/v3/users/53fefd7330b64e8da75e648678491b3c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:02.567989 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab544cf2-b5e4-4f77-a643-819bd4750830 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53fefd7330b64e8da75e648678491b3c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:02.569956 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab544cf2-b5e4-4f77-a643-819bd4750830 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:02.619828 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ab544cf2-b5e4-4f77-a643-819bd4750830 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53fefd7330b64e8da75e648678491b3c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:02.620530 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ab544cf2-b5e4-4f77-a643-819bd4750830 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53fefd7330b64e8da75e648678491b3c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:02.622458 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:34:02.634815 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ab544cf2-b5e4-4f77-a643-819bd4750830 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53fefd7330b64e8da75e648678491b3c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:02.641475 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ab544cf2-b5e4-4f77-a643-819bd4750830 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53fefd7330b64e8da75e648678491b3c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:02.649430 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ab544cf2-b5e4-4f77-a643-819bd4750830 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53fefd7330b64e8da75e648678491b3c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:02.655351 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1199/2381] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:34:02 2022] DELETE /identity/v3/users/53fefd7330b64e8da75e648678491b3c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:34:02.960354 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ade57-e2a2-4754-aa64-c2a258b0158e admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:02.961873 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-5e5ade57-e2a2-4754-aa64-c2a258b0158e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:02.976949 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ade57-e2a2-4754-aa64-c2a258b0158e admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:03.034160 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a045b-1fe3-4501-b5fb-a43c91577fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:03.035423 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a045b-1fe3-4501-b5fb-a43c91577fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:03.035704 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a045b-1fe3-4501-b5fb-a43c91577fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:03.036011 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a045b-1fe3-4501-b5fb-a43c91577fd8 admin admin] PATH_INFO: `/v3/projects/a23d0e647120411fb2030a759fbc06a5` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:03.037130 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776a045b-1fe3-4501-b5fb-a43c91577fd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a23d0e647120411fb2030a759fbc06a5)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:03.039033 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776a045b-1fe3-4501-b5fb-a43c91577fd8 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:03.085267 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-776a045b-1fe3-4501-b5fb-a43c91577fd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a23d0e647120411fb2030a759fbc06a5', 'request_id': 'req-776a045b-1fe3-4501-b5fb-a43c91577fd8'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:03.091244 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-776a045b-1fe3-4501-b5fb-a43c91577fd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a23d0e647120411fb2030a759fbc06a5', 'request_id': 'req-776a045b-1fe3-4501-b5fb-a43c91577fd8'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:03.099200 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-776a045b-1fe3-4501-b5fb-a43c91577fd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a23d0e647120411fb2030a759fbc06a5', 'request_id': 'req-776a045b-1fe3-4501-b5fb-a43c91577fd8'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:03.109463 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-776a045b-1fe3-4501-b5fb-a43c91577fd8 admin admin] The token cache is being invalidate because project a23d0e647120411fb2030a759fbc06a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:34:03.109747 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-776a045b-1fe3-4501-b5fb-a43c91577fd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:03.110362 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-776a045b-1fe3-4501-b5fb-a43c91577fd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:03.111827 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1183/2382] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:34:02 2022] DELETE /identity/v3/projects/a23d0e647120411fb2030a759fbc06a5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:34:03.117704 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d9c56-a213-419f-a473-8b073f6ba3e0 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:03.117992 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d9c56-a213-419f-a473-8b073f6ba3e0 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:03.118273 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d9c56-a213-419f-a473-8b073f6ba3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:03.145499 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e48d9c56-a213-419f-a473-8b073f6ba3e0 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:34:03.146718 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e48d9c56-a213-419f-a473-8b073f6ba3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:03.205903 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1200/2383] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:34:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:34:03.214339 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45957a-2197-4d80-9984-dc2b2d24f3be None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:03.214558 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45957a-2197-4d80-9984-dc2b2d24f3be None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:03.214833 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45957a-2197-4d80-9984-dc2b2d24f3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:03.235767 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-7d45957a-2197-4d80-9984-dc2b2d24f3be None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:34:03.236989 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-7d45957a-2197-4d80-9984-dc2b2d24f3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:03.245120 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1184/2384] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:34:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:34:03.249201 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d9c56-a213-419f-a473-8b073f6ba3e0 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:03.259152 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d9c56-a213-419f-a473-8b073f6ba3e0 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:03.263619 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70edf1-69a6-46de-959b-16fefe3fcbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:03.264241 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70edf1-69a6-46de-959b-16fefe3fcbe1 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:03.264523 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70edf1-69a6-46de-959b-16fefe3fcbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:03.264795 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70edf1-69a6-46de-959b-16fefe3fcbe1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:03.265423 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70edf1-69a6-46de-959b-16fefe3fcbe1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:34:03.265723 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70edf1-69a6-46de-959b-16fefe3fcbe1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:03.267302 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70edf1-69a6-46de-959b-16fefe3fcbe1 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:03.278724 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1201/2385] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:34:03.282887 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45957a-2197-4d80-9984-dc2b2d24f3be None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:03.292662 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45957a-2197-4d80-9984-dc2b2d24f3be None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:03.297500 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a05024-3855-481d-8861-1ad91337fe50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:03.298080 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a05024-3855-481d-8861-1ad91337fe50 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:03.298354 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a05024-3855-481d-8861-1ad91337fe50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:03.298621 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a05024-3855-481d-8861-1ad91337fe50 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:03.299259 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a05024-3855-481d-8861-1ad91337fe50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:03.302082 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a05024-3855-481d-8861-1ad91337fe50 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:03.328211 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1185/2386] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:34:03 2022] POST /identity/v3/projects => generated 359 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:34:03.332546 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70edf1-69a6-46de-959b-16fefe3fcbe1 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:03.342589 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70edf1-69a6-46de-959b-16fefe3fcbe1 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:03.399863 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c26b69-66c1-47da-a42c-f5a2f612b310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:03.400495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c26b69-66c1-47da-a42c-f5a2f612b310 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:03.400774 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c26b69-66c1-47da-a42c-f5a2f612b310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:03.401070 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c26b69-66c1-47da-a42c-f5a2f612b310 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:03.401703 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c26b69-66c1-47da-a42c-f5a2f612b310 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:03.403660 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c26b69-66c1-47da-a42c-f5a2f612b310 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:03.428797 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1202/2387] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:34:03 2022] POST /identity/v3/users => generated 280 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:34:03.433521 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a05024-3855-481d-8861-1ad91337fe50 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:03.444590 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a05024-3855-481d-8861-1ad91337fe50 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:03.449209 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a4b1b-f517-42b8-a680-62aca2522534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:03.449803 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a4b1b-f517-42b8-a680-62aca2522534 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:03.450082 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a4b1b-f517-42b8-a680-62aca2522534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:03.450355 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a4b1b-f517-42b8-a680-62aca2522534 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:03.450992 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a4b1b-f517-42b8-a680-62aca2522534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:03.452624 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a4b1b-f517-42b8-a680-62aca2522534 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:03.463093 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1186/2388] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:34:03.467056 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c26b69-66c1-47da-a42c-f5a2f612b310 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:03.477298 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c26b69-66c1-47da-a42c-f5a2f612b310 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:03.481913 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07312bb-f555-4e26-b26f-196bf169b062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:03.482499 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07312bb-f555-4e26-b26f-196bf169b062 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:03.482778 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07312bb-f555-4e26-b26f-196bf169b062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:03.483057 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07312bb-f555-4e26-b26f-196bf169b062 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:03.483676 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07312bb-f555-4e26-b26f-196bf169b062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:03.485316 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07312bb-f555-4e26-b26f-196bf169b062 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:03.496530 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1203/2389] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:34:03.500603 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a4b1b-f517-42b8-a680-62aca2522534 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:03.510440 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a4b1b-f517-42b8-a680-62aca2522534 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:03.514933 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3fb58c-793d-41ef-a3c4-296753264129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:03.515570 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fb58c-793d-41ef-a3c4-296753264129 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:03.515839 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fb58c-793d-41ef-a3c4-296753264129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:03.516164 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fb58c-793d-41ef-a3c4-296753264129 admin admin] PATH_INFO: `/v3/projects/b8f604eb2802443286423d0fe3d57401/users/f9b57a4cff234b4ea48476b9464e00d4/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:03.530246 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3fb58c-793d-41ef-a3c4-296753264129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8f604eb2802443286423d0fe3d57401, user_id=f9b57a4cff234b4ea48476b9464e00d4, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:03.532892 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3fb58c-793d-41ef-a3c4-296753264129 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:03.541298 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:34:03.548684 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1187/2390] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:34:03 2022] PUT /identity/v3/projects/b8f604eb2802443286423d0fe3d57401/users/f9b57a4cff234b4ea48476b9464e00d4/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:34:03.559609 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906ac38-2b00-45e5-a1c8-6c1fa264dc61 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:03.560136 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906ac38-2b00-45e5-a1c8-6c1fa264dc61 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:03.560246 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906ac38-2b00-45e5-a1c8-6c1fa264dc61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:03.588742 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-b906ac38-2b00-45e5-a1c8-6c1fa264dc61 None None] MFA Rules not processed for user `f9b57a4cff234b4ea48476b9464e00d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:34:03.589950 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b906ac38-2b00-45e5-a1c8-6c1fa264dc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:03.610203 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:34:03.657178 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1204/2391] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:34:03 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:34:03.692548 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3fb58c-793d-41ef-a3c4-296753264129 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:03.694230 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2c3fb58c-793d-41ef-a3c4-296753264129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:03.751437 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3fb58c-793d-41ef-a3c4-296753264129 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:03.755969 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4221fae-4af3-4c43-bf23-f6eb7a41fe57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:03.756562 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4221fae-4af3-4c43-bf23-f6eb7a41fe57 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:03.756838 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4221fae-4af3-4c43-bf23-f6eb7a41fe57 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:03.757106 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4221fae-4af3-4c43-bf23-f6eb7a41fe57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:03.765172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4221fae-4af3-4c43-bf23-f6eb7a41fe57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:03.766579 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4221fae-4af3-4c43-bf23-f6eb7a41fe57 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:03.776323 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1188/2392] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:34:03 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:34:03.792407 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906ac38-2b00-45e5-a1c8-6c1fa264dc61 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:03.857418 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906ac38-2b00-45e5-a1c8-6c1fa264dc61 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:03.862057 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21fc2a-3ee7-4628-a155-c883005cd18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:03.863256 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21fc2a-3ee7-4628-a155-c883005cd18f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:03.863510 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21fc2a-3ee7-4628-a155-c883005cd18f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:03.863901 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21fc2a-3ee7-4628-a155-c883005cd18f admin admin] PATH_INFO: `/v3/users/f9b57a4cff234b4ea48476b9464e00d4` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:03.865334 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb21fc2a-3ee7-4628-a155-c883005cd18f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9b57a4cff234b4ea48476b9464e00d4)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:03.867423 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb21fc2a-3ee7-4628-a155-c883005cd18f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:03.916958 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-eb21fc2a-3ee7-4628-a155-c883005cd18f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9b57a4cff234b4ea48476b9464e00d4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:03.917727 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-eb21fc2a-3ee7-4628-a155-c883005cd18f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9b57a4cff234b4ea48476b9464e00d4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:03.931865 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-eb21fc2a-3ee7-4628-a155-c883005cd18f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9b57a4cff234b4ea48476b9464e00d4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:03.943962 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-eb21fc2a-3ee7-4628-a155-c883005cd18f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9b57a4cff234b4ea48476b9464e00d4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:03.952061 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-eb21fc2a-3ee7-4628-a155-c883005cd18f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9b57a4cff234b4ea48476b9464e00d4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:03.959311 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1205/2393] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:34:03 2022] DELETE /identity/v3/users/f9b57a4cff234b4ea48476b9464e00d4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:34:03.962613 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e09a0d-882b-4d35-b9f0-fc069b673c2b None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:03.963079 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e09a0d-882b-4d35-b9f0-fc069b673c2b None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:03.963286 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e09a0d-882b-4d35-b9f0-fc069b673c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:03.983309 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-c6e09a0d-882b-4d35-b9f0-fc069b673c2b None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:34:03.984570 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c6e09a0d-882b-4d35-b9f0-fc069b673c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:04.043414 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1189/2394] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:34:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:34:04.054044 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21fc2a-3ee7-4628-a155-c883005cd18f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:04.055438 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-eb21fc2a-3ee7-4628-a155-c883005cd18f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:04.102459 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:34:04.115658 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21fc2a-3ee7-4628-a155-c883005cd18f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:04.119529 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd771f0-787a-419f-89ba-e724c8dd34cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:04.120170 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd771f0-787a-419f-89ba-e724c8dd34cd service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:04.120448 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd771f0-787a-419f-89ba-e724c8dd34cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:04.120719 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd771f0-787a-419f-89ba-e724c8dd34cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:04.131431 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd771f0-787a-419f-89ba-e724c8dd34cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:04.133014 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd771f0-787a-419f-89ba-e724c8dd34cd service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:04.143100 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1206/2395] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:34:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:34:04.411199 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e09a0d-882b-4d35-b9f0-fc069b673c2b None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:04.412707 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c6e09a0d-882b-4d35-b9f0-fc069b673c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:04.424904 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e09a0d-882b-4d35-b9f0-fc069b673c2b None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:04.430759 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b793580-5996-4d4d-aa93-ff56c0b1640d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:04.431535 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b793580-5996-4d4d-aa93-ff56c0b1640d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:04.431875 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b793580-5996-4d4d-aa93-ff56c0b1640d admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:04.432744 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b793580-5996-4d4d-aa93-ff56c0b1640d admin admin] PATH_INFO: `/v3/projects/b8f604eb2802443286423d0fe3d57401` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:04.434189 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b793580-5996-4d4d-aa93-ff56c0b1640d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8f604eb2802443286423d0fe3d57401)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:04.436811 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b793580-5996-4d4d-aa93-ff56c0b1640d admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:04.484625 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5b793580-5996-4d4d-aa93-ff56c0b1640d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8f604eb2802443286423d0fe3d57401', 'request_id': 'req-5b793580-5996-4d4d-aa93-ff56c0b1640d'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:04.490901 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5b793580-5996-4d4d-aa93-ff56c0b1640d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8f604eb2802443286423d0fe3d57401', 'request_id': 'req-5b793580-5996-4d4d-aa93-ff56c0b1640d'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:04.498468 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5b793580-5996-4d4d-aa93-ff56c0b1640d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8f604eb2802443286423d0fe3d57401', 'request_id': 'req-5b793580-5996-4d4d-aa93-ff56c0b1640d'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:04.509599 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5b793580-5996-4d4d-aa93-ff56c0b1640d admin admin] The token cache is being invalidate because project b8f604eb2802443286423d0fe3d57401 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:34:04.509891 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5b793580-5996-4d4d-aa93-ff56c0b1640d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:04.510520 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5b793580-5996-4d4d-aa93-ff56c0b1640d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:04.512017 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1190/2396] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:34:04 2022] DELETE /identity/v3/projects/b8f604eb2802443286423d0fe3d57401 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:34:04.517729 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d7d19-b586-41ce-91e3-7c40cd516442 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:04.518023 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d7d19-b586-41ce-91e3-7c40cd516442 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:04.518300 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d7d19-b586-41ce-91e3-7c40cd516442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:04.538309 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-ab5d7d19-b586-41ce-91e3-7c40cd516442 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:34:04.539490 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ab5d7d19-b586-41ce-91e3-7c40cd516442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:04.598096 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1207/2397] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:34:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:34:04.607096 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106df51-7c6f-4fb3-bd0c-61bb3022c97e None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:04.607382 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106df51-7c6f-4fb3-bd0c-61bb3022c97e None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:04.607661 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106df51-7c6f-4fb3-bd0c-61bb3022c97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:04.627577 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-d106df51-7c6f-4fb3-bd0c-61bb3022c97e None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:34:04.629431 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-d106df51-7c6f-4fb3-bd0c-61bb3022c97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:04.637127 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1191/2398] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:34:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:34:04.641375 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d7d19-b586-41ce-91e3-7c40cd516442 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:04.651132 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d7d19-b586-41ce-91e3-7c40cd516442 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:04.655712 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e1080-1c52-4f25-b684-5da065c71de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:04.656342 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e1080-1c52-4f25-b684-5da065c71de6 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:04.656627 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e1080-1c52-4f25-b684-5da065c71de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:04.656900 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e1080-1c52-4f25-b684-5da065c71de6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:04.657535 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e1080-1c52-4f25-b684-5da065c71de6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:34:04.657839 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e1080-1c52-4f25-b684-5da065c71de6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:04.659428 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e1080-1c52-4f25-b684-5da065c71de6 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:04.670870 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1208/2399] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:34:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:34:04.675766 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106df51-7c6f-4fb3-bd0c-61bb3022c97e None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:04.684835 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106df51-7c6f-4fb3-bd0c-61bb3022c97e None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:04.689427 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97934913-26d0-44ff-86aa-1c2168d33ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:04.689992 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97934913-26d0-44ff-86aa-1c2168d33ae5 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:04.690266 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97934913-26d0-44ff-86aa-1c2168d33ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:04.690538 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97934913-26d0-44ff-86aa-1c2168d33ae5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:04.691816 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97934913-26d0-44ff-86aa-1c2168d33ae5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:04.693736 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97934913-26d0-44ff-86aa-1c2168d33ae5 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:04.709386 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:34:04.723866 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1192/2400] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:34:04 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:34:04.728032 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e1080-1c52-4f25-b684-5da065c71de6 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:04.738974 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e1080-1c52-4f25-b684-5da065c71de6 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:04.793794 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622712a-9efa-460f-87dc-2d979afa38ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:04.794322 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622712a-9efa-460f-87dc-2d979afa38ff admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:04.794609 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622712a-9efa-460f-87dc-2d979afa38ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:04.794881 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622712a-9efa-460f-87dc-2d979afa38ff admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:04.795509 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e622712a-9efa-460f-87dc-2d979afa38ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:04.797688 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e622712a-9efa-460f-87dc-2d979afa38ff admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:04.819286 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1209/2401] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:34:04 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:34:04.823812 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97934913-26d0-44ff-86aa-1c2168d33ae5 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:04.834568 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97934913-26d0-44ff-86aa-1c2168d33ae5 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:04.839607 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab407ab1-1d78-4e86-8108-4f2cf2c4ee2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:04.840239 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab407ab1-1d78-4e86-8108-4f2cf2c4ee2d admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:04.840518 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab407ab1-1d78-4e86-8108-4f2cf2c4ee2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:04.840790 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab407ab1-1d78-4e86-8108-4f2cf2c4ee2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:04.841427 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab407ab1-1d78-4e86-8108-4f2cf2c4ee2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:04.843030 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab407ab1-1d78-4e86-8108-4f2cf2c4ee2d admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:04.854691 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1193/2402] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:34:04.858862 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622712a-9efa-460f-87dc-2d979afa38ff admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:04.869709 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622712a-9efa-460f-87dc-2d979afa38ff admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:04.874342 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46013274-2a97-4d4a-a0cc-82712b9fdd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:04.874936 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46013274-2a97-4d4a-a0cc-82712b9fdd04 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:04.875218 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46013274-2a97-4d4a-a0cc-82712b9fdd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:04.875495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46013274-2a97-4d4a-a0cc-82712b9fdd04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:04.876163 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46013274-2a97-4d4a-a0cc-82712b9fdd04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:04.877748 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46013274-2a97-4d4a-a0cc-82712b9fdd04 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:04.888587 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1210/2403] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:34:04.892695 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab407ab1-1d78-4e86-8108-4f2cf2c4ee2d admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:04.903196 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab407ab1-1d78-4e86-8108-4f2cf2c4ee2d admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:04.907799 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad6427-3b00-4eb2-b4ce-238f6d0fad1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:04.908469 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad6427-3b00-4eb2-b4ce-238f6d0fad1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:04.908749 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad6427-3b00-4eb2-b4ce-238f6d0fad1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:04.909020 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad6427-3b00-4eb2-b4ce-238f6d0fad1a admin admin] PATH_INFO: `/v3/projects/06000ba8a349460ea771eb50bec33567/users/e88cff8ae950433297fa205a1115f421/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:04.924293 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edad6427-3b00-4eb2-b4ce-238f6d0fad1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=06000ba8a349460ea771eb50bec33567, user_id=e88cff8ae950433297fa205a1115f421, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:04.927567 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edad6427-3b00-4eb2-b4ce-238f6d0fad1a admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:04.940200 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1194/2404] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:34:04 2022] PUT /identity/v3/projects/06000ba8a349460ea771eb50bec33567/users/e88cff8ae950433297fa205a1115f421/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:34:04.950672 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc87b9b-ed50-40a5-a1ac-eae51b5b2fcb None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:04.950962 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc87b9b-ed50-40a5-a1ac-eae51b5b2fcb None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:04.951237 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc87b9b-ed50-40a5-a1ac-eae51b5b2fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:04.979520 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-2dc87b9b-ed50-40a5-a1ac-eae51b5b2fcb None None] MFA Rules not processed for user `e88cff8ae950433297fa205a1115f421`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:34:04.980750 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2dc87b9b-ed50-40a5-a1ac-eae51b5b2fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:05.026743 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:34:05.058142 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1211/2405] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:34:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:34:05.071671 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad6427-3b00-4eb2-b4ce-238f6d0fad1a admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:05.074203 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-edad6427-3b00-4eb2-b4ce-238f6d0fad1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:05.153586 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad6427-3b00-4eb2-b4ce-238f6d0fad1a admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:05.157462 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0dd3a3-7776-4222-a798-628f9c820bfd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f67d808ffb4641b03f96406b3fe9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:05.158092 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0dd3a3-7776-4222-a798-628f9c820bfd service glance] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:05.158398 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0dd3a3-7776-4222-a798-628f9c820bfd service glance] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:05.158668 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0dd3a3-7776-4222-a798-628f9c820bfd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:05.167244 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0dd3a3-7776-4222-a798-628f9c820bfd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:05.168683 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0dd3a3-7776-4222-a798-628f9c820bfd service glance] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:05.178966 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1195/2406] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:34:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:34:15.054397 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=9 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:34:15.173713 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=43,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:34:24.649275 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a56bde-8959-4a92-8a17-99f5f4cca181 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:24.649765 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a56bde-8959-4a92-8a17-99f5f4cca181 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:24.649853 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a56bde-8959-4a92-8a17-99f5f4cca181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:24.671262 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-55a56bde-8959-4a92-8a17-99f5f4cca181 None None] MFA Rules not processed for user `9d5d4691dca848d58bd280d2fad79fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:34:24.672771 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-55a56bde-8959-4a92-8a17-99f5f4cca181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:24.736576 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1212/2407] 10.222.0.25 () {58 vars in 967 bytes} [Tue Oct 25 13:34:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:34:24.788853 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0dd3a3-7776-4222-a798-628f9c820bfd service glance] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:24.790586 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-4d0dd3a3-7776-4222-a798-628f9c820bfd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:24.871764 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0dd3a3-7776-4222-a798-628f9c820bfd service glance] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:24.876743 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d5ae4-f4ab-45bf-a6a2-7e033511b7e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07413369b0c14e878d04ee528487801d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:24.877353 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d5ae4-f4ab-45bf-a6a2-7e033511b7e1 service swift] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:24.877629 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d5ae4-f4ab-45bf-a6a2-7e033511b7e1 service swift] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:24.877904 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d5ae4-f4ab-45bf-a6a2-7e033511b7e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:24.886278 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d5ae4-f4ab-45bf-a6a2-7e033511b7e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:24.887844 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d5ae4-f4ab-45bf-a6a2-7e033511b7e1 service swift] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:24.895709 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1196/2408] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 25 13:34:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 25 13:34:28.628182 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a56bde-8959-4a92-8a17-99f5f4cca181 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:28.631131 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-55a56bde-8959-4a92-8a17-99f5f4cca181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:28.702169 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a56bde-8959-4a92-8a17-99f5f4cca181 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:28.706055 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18774997-7b17-43d9-8079-8eaa322605be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:28.706741 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18774997-7b17-43d9-8079-8eaa322605be service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:28.707093 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18774997-7b17-43d9-8079-8eaa322605be service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:28.707584 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18774997-7b17-43d9-8079-8eaa322605be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:28.709672 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-18774997-7b17-43d9-8079-8eaa322605be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:28.812219 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18774997-7b17-43d9-8079-8eaa322605be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:28.814070 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18774997-7b17-43d9-8079-8eaa322605be service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:28.827795 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1213/2409] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:34:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:34:33.440484 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d5ae4-f4ab-45bf-a6a2-7e033511b7e1 service swift] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:33.442037 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ec0d5ae4-f4ab-45bf-a6a2-7e033511b7e1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:33.470821 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d5ae4-f4ab-45bf-a6a2-7e033511b7e1 service swift] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:33.476683 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57acd7-1a1f-4eea-a226-10012eaea6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:33.478822 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57acd7-1a1f-4eea-a226-10012eaea6f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:33.479351 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57acd7-1a1f-4eea-a226-10012eaea6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:33.479658 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57acd7-1a1f-4eea-a226-10012eaea6f2 admin admin] PATH_INFO: `/v3/users/74f1fc245d3a4e80a4a3aaf079e9c4e3` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:33.481302 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57acd7-1a1f-4eea-a226-10012eaea6f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74f1fc245d3a4e80a4a3aaf079e9c4e3)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:33.483284 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57acd7-1a1f-4eea-a226-10012eaea6f2 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:33.544542 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-8c57acd7-1a1f-4eea-a226-10012eaea6f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74f1fc245d3a4e80a4a3aaf079e9c4e3'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:33.562365 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-8c57acd7-1a1f-4eea-a226-10012eaea6f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74f1fc245d3a4e80a4a3aaf079e9c4e3'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:33.563092 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-8c57acd7-1a1f-4eea-a226-10012eaea6f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74f1fc245d3a4e80a4a3aaf079e9c4e3'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:33.571465 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-8c57acd7-1a1f-4eea-a226-10012eaea6f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74f1fc245d3a4e80a4a3aaf079e9c4e3'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:33.572859 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-8c57acd7-1a1f-4eea-a226-10012eaea6f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74f1fc245d3a4e80a4a3aaf079e9c4e3'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:33.588839 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1197/2410] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:34:33 2022] DELETE /identity/v3/users/74f1fc245d3a4e80a4a3aaf079e9c4e3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:34:33.774103 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18774997-7b17-43d9-8079-8eaa322605be service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:33.780142 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-18774997-7b17-43d9-8079-8eaa322605be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:33.802537 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18774997-7b17-43d9-8079-8eaa322605be service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:33.803778 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57acd7-1a1f-4eea-a226-10012eaea6f2 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:33.805383 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-8c57acd7-1a1f-4eea-a226-10012eaea6f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:33.865097 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:34:33.878489 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2df19-65b6-483f-9f40-4fe8799ab248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:33.879463 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2df19-65b6-483f-9f40-4fe8799ab248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:33.880227 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2df19-65b6-483f-9f40-4fe8799ab248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:33.880605 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2df19-65b6-483f-9f40-4fe8799ab248 admin admin] PATH_INFO: `/v3/users/b59b96a78db44099838e00f6614052bf` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:33.892028 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57acd7-1a1f-4eea-a226-10012eaea6f2 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:33.898941 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a2df19-65b6-483f-9f40-4fe8799ab248 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b59b96a78db44099838e00f6614052bf)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:33.899219 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398e2c8-2d36-447e-a53a-0482db721fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:33.900400 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398e2c8-2d36-447e-a53a-0482db721fd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:33.901346 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398e2c8-2d36-447e-a53a-0482db721fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:33.901621 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398e2c8-2d36-447e-a53a-0482db721fd3 admin admin] PATH_INFO: `/v3/projects/b5d86fcd003b4061a0789ebfe2c10509` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:33.901744 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a2df19-65b6-483f-9f40-4fe8799ab248 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:33.902809 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398e2c8-2d36-447e-a53a-0482db721fd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5d86fcd003b4061a0789ebfe2c10509)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:33.904736 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398e2c8-2d36-447e-a53a-0482db721fd3 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:33.907168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:34:33.950680 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d4a2df19-65b6-483f-9f40-4fe8799ab248 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b59b96a78db44099838e00f6614052bf'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:33.951312 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d4a2df19-65b6-483f-9f40-4fe8799ab248 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b59b96a78db44099838e00f6614052bf'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:33.955396 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-6398e2c8-2d36-447e-a53a-0482db721fd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5d86fcd003b4061a0789ebfe2c10509', 'request_id': 'req-6398e2c8-2d36-447e-a53a-0482db721fd3'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:33.962747 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-6398e2c8-2d36-447e-a53a-0482db721fd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5d86fcd003b4061a0789ebfe2c10509', 'request_id': 'req-6398e2c8-2d36-447e-a53a-0482db721fd3'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:33.966379 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d4a2df19-65b6-483f-9f40-4fe8799ab248 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b59b96a78db44099838e00f6614052bf'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:33.970902 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-6398e2c8-2d36-447e-a53a-0482db721fd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5d86fcd003b4061a0789ebfe2c10509', 'request_id': 'req-6398e2c8-2d36-447e-a53a-0482db721fd3'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:33.973129 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d4a2df19-65b6-483f-9f40-4fe8799ab248 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b59b96a78db44099838e00f6614052bf'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:33.981571 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d4a2df19-65b6-483f-9f40-4fe8799ab248 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b59b96a78db44099838e00f6614052bf'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:33.985498 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-6398e2c8-2d36-447e-a53a-0482db721fd3 admin admin] The token cache is being invalidate because project b5d86fcd003b4061a0789ebfe2c10509 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:34:33.985716 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-6398e2c8-2d36-447e-a53a-0482db721fd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:33.986359 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-6398e2c8-2d36-447e-a53a-0482db721fd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:33.987739 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1214/2411] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:34:33 2022] DELETE /identity/v3/users/b59b96a78db44099838e00f6614052bf => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:34:33.987929 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1198/2412] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:34:33 2022] DELETE /identity/v3/projects/b5d86fcd003b4061a0789ebfe2c10509 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:34:33.991964 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2df19-65b6-483f-9f40-4fe8799ab248 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:33.993310 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d4a2df19-65b6-483f-9f40-4fe8799ab248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:34.063467 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2df19-65b6-483f-9f40-4fe8799ab248 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:34.068441 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793770e3-e9f7-4d69-acc7-e074ba17407f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:34.068870 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793770e3-e9f7-4d69-acc7-e074ba17407f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:34.069154 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793770e3-e9f7-4d69-acc7-e074ba17407f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:34.069434 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793770e3-e9f7-4d69-acc7-e074ba17407f admin admin] PATH_INFO: `/v3/users/d1922277b8934630888d03e9161d8d64` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:34.070584 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793770e3-e9f7-4d69-acc7-e074ba17407f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1922277b8934630888d03e9161d8d64)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:34.072589 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793770e3-e9f7-4d69-acc7-e074ba17407f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:34.125240 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-793770e3-e9f7-4d69-acc7-e074ba17407f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1922277b8934630888d03e9161d8d64'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:34.126108 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-793770e3-e9f7-4d69-acc7-e074ba17407f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1922277b8934630888d03e9161d8d64'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:34.142801 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-793770e3-e9f7-4d69-acc7-e074ba17407f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1922277b8934630888d03e9161d8d64'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:34.144632 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:34:34.152177 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-793770e3-e9f7-4d69-acc7-e074ba17407f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1922277b8934630888d03e9161d8d64'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:34.160332 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-793770e3-e9f7-4d69-acc7-e074ba17407f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1922277b8934630888d03e9161d8d64'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:34.167444 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1215/2413] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:34:33 2022] DELETE /identity/v3/users/d1922277b8934630888d03e9161d8d64 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:34:34.220400 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398e2c8-2d36-447e-a53a-0482db721fd3 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:34.222368 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-6398e2c8-2d36-447e-a53a-0482db721fd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:34.319963 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398e2c8-2d36-447e-a53a-0482db721fd3 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:34.393621 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793770e3-e9f7-4d69-acc7-e074ba17407f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:34.395501 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-793770e3-e9f7-4d69-acc7-e074ba17407f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:34.403790 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87efa21b-3ae0-4d7e-8ff3-8c4f5955bc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:34.404636 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efa21b-3ae0-4d7e-8ff3-8c4f5955bc41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:34.405012 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efa21b-3ae0-4d7e-8ff3-8c4f5955bc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:34.405472 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efa21b-3ae0-4d7e-8ff3-8c4f5955bc41 admin admin] PATH_INFO: `/v3/projects/048c11136b544569a6193370a22460a2` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:34.409883 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793770e3-e9f7-4d69-acc7-e074ba17407f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:34.414774 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387ace9-c9a4-4a93-b6f2-a9c6464e4040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:34.415326 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387ace9-c9a4-4a93-b6f2-a9c6464e4040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:34.416212 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387ace9-c9a4-4a93-b6f2-a9c6464e4040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:34.417208 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387ace9-c9a4-4a93-b6f2-a9c6464e4040 admin admin] PATH_INFO: `/v3/projects/f859bac32708481e9a76e304f30e12eb` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:34.418430 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387ace9-c9a4-4a93-b6f2-a9c6464e4040 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f859bac32708481e9a76e304f30e12eb)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:34.420400 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387ace9-c9a4-4a93-b6f2-a9c6464e4040 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:34.432701 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87efa21b-3ae0-4d7e-8ff3-8c4f5955bc41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=048c11136b544569a6193370a22460a2)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:34.435185 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87efa21b-3ae0-4d7e-8ff3-8c4f5955bc41 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:34.476962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:34:34.481958 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d387ace9-c9a4-4a93-b6f2-a9c6464e4040 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f859bac32708481e9a76e304f30e12eb', 'request_id': 'req-d387ace9-c9a4-4a93-b6f2-a9c6464e4040'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:34.491847 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d387ace9-c9a4-4a93-b6f2-a9c6464e4040 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f859bac32708481e9a76e304f30e12eb', 'request_id': 'req-d387ace9-c9a4-4a93-b6f2-a9c6464e4040'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:34.499561 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-87efa21b-3ae0-4d7e-8ff3-8c4f5955bc41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '048c11136b544569a6193370a22460a2', 'request_id': 'req-87efa21b-3ae0-4d7e-8ff3-8c4f5955bc41'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:34.502002 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d387ace9-c9a4-4a93-b6f2-a9c6464e4040 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f859bac32708481e9a76e304f30e12eb', 'request_id': 'req-d387ace9-c9a4-4a93-b6f2-a9c6464e4040'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:34.511774 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-87efa21b-3ae0-4d7e-8ff3-8c4f5955bc41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '048c11136b544569a6193370a22460a2', 'request_id': 'req-87efa21b-3ae0-4d7e-8ff3-8c4f5955bc41'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:34.515143 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d387ace9-c9a4-4a93-b6f2-a9c6464e4040 admin admin] The token cache is being invalidate because project f859bac32708481e9a76e304f30e12eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:34:34.515437 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d387ace9-c9a4-4a93-b6f2-a9c6464e4040 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:34.516195 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d387ace9-c9a4-4a93-b6f2-a9c6464e4040 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:34.517669 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1216/2414] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:34:34 2022] DELETE /identity/v3/projects/f859bac32708481e9a76e304f30e12eb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:34:34.532535 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-87efa21b-3ae0-4d7e-8ff3-8c4f5955bc41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '048c11136b544569a6193370a22460a2', 'request_id': 'req-87efa21b-3ae0-4d7e-8ff3-8c4f5955bc41'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:34.546067 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-87efa21b-3ae0-4d7e-8ff3-8c4f5955bc41 admin admin] The token cache is being invalidate because project 048c11136b544569a6193370a22460a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:34:34.546290 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-87efa21b-3ae0-4d7e-8ff3-8c4f5955bc41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:34.547141 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-87efa21b-3ae0-4d7e-8ff3-8c4f5955bc41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:34.551934 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1199/2415] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:34:34 2022] DELETE /identity/v3/projects/048c11136b544569a6193370a22460a2 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:34:34.554095 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f3635-2dce-4112-a574-b240b359b95f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:34.554386 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f3635-2dce-4112-a574-b240b359b95f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:34.554693 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f3635-2dce-4112-a574-b240b359b95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:34.576937 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-ee0f3635-2dce-4112-a574-b240b359b95f None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:34:34.578167 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ee0f3635-2dce-4112-a574-b240b359b95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:34.644184 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1217/2416] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:34:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:34:34.653659 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d20ebf-f620-4638-879c-6acb87e14717 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:34.654137 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d20ebf-f620-4638-879c-6acb87e14717 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:34.654598 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d20ebf-f620-4638-879c-6acb87e14717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:34.677624 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-c5d20ebf-f620-4638-879c-6acb87e14717 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:34:34.679152 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c5d20ebf-f620-4638-879c-6acb87e14717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:34.687992 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1200/2417] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:34:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:34:34.692503 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f3635-2dce-4112-a574-b240b359b95f None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:34.703307 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f3635-2dce-4112-a574-b240b359b95f None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:34.708418 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7abd68d-e0dc-457a-8924-24d0069bf941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:34.709084 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abd68d-e0dc-457a-8924-24d0069bf941 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:34.709366 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abd68d-e0dc-457a-8924-24d0069bf941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:34.709640 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abd68d-e0dc-457a-8924-24d0069bf941 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:34.710337 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7abd68d-e0dc-457a-8924-24d0069bf941 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:34:34.710641 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7abd68d-e0dc-457a-8924-24d0069bf941 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:34.712935 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7abd68d-e0dc-457a-8924-24d0069bf941 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:34.730608 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1218/2418] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:34:34.731772 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d20ebf-f620-4638-879c-6acb87e14717 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:34.741556 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d20ebf-f620-4638-879c-6acb87e14717 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:34.746940 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cec241-551a-41c8-9494-15b83aedcbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:34.747564 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cec241-551a-41c8-9494-15b83aedcbde admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:34.747841 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cec241-551a-41c8-9494-15b83aedcbde admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:34.748151 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cec241-551a-41c8-9494-15b83aedcbde admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:34.748822 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cec241-551a-41c8-9494-15b83aedcbde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:34.750828 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cec241-551a-41c8-9494-15b83aedcbde admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:34.788091 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1201/2419] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:34:34 2022] POST /identity/v3/projects => generated 369 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:34:34.792431 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7abd68d-e0dc-457a-8924-24d0069bf941 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:34.802512 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7abd68d-e0dc-457a-8924-24d0069bf941 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:34.850510 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:34:34.863295 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742b090-f28e-41dc-9c3b-e831a16e9042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:34.864804 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742b090-f28e-41dc-9c3b-e831a16e9042 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:34.865300 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742b090-f28e-41dc-9c3b-e831a16e9042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:34.865804 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742b090-f28e-41dc-9c3b-e831a16e9042 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:34.866463 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742b090-f28e-41dc-9c3b-e831a16e9042 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:34.869323 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742b090-f28e-41dc-9c3b-e831a16e9042 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:34.891303 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1219/2420] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:34:34 2022] POST /identity/v3/users => generated 285 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:34:34.895457 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cec241-551a-41c8-9494-15b83aedcbde admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:34.906136 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cec241-551a-41c8-9494-15b83aedcbde admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:34.910662 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870363bb-bebd-4851-9ac6-1ccc870858df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:34.911248 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870363bb-bebd-4851-9ac6-1ccc870858df admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:34.911529 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870363bb-bebd-4851-9ac6-1ccc870858df admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:34.911797 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870363bb-bebd-4851-9ac6-1ccc870858df admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:34.912463 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870363bb-bebd-4851-9ac6-1ccc870858df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:34.914026 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870363bb-bebd-4851-9ac6-1ccc870858df admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:34.924616 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1202/2421] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:34:34.928596 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742b090-f28e-41dc-9c3b-e831a16e9042 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:34.938665 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742b090-f28e-41dc-9c3b-e831a16e9042 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:34.943225 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7853b098-b6a6-4f52-abba-d30c4de29011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:34.943817 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853b098-b6a6-4f52-abba-d30c4de29011 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:34.944133 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853b098-b6a6-4f52-abba-d30c4de29011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:34.944409 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853b098-b6a6-4f52-abba-d30c4de29011 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:34.945039 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7853b098-b6a6-4f52-abba-d30c4de29011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:34.947181 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7853b098-b6a6-4f52-abba-d30c4de29011 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:34.957717 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1220/2422] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:34:34.961677 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870363bb-bebd-4851-9ac6-1ccc870858df admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:34.972153 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870363bb-bebd-4851-9ac6-1ccc870858df admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:34.976681 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d1224-eae8-4f9a-99db-fbe2cf9213b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:34.977488 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d1224-eae8-4f9a-99db-fbe2cf9213b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:34.977773 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d1224-eae8-4f9a-99db-fbe2cf9213b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:34.978386 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d1224-eae8-4f9a-99db-fbe2cf9213b1 admin admin] PATH_INFO: `/v3/projects/22991e98a7a342f3a48c0bb147b4ecf5/users/f6dbb44f7074407d81182312917a7d00/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:34.992854 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d1224-eae8-4f9a-99db-fbe2cf9213b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22991e98a7a342f3a48c0bb147b4ecf5, user_id=f6dbb44f7074407d81182312917a7d00, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:34.995670 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d1224-eae8-4f9a-99db-fbe2cf9213b1 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:35.009730 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1203/2423] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:34:34 2022] PUT /identity/v3/projects/22991e98a7a342f3a48c0bb147b4ecf5/users/f6dbb44f7074407d81182312917a7d00/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:34:35.020950 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ace897-b226-4d98-a933-414330228d2f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:35.021241 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ace897-b226-4d98-a933-414330228d2f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:35.021525 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ace897-b226-4d98-a933-414330228d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:35.050719 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f4ace897-b226-4d98-a933-414330228d2f None None] MFA Rules not processed for user `f6dbb44f7074407d81182312917a7d00`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:34:35.052228 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f4ace897-b226-4d98-a933-414330228d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:35.118145 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1221/2424] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:34:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:34:35.123511 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d1224-eae8-4f9a-99db-fbe2cf9213b1 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:35.184227 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d1224-eae8-4f9a-99db-fbe2cf9213b1 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:35.188922 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069586fc-deed-4c87-aa00-c7d3080f079b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:35.189529 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069586fc-deed-4c87-aa00-c7d3080f079b admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:35.189806 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069586fc-deed-4c87-aa00-c7d3080f079b admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:35.190106 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069586fc-deed-4c87-aa00-c7d3080f079b admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:35.190728 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069586fc-deed-4c87-aa00-c7d3080f079b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:35.192671 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069586fc-deed-4c87-aa00-c7d3080f079b admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:35.218168 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1204/2425] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:34:35 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:34:35.222261 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ace897-b226-4d98-a933-414330228d2f None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:35.233551 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ace897-b226-4d98-a933-414330228d2f None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:35.289213 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab3f16-03a1-45bf-9bd0-b00dcbf8e9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:35.289838 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab3f16-03a1-45bf-9bd0-b00dcbf8e9cb admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:35.290113 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab3f16-03a1-45bf-9bd0-b00dcbf8e9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:35.290881 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab3f16-03a1-45bf-9bd0-b00dcbf8e9cb admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:35.291924 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab3f16-03a1-45bf-9bd0-b00dcbf8e9cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:35.293820 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab3f16-03a1-45bf-9bd0-b00dcbf8e9cb admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:35.314639 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1222/2426] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:34:35 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:34:35.318655 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069586fc-deed-4c87-aa00-c7d3080f079b admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:35.329009 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069586fc-deed-4c87-aa00-c7d3080f079b admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:35.333852 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878efa0-19ad-46c6-ad07-b94330eb63e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:35.334449 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878efa0-19ad-46c6-ad07-b94330eb63e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:35.334726 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878efa0-19ad-46c6-ad07-b94330eb63e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:35.334998 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878efa0-19ad-46c6-ad07-b94330eb63e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:35.335634 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e878efa0-19ad-46c6-ad07-b94330eb63e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:35.337783 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e878efa0-19ad-46c6-ad07-b94330eb63e1 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:35.348622 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1205/2427] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:34:35.360269 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab3f16-03a1-45bf-9bd0-b00dcbf8e9cb admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:35.364043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab3f16-03a1-45bf-9bd0-b00dcbf8e9cb admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:35.369264 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bda33c-8f19-4fab-8bfb-9ff0bb02a94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:35.369871 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bda33c-8f19-4fab-8bfb-9ff0bb02a94d admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:35.370149 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bda33c-8f19-4fab-8bfb-9ff0bb02a94d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:35.370724 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bda33c-8f19-4fab-8bfb-9ff0bb02a94d admin admin] PATH_INFO: `/v3/projects/06b3fb891a294fbb84784d0e3bfe31d3/users/9a150aed63a546aaba801a7a5075c898/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:35.387603 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bda33c-8f19-4fab-8bfb-9ff0bb02a94d admin admin] RBAC: Authorizing `identity:create_grant(project_id=06b3fb891a294fbb84784d0e3bfe31d3, user_id=9a150aed63a546aaba801a7a5075c898, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:35.390270 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bda33c-8f19-4fab-8bfb-9ff0bb02a94d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:35.404986 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1223/2428] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:34:35 2022] PUT /identity/v3/projects/06b3fb891a294fbb84784d0e3bfe31d3/users/9a150aed63a546aaba801a7a5075c898/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:34:35.408792 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878efa0-19ad-46c6-ad07-b94330eb63e1 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:35.419348 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878efa0-19ad-46c6-ad07-b94330eb63e1 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:35.438134 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:34:35.488265 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b81b46-54c5-4c53-a0c5-95c1bc456127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:35.488943 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b81b46-54c5-4c53-a0c5-95c1bc456127 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:35.489287 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b81b46-54c5-4c53-a0c5-95c1bc456127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:35.489657 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b81b46-54c5-4c53-a0c5-95c1bc456127 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:35.491070 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b81b46-54c5-4c53-a0c5-95c1bc456127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:35.492965 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b81b46-54c5-4c53-a0c5-95c1bc456127 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:35.504694 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1206/2429] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:34:35.508682 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bda33c-8f19-4fab-8bfb-9ff0bb02a94d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:35.520027 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bda33c-8f19-4fab-8bfb-9ff0bb02a94d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:35.534240 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c519145-f744-4d83-9039-7d7dc9c92481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:35.534240 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c519145-f744-4d83-9039-7d7dc9c92481 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:35.534240 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c519145-f744-4d83-9039-7d7dc9c92481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:35.534240 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c519145-f744-4d83-9039-7d7dc9c92481 admin admin] PATH_INFO: `/v3/projects/06b3fb891a294fbb84784d0e3bfe31d3/users/9a150aed63a546aaba801a7a5075c898/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:35.534649 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c519145-f744-4d83-9039-7d7dc9c92481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06b3fb891a294fbb84784d0e3bfe31d3, user_id=9a150aed63a546aaba801a7a5075c898, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:35.534649 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c519145-f744-4d83-9039-7d7dc9c92481 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:35.543585 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1224/2430] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:34:35 2022] PUT /identity/v3/projects/06b3fb891a294fbb84784d0e3bfe31d3/users/9a150aed63a546aaba801a7a5075c898/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:34:35.555338 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b1290-74f1-4fa4-bbf5-bd1bccbf9206 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:35.555747 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b1290-74f1-4fa4-bbf5-bd1bccbf9206 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:35.556541 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b1290-74f1-4fa4-bbf5-bd1bccbf9206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:35.587076 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-386b1290-74f1-4fa4-bbf5-bd1bccbf9206 None None] MFA Rules not processed for user `9a150aed63a546aaba801a7a5075c898`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:34:35.588575 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-386b1290-74f1-4fa4-bbf5-bd1bccbf9206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:35.655489 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1207/2431] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:34:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:34:35.667386 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c519145-f744-4d83-9039-7d7dc9c92481 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:35.669091 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8c519145-f744-4d83-9039-7d7dc9c92481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:35.684544 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:34:35.728852 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c519145-f744-4d83-9039-7d7dc9c92481 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:35.732501 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be2925-8b5b-4018-b85e-654f00f78a01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:35.733100 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be2925-8b5b-4018-b85e-654f00f78a01 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:35.733376 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be2925-8b5b-4018-b85e-654f00f78a01 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:35.733643 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be2925-8b5b-4018-b85e-654f00f78a01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:35.742394 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be2925-8b5b-4018-b85e-654f00f78a01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:35.744539 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be2925-8b5b-4018-b85e-654f00f78a01 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:35.753697 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1225/2432] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:34:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:34:35.828069 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b1290-74f1-4fa4-bbf5-bd1bccbf9206 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:35.838249 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b1290-74f1-4fa4-bbf5-bd1bccbf9206 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:35.841851 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51a533-47d6-4201-8210-173b7345541b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:35.842438 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51a533-47d6-4201-8210-173b7345541b service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:35.842716 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51a533-47d6-4201-8210-173b7345541b service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:35.842989 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51a533-47d6-4201-8210-173b7345541b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:35.900854 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee51a533-47d6-4201-8210-173b7345541b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:35.902334 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee51a533-47d6-4201-8210-173b7345541b service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:35.911172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1208/2433] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:34:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:34:41.040255 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be2925-8b5b-4018-b85e-654f00f78a01 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:41.041946 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-96be2925-8b5b-4018-b85e-654f00f78a01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:41.109987 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be2925-8b5b-4018-b85e-654f00f78a01 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:41.114787 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c3828-b641-4a52-9889-24f50aea764f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:41.115413 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c3828-b641-4a52-9889-24f50aea764f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:41.115691 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c3828-b641-4a52-9889-24f50aea764f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:41.116002 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c3828-b641-4a52-9889-24f50aea764f admin admin] PATH_INFO: `/v3/users/e88cff8ae950433297fa205a1115f421` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:41.117116 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9c3828-b641-4a52-9889-24f50aea764f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e88cff8ae950433297fa205a1115f421)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:41.119684 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9c3828-b641-4a52-9889-24f50aea764f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:41.165442 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7d9c3828-b641-4a52-9889-24f50aea764f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e88cff8ae950433297fa205a1115f421'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:41.166116 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7d9c3828-b641-4a52-9889-24f50aea764f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e88cff8ae950433297fa205a1115f421'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:41.178326 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7d9c3828-b641-4a52-9889-24f50aea764f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e88cff8ae950433297fa205a1115f421'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:41.185823 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7d9c3828-b641-4a52-9889-24f50aea764f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e88cff8ae950433297fa205a1115f421'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:41.192757 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7d9c3828-b641-4a52-9889-24f50aea764f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e88cff8ae950433297fa205a1115f421'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:41.200113 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1226/2434] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:34:41 2022] DELETE /identity/v3/users/e88cff8ae950433297fa205a1115f421 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:34:41.204704 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845c3ba-eb00-493d-a6b4-6e116e025dea None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:41.205174 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845c3ba-eb00-493d-a6b4-6e116e025dea None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:41.205275 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845c3ba-eb00-493d-a6b4-6e116e025dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:41.224980 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-0845c3ba-eb00-493d-a6b4-6e116e025dea None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:34:41.226460 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-0845c3ba-eb00-493d-a6b4-6e116e025dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:41.264333 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:34:41.285037 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1209/2435] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:34:41.294793 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c3828-b641-4a52-9889-24f50aea764f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:41.296462 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7d9c3828-b641-4a52-9889-24f50aea764f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:41.338256 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:34:41.357527 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c3828-b641-4a52-9889-24f50aea764f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:41.361234 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55b5be-75e4-4f16-a872-f0a7c31c017d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:41.361843 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55b5be-75e4-4f16-a872-f0a7c31c017d service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:41.362126 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55b5be-75e4-4f16-a872-f0a7c31c017d service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:41.362444 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55b5be-75e4-4f16-a872-f0a7c31c017d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:41.371984 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55b5be-75e4-4f16-a872-f0a7c31c017d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:41.373407 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55b5be-75e4-4f16-a872-f0a7c31c017d service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:41.382865 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1227/2436] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:34:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:34:41.671973 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845c3ba-eb00-493d-a6b4-6e116e025dea None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:41.673472 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-0845c3ba-eb00-493d-a6b4-6e116e025dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:41.687049 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845c3ba-eb00-493d-a6b4-6e116e025dea None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:41.687470 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55b5be-75e4-4f16-a872-f0a7c31c017d service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:41.688926 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5e55b5be-75e4-4f16-a872-f0a7c31c017d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:41.692368 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31fe8b-ed65-4f54-9b7a-6888d14b0374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:41.693779 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31fe8b-ed65-4f54-9b7a-6888d14b0374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:41.694154 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31fe8b-ed65-4f54-9b7a-6888d14b0374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:41.694770 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31fe8b-ed65-4f54-9b7a-6888d14b0374 admin admin] PATH_INFO: `/v3/projects/06000ba8a349460ea771eb50bec33567` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:41.696076 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31fe8b-ed65-4f54-9b7a-6888d14b0374 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06000ba8a349460ea771eb50bec33567)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:41.698658 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31fe8b-ed65-4f54-9b7a-6888d14b0374 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:41.704155 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55b5be-75e4-4f16-a872-f0a7c31c017d service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:41.709137 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5ccd0-87a4-4806-8356-7e8885f6ddb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:41.709806 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5ccd0-87a4-4806-8356-7e8885f6ddb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:41.710088 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5ccd0-87a4-4806-8356-7e8885f6ddb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:41.710505 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5ccd0-87a4-4806-8356-7e8885f6ddb4 admin admin] PATH_INFO: `/v3/users/6cbe4dacb6e94ea1a9161d2ff375a13c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:41.711636 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5ccd0-87a4-4806-8356-7e8885f6ddb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cbe4dacb6e94ea1a9161d2ff375a13c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:41.714420 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5ccd0-87a4-4806-8356-7e8885f6ddb4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:41.762530 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-9c31fe8b-ed65-4f54-9b7a-6888d14b0374 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06000ba8a349460ea771eb50bec33567', 'request_id': 'req-9c31fe8b-ed65-4f54-9b7a-6888d14b0374'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:41.769856 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-9c31fe8b-ed65-4f54-9b7a-6888d14b0374 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06000ba8a349460ea771eb50bec33567', 'request_id': 'req-9c31fe8b-ed65-4f54-9b7a-6888d14b0374'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:41.781350 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-9c31fe8b-ed65-4f54-9b7a-6888d14b0374 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06000ba8a349460ea771eb50bec33567', 'request_id': 'req-9c31fe8b-ed65-4f54-9b7a-6888d14b0374'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:41.787122 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-59d5ccd0-87a4-4806-8356-7e8885f6ddb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cbe4dacb6e94ea1a9161d2ff375a13c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:41.787956 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-59d5ccd0-87a4-4806-8356-7e8885f6ddb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cbe4dacb6e94ea1a9161d2ff375a13c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:41.793977 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-9c31fe8b-ed65-4f54-9b7a-6888d14b0374 admin admin] The token cache is being invalidate because project 06000ba8a349460ea771eb50bec33567 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:34:41.794362 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-9c31fe8b-ed65-4f54-9b7a-6888d14b0374 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:41.795656 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-9c31fe8b-ed65-4f54-9b7a-6888d14b0374 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:41.797945 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1210/2437] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:34:41 2022] DELETE /identity/v3/projects/06000ba8a349460ea771eb50bec33567 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:34:41.802421 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda88b15-50fe-4281-b7a1-8497ce21ec19 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:41.802690 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda88b15-50fe-4281-b7a1-8497ce21ec19 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:41.803090 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda88b15-50fe-4281-b7a1-8497ce21ec19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:41.806001 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-59d5ccd0-87a4-4806-8356-7e8885f6ddb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cbe4dacb6e94ea1a9161d2ff375a13c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:41.816910 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-59d5ccd0-87a4-4806-8356-7e8885f6ddb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cbe4dacb6e94ea1a9161d2ff375a13c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:41.825384 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-bda88b15-50fe-4281-b7a1-8497ce21ec19 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:34:41.826599 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-bda88b15-50fe-4281-b7a1-8497ce21ec19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:41.827472 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-59d5ccd0-87a4-4806-8356-7e8885f6ddb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cbe4dacb6e94ea1a9161d2ff375a13c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:41.834462 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1228/2438] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:34:41 2022] DELETE /identity/v3/users/6cbe4dacb6e94ea1a9161d2ff375a13c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:34:41.840476 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02405ae-3b7b-4312-8c3e-d80ee0a60e1d None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:41.842225 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02405ae-3b7b-4312-8c3e-d80ee0a60e1d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:41.842531 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02405ae-3b7b-4312-8c3e-d80ee0a60e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:41.866451 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f02405ae-3b7b-4312-8c3e-d80ee0a60e1d None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:34:41.868676 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f02405ae-3b7b-4312-8c3e-d80ee0a60e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:41.898183 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1211/2439] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:34:41.908089 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b3fbf-8e0e-46fa-ad44-f7b145a542b6 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:41.908445 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b3fbf-8e0e-46fa-ad44-f7b145a542b6 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:41.908740 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b3fbf-8e0e-46fa-ad44-f7b145a542b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:41.929534 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-ec3b3fbf-8e0e-46fa-ad44-f7b145a542b6 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:34:41.930733 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ec3b3fbf-8e0e-46fa-ad44-f7b145a542b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:41.933336 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1229/2440] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:34:41.939991 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1212/2441] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:34:41.944044 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02405ae-3b7b-4312-8c3e-d80ee0a60e1d None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:41.944879 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b3fbf-8e0e-46fa-ad44-f7b145a542b6 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:41.945418 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f02405ae-3b7b-4312-8c3e-d80ee0a60e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:41.954582 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b3fbf-8e0e-46fa-ad44-f7b145a542b6 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:41.959523 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb88ea9-6699-4944-81a9-8f67ac5e393d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:41.960152 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb88ea9-6699-4944-81a9-8f67ac5e393d admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:41.960429 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb88ea9-6699-4944-81a9-8f67ac5e393d admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:41.960864 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb88ea9-6699-4944-81a9-8f67ac5e393d admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:41.961535 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb88ea9-6699-4944-81a9-8f67ac5e393d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:34:41.961836 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb88ea9-6699-4944-81a9-8f67ac5e393d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:41.963469 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb88ea9-6699-4944-81a9-8f67ac5e393d admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:41.975980 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1213/2442] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:34:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:34:41.981999 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb88ea9-6699-4944-81a9-8f67ac5e393d admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:41.994509 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb88ea9-6699-4944-81a9-8f67ac5e393d admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:42.000189 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc09c0c-4686-46c5-9ab1-17a84a92efc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:42.001359 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc09c0c-4686-46c5-9ab1-17a84a92efc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:42.001667 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc09c0c-4686-46c5-9ab1-17a84a92efc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:42.001944 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc09c0c-4686-46c5-9ab1-17a84a92efc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:42.002654 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc09c0c-4686-46c5-9ab1-17a84a92efc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:42.004734 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc09c0c-4686-46c5-9ab1-17a84a92efc9 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:42.016222 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02405ae-3b7b-4312-8c3e-d80ee0a60e1d None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:42.020349 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc867e-5e3f-490b-82b3-8c5d85681049 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:42.020971 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc867e-5e3f-490b-82b3-8c5d85681049 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:42.021237 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc867e-5e3f-490b-82b3-8c5d85681049 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:42.021554 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc867e-5e3f-490b-82b3-8c5d85681049 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:42.030802 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:34:42.033214 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1214/2443] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:34:41 2022] POST /identity/v3/projects => generated 397 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:34:42.033857 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc867e-5e3f-490b-82b3-8c5d85681049 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:42.037249 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc867e-5e3f-490b-82b3-8c5d85681049 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:42.037489 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc09c0c-4686-46c5-9ab1-17a84a92efc9 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:42.049467 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1230/2444] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:34:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 13:34:42.067141 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:34:42.106497 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc09c0c-4686-46c5-9ab1-17a84a92efc9 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:42.111356 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774e5f3-79c1-476b-9f16-09b302cae28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:42.111988 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774e5f3-79c1-476b-9f16-09b302cae28b admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:42.112260 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774e5f3-79c1-476b-9f16-09b302cae28b admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:42.112517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774e5f3-79c1-476b-9f16-09b302cae28b admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:42.113138 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a774e5f3-79c1-476b-9f16-09b302cae28b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:42.115028 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a774e5f3-79c1-476b-9f16-09b302cae28b admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:42.138288 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1215/2445] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:34:42 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:34:42.142709 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc867e-5e3f-490b-82b3-8c5d85681049 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:42.153750 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc867e-5e3f-490b-82b3-8c5d85681049 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:42.158579 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ee6cd-fbeb-417f-86f3-003175eadde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:42.159179 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ee6cd-fbeb-417f-86f3-003175eadde6 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:42.159460 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ee6cd-fbeb-417f-86f3-003175eadde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:42.159760 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ee6cd-fbeb-417f-86f3-003175eadde6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:42.160477 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ee6cd-fbeb-417f-86f3-003175eadde6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:42.162059 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ee6cd-fbeb-417f-86f3-003175eadde6 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:42.173192 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1231/2446] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:34:42.177425 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774e5f3-79c1-476b-9f16-09b302cae28b admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:42.188890 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774e5f3-79c1-476b-9f16-09b302cae28b admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:42.193673 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5bd673-9ba4-4963-af15-a1ef1f5c6b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:42.194374 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5bd673-9ba4-4963-af15-a1ef1f5c6b1f admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:42.195287 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5bd673-9ba4-4963-af15-a1ef1f5c6b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:42.195784 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5bd673-9ba4-4963-af15-a1ef1f5c6b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:42.197464 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5bd673-9ba4-4963-af15-a1ef1f5c6b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:42.199563 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5bd673-9ba4-4963-af15-a1ef1f5c6b1f admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:42.210234 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1216/2447] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:34:42.214520 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ee6cd-fbeb-417f-86f3-003175eadde6 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:42.225092 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ee6cd-fbeb-417f-86f3-003175eadde6 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:42.230108 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2acf6c-e1e3-4dbd-a57e-627b062268c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:42.230831 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2acf6c-e1e3-4dbd-a57e-627b062268c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:42.231116 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2acf6c-e1e3-4dbd-a57e-627b062268c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:42.231393 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2acf6c-e1e3-4dbd-a57e-627b062268c7 admin admin] PATH_INFO: `/v3/projects/4820eaf85bfa45f4b749429889b38b85/users/3e47fb7c117445c99f9584e31dfe98d7/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:42.248243 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2acf6c-e1e3-4dbd-a57e-627b062268c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4820eaf85bfa45f4b749429889b38b85, user_id=3e47fb7c117445c99f9584e31dfe98d7, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:42.250885 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2acf6c-e1e3-4dbd-a57e-627b062268c7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:42.264851 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1232/2448] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:34:42 2022] PUT /identity/v3/projects/4820eaf85bfa45f4b749429889b38b85/users/3e47fb7c117445c99f9584e31dfe98d7/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:34:42.275102 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7340a74-e965-4354-b52f-85d2b64165fa None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:42.275381 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7340a74-e965-4354-b52f-85d2b64165fa None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:42.275662 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7340a74-e965-4354-b52f-85d2b64165fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:42.306927 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-d7340a74-e965-4354-b52f-85d2b64165fa None None] MFA Rules not processed for user `3e47fb7c117445c99f9584e31dfe98d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:34:42.308148 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-d7340a74-e965-4354-b52f-85d2b64165fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:42.349100 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2acf6c-e1e3-4dbd-a57e-627b062268c7 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:42.351073 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-db2acf6c-e1e3-4dbd-a57e-627b062268c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:42.381898 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1217/2449] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:34:42 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:34:42.393657 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7340a74-e965-4354-b52f-85d2b64165fa None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:42.395088 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-d7340a74-e965-4354-b52f-85d2b64165fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:42.424836 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2acf6c-e1e3-4dbd-a57e-627b062268c7 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:42.431823 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7235677-b919-48a0-8991-60159933bc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:42.432764 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7235677-b919-48a0-8991-60159933bc71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:42.433131 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7235677-b919-48a0-8991-60159933bc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:42.433534 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7235677-b919-48a0-8991-60159933bc71 admin admin] PATH_INFO: `/v3/projects/5febc28424d449fe9dd602a3c24d50f2` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:42.435495 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7235677-b919-48a0-8991-60159933bc71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5febc28424d449fe9dd602a3c24d50f2)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:42.437684 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7235677-b919-48a0-8991-60159933bc71 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:42.454268 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7340a74-e965-4354-b52f-85d2b64165fa None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:42.457808 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05040332-1fd2-40b2-8acb-7caae64442cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:42.458411 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05040332-1fd2-40b2-8acb-7caae64442cb service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:42.458685 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05040332-1fd2-40b2-8acb-7caae64442cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:42.458954 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05040332-1fd2-40b2-8acb-7caae64442cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:42.467856 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05040332-1fd2-40b2-8acb-7caae64442cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:42.469330 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05040332-1fd2-40b2-8acb-7caae64442cb service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:42.478898 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1218/2450] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:34:42 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 13:34:42.485965 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d7235677-b919-48a0-8991-60159933bc71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5febc28424d449fe9dd602a3c24d50f2', 'request_id': 'req-d7235677-b919-48a0-8991-60159933bc71'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:42.495409 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d7235677-b919-48a0-8991-60159933bc71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5febc28424d449fe9dd602a3c24d50f2', 'request_id': 'req-d7235677-b919-48a0-8991-60159933bc71'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:42.505982 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d7235677-b919-48a0-8991-60159933bc71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5febc28424d449fe9dd602a3c24d50f2', 'request_id': 'req-d7235677-b919-48a0-8991-60159933bc71'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:42.513473 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d7235677-b919-48a0-8991-60159933bc71 admin admin] The token cache is being invalidate because project 5febc28424d449fe9dd602a3c24d50f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:34:42.513759 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d7235677-b919-48a0-8991-60159933bc71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:42.514421 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d7235677-b919-48a0-8991-60159933bc71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:42.515943 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1233/2451] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:34:42 2022] DELETE /identity/v3/projects/5febc28424d449fe9dd602a3c24d50f2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:34:42.520877 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a02e22-d797-42fe-a84d-5a696f5611ff None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:42.521249 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a02e22-d797-42fe-a84d-5a696f5611ff None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:42.521600 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a02e22-d797-42fe-a84d-5a696f5611ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:42.543860 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-a8a02e22-d797-42fe-a84d-5a696f5611ff None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:34:42.545166 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a8a02e22-d797-42fe-a84d-5a696f5611ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:42.576348 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:34:42.618088 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1219/2452] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:34:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:34:42.621344 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1e65e-7959-4f21-bfde-105331690a24 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:42.621697 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1e65e-7959-4f21-bfde-105331690a24 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:42.622037 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1e65e-7959-4f21-bfde-105331690a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:42.642744 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-dcc1e65e-7959-4f21-bfde-105331690a24 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:34:42.643962 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-dcc1e65e-7959-4f21-bfde-105331690a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:42.652617 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1234/2453] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:34:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:34:42.656692 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a02e22-d797-42fe-a84d-5a696f5611ff None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:42.666464 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a02e22-d797-42fe-a84d-5a696f5611ff None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:42.671076 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d469867-d9c9-4d82-8a15-c882e8cbf7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:42.671673 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d469867-d9c9-4d82-8a15-c882e8cbf7da admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:42.672221 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d469867-d9c9-4d82-8a15-c882e8cbf7da admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:42.672858 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d469867-d9c9-4d82-8a15-c882e8cbf7da admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:42.673118 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d469867-d9c9-4d82-8a15-c882e8cbf7da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:34:42.673413 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d469867-d9c9-4d82-8a15-c882e8cbf7da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:42.674979 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d469867-d9c9-4d82-8a15-c882e8cbf7da admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:42.687829 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1220/2454] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:34:42.692076 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1e65e-7959-4f21-bfde-105331690a24 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:42.702013 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1e65e-7959-4f21-bfde-105331690a24 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:42.706711 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350bec2-7c24-423f-a930-bdb86d759a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:42.707243 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350bec2-7c24-423f-a930-bdb86d759a31 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:42.707511 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350bec2-7c24-423f-a930-bdb86d759a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:42.707783 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350bec2-7c24-423f-a930-bdb86d759a31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:42.708434 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5350bec2-7c24-423f-a930-bdb86d759a31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:42.710323 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5350bec2-7c24-423f-a930-bdb86d759a31 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:42.748724 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1235/2455] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:34:42 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:34:42.753162 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d469867-d9c9-4d82-8a15-c882e8cbf7da admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:42.764019 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d469867-d9c9-4d82-8a15-c882e8cbf7da admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:42.828008 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750af1b8-ff2b-4447-b5e4-4e0c478af889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:42.828643 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750af1b8-ff2b-4447-b5e4-4e0c478af889 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:42.829055 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750af1b8-ff2b-4447-b5e4-4e0c478af889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:42.829288 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750af1b8-ff2b-4447-b5e4-4e0c478af889 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:42.829905 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750af1b8-ff2b-4447-b5e4-4e0c478af889 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:42.831803 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750af1b8-ff2b-4447-b5e4-4e0c478af889 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:42.852813 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1221/2456] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:34:42 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:34:42.856955 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350bec2-7c24-423f-a930-bdb86d759a31 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:42.876714 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350bec2-7c24-423f-a930-bdb86d759a31 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:42.887690 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85750374-9b09-4d02-a507-e902c8dc06e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:42.888571 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85750374-9b09-4d02-a507-e902c8dc06e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:42.888865 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85750374-9b09-4d02-a507-e902c8dc06e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:42.889112 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85750374-9b09-4d02-a507-e902c8dc06e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:42.889898 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85750374-9b09-4d02-a507-e902c8dc06e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:42.891639 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85750374-9b09-4d02-a507-e902c8dc06e2 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:42.907384 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1236/2457] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:34:42.909155 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750af1b8-ff2b-4447-b5e4-4e0c478af889 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:42.921049 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750af1b8-ff2b-4447-b5e4-4e0c478af889 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:42.928079 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3ceff-82fb-4be7-a96f-d81f9fa6ae25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:42.929468 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3ceff-82fb-4be7-a96f-d81f9fa6ae25 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:42.929900 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3ceff-82fb-4be7-a96f-d81f9fa6ae25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:42.930727 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3ceff-82fb-4be7-a96f-d81f9fa6ae25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:42.933356 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b3ceff-82fb-4be7-a96f-d81f9fa6ae25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:42.935245 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b3ceff-82fb-4be7-a96f-d81f9fa6ae25 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:42.950161 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1222/2458] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:34:42.954200 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85750374-9b09-4d02-a507-e902c8dc06e2 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:42.973879 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85750374-9b09-4d02-a507-e902c8dc06e2 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:42.981115 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a8529-e922-4265-bfde-19b6c63d6e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:42.981826 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a8529-e922-4265-bfde-19b6c63d6e55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:42.982104 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a8529-e922-4265-bfde-19b6c63d6e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:42.982378 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a8529-e922-4265-bfde-19b6c63d6e55 admin admin] PATH_INFO: `/v3/projects/e958967d2c434bf6bf31214434a4d11c/users/e135867e0c54419ea28fbd3bce776dba/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:42.986474 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:34:43.003408 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a8529-e922-4265-bfde-19b6c63d6e55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e958967d2c434bf6bf31214434a4d11c, user_id=e135867e0c54419ea28fbd3bce776dba, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:43.006240 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a8529-e922-4265-bfde-19b6c63d6e55 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:43.020249 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1237/2459] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:34:42 2022] PUT /identity/v3/projects/e958967d2c434bf6bf31214434a4d11c/users/e135867e0c54419ea28fbd3bce776dba/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:34:43.032746 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febd216-302b-4b0f-936f-52866157716b None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:43.033149 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febd216-302b-4b0f-936f-52866157716b None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:43.033550 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febd216-302b-4b0f-936f-52866157716b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:43.063526 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-0febd216-302b-4b0f-936f-52866157716b None None] MFA Rules not processed for user `e135867e0c54419ea28fbd3bce776dba`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:34:43.064795 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-0febd216-302b-4b0f-936f-52866157716b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:43.134790 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1223/2460] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:34:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:34:43.145743 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a8529-e922-4265-bfde-19b6c63d6e55 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:43.147490 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-050a8529-e922-4265-bfde-19b6c63d6e55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:43.205327 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a8529-e922-4265-bfde-19b6c63d6e55 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:43.208990 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b37518-6f3b-4f1d-b904-944f8d3e5f2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:43.209589 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b37518-6f3b-4f1d-b904-944f8d3e5f2e service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:43.209870 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b37518-6f3b-4f1d-b904-944f8d3e5f2e service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:43.210146 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b37518-6f3b-4f1d-b904-944f8d3e5f2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:43.219060 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b37518-6f3b-4f1d-b904-944f8d3e5f2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:43.220519 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b37518-6f3b-4f1d-b904-944f8d3e5f2e service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:43.229294 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1238/2461] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:34:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:34:43.253226 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0febd216-302b-4b0f-936f-52866157716b None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:43.286688 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:34:43.316850 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0febd216-302b-4b0f-936f-52866157716b None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:43.321328 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232f7d1-8554-4245-befc-29b20755d4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:43.322965 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232f7d1-8554-4245-befc-29b20755d4ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:43.323244 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232f7d1-8554-4245-befc-29b20755d4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:43.323511 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232f7d1-8554-4245-befc-29b20755d4ef admin admin] PATH_INFO: `/v3/users/e135867e0c54419ea28fbd3bce776dba` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:43.324663 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2232f7d1-8554-4245-befc-29b20755d4ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=e135867e0c54419ea28fbd3bce776dba)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:43.326547 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2232f7d1-8554-4245-befc-29b20755d4ef admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:43.372793 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2232f7d1-8554-4245-befc-29b20755d4ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e135867e0c54419ea28fbd3bce776dba'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:43.385198 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2232f7d1-8554-4245-befc-29b20755d4ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e135867e0c54419ea28fbd3bce776dba'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:43.385866 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2232f7d1-8554-4245-befc-29b20755d4ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e135867e0c54419ea28fbd3bce776dba'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:43.393136 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2232f7d1-8554-4245-befc-29b20755d4ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e135867e0c54419ea28fbd3bce776dba'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:43.393755 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2232f7d1-8554-4245-befc-29b20755d4ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e135867e0c54419ea28fbd3bce776dba'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:43.407487 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1224/2462] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:34:43 2022] DELETE /identity/v3/users/e135867e0c54419ea28fbd3bce776dba => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:34:43.411920 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a28db-de94-4de9-9d14-e497b29130fe None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:43.412216 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a28db-de94-4de9-9d14-e497b29130fe None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:43.412491 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a28db-de94-4de9-9d14-e497b29130fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:43.434159 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-142a28db-de94-4de9-9d14-e497b29130fe None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:34:43.435352 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-142a28db-de94-4de9-9d14-e497b29130fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:43.494183 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1239/2463] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:34:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:34:43.503869 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232f7d1-8554-4245-befc-29b20755d4ef admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:43.505266 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2232f7d1-8554-4245-befc-29b20755d4ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:43.576063 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232f7d1-8554-4245-befc-29b20755d4ef admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:43.580113 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0f734-25f1-428f-8dde-0e557c79d3b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:43.580728 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0f734-25f1-428f-8dde-0e557c79d3b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:43.581004 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0f734-25f1-428f-8dde-0e557c79d3b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:43.581279 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0f734-25f1-428f-8dde-0e557c79d3b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:43.593549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0f734-25f1-428f-8dde-0e557c79d3b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:43.594971 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0f734-25f1-428f-8dde-0e557c79d3b4 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:43.605274 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1225/2464] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:34:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:34:43.917766 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a28db-de94-4de9-9d14-e497b29130fe None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:43.919209 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-142a28db-de94-4de9-9d14-e497b29130fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:43.933398 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a28db-de94-4de9-9d14-e497b29130fe None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:43.939861 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01024acc-c40a-49dd-9bdf-4b9d4d05b4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:43.940631 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01024acc-c40a-49dd-9bdf-4b9d4d05b4a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:43.941117 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01024acc-c40a-49dd-9bdf-4b9d4d05b4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:43.941465 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01024acc-c40a-49dd-9bdf-4b9d4d05b4a5 admin admin] PATH_INFO: `/v3/projects/e958967d2c434bf6bf31214434a4d11c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:43.942956 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01024acc-c40a-49dd-9bdf-4b9d4d05b4a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e958967d2c434bf6bf31214434a4d11c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:43.944911 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01024acc-c40a-49dd-9bdf-4b9d4d05b4a5 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:44.012049 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-01024acc-c40a-49dd-9bdf-4b9d4d05b4a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e958967d2c434bf6bf31214434a4d11c', 'request_id': 'req-01024acc-c40a-49dd-9bdf-4b9d4d05b4a5'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:44.020657 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-01024acc-c40a-49dd-9bdf-4b9d4d05b4a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e958967d2c434bf6bf31214434a4d11c', 'request_id': 'req-01024acc-c40a-49dd-9bdf-4b9d4d05b4a5'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:44.029782 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-01024acc-c40a-49dd-9bdf-4b9d4d05b4a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e958967d2c434bf6bf31214434a4d11c', 'request_id': 'req-01024acc-c40a-49dd-9bdf-4b9d4d05b4a5'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:44.042905 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-01024acc-c40a-49dd-9bdf-4b9d4d05b4a5 admin admin] The token cache is being invalidate because project e958967d2c434bf6bf31214434a4d11c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:34:44.043193 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-01024acc-c40a-49dd-9bdf-4b9d4d05b4a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:44.043850 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-01024acc-c40a-49dd-9bdf-4b9d4d05b4a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:44.045809 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1240/2465] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:34:43 2022] DELETE /identity/v3/projects/e958967d2c434bf6bf31214434a4d11c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:34:44.052249 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d98ea-961e-43b6-a0c4-2d5f66eee5c8 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:44.052642 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d98ea-961e-43b6-a0c4-2d5f66eee5c8 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:44.053004 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d98ea-961e-43b6-a0c4-2d5f66eee5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:44.076850 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-0c6d98ea-961e-43b6-a0c4-2d5f66eee5c8 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:34:44.078053 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-0c6d98ea-961e-43b6-a0c4-2d5f66eee5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:44.141183 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:34:44.163022 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1226/2466] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:34:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:34:44.173136 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32658b-1525-458f-86ed-08586e6917b0 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:44.173598 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32658b-1525-458f-86ed-08586e6917b0 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:44.173940 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32658b-1525-458f-86ed-08586e6917b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:44.216456 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-4c32658b-1525-458f-86ed-08586e6917b0 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:34:44.216456 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4c32658b-1525-458f-86ed-08586e6917b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:44.219556 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1241/2467] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:34:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:34:44.223739 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d98ea-961e-43b6-a0c4-2d5f66eee5c8 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:44.236810 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d98ea-961e-43b6-a0c4-2d5f66eee5c8 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:44.242273 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21136998-0665-4904-ac44-a67c4bbaf348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:44.243138 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21136998-0665-4904-ac44-a67c4bbaf348 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:44.249680 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21136998-0665-4904-ac44-a67c4bbaf348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:44.249680 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21136998-0665-4904-ac44-a67c4bbaf348 admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:44.249680 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21136998-0665-4904-ac44-a67c4bbaf348 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:34:44.249680 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21136998-0665-4904-ac44-a67c4bbaf348 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:44.250469 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21136998-0665-4904-ac44-a67c4bbaf348 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:44.267434 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1227/2468] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:34:44.273288 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32658b-1525-458f-86ed-08586e6917b0 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:44.280567 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:34:44.284930 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32658b-1525-458f-86ed-08586e6917b0 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:44.293481 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a95e7-3f91-48a5-a291-29e8f33df282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:44.294123 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a95e7-3f91-48a5-a291-29e8f33df282 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:44.294680 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a95e7-3f91-48a5-a291-29e8f33df282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:44.295134 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a95e7-3f91-48a5-a291-29e8f33df282 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:44.296104 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a95e7-3f91-48a5-a291-29e8f33df282 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:44.299249 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a95e7-3f91-48a5-a291-29e8f33df282 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:44.330106 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1242/2469] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:34:44 2022] POST /identity/v3/projects => generated 389 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:34:44.334203 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21136998-0665-4904-ac44-a67c4bbaf348 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:44.347691 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21136998-0665-4904-ac44-a67c4bbaf348 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:44.414489 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831779f7-fc08-4ddc-921b-8e0e4ec54ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:44.415093 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831779f7-fc08-4ddc-921b-8e0e4ec54ec7 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:44.416087 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831779f7-fc08-4ddc-921b-8e0e4ec54ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:44.416866 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831779f7-fc08-4ddc-921b-8e0e4ec54ec7 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:44.417515 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831779f7-fc08-4ddc-921b-8e0e4ec54ec7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:44.419713 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831779f7-fc08-4ddc-921b-8e0e4ec54ec7 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:44.451244 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1228/2470] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:34:44 2022] POST /identity/v3/users => generated 295 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:34:44.456127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a95e7-3f91-48a5-a291-29e8f33df282 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:44.468617 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a95e7-3f91-48a5-a291-29e8f33df282 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:44.473920 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce0f97-eadf-491a-a1c0-389054d9f242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:44.474555 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce0f97-eadf-491a-a1c0-389054d9f242 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:44.474829 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce0f97-eadf-491a-a1c0-389054d9f242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:44.475127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce0f97-eadf-491a-a1c0-389054d9f242 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:44.475774 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce0f97-eadf-491a-a1c0-389054d9f242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:44.478662 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce0f97-eadf-491a-a1c0-389054d9f242 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:44.492171 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1243/2471] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:34:44.497056 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831779f7-fc08-4ddc-921b-8e0e4ec54ec7 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:44.508530 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831779f7-fc08-4ddc-921b-8e0e4ec54ec7 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:44.514769 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8082b-90ab-4d45-8c39-ad5976066501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:44.515409 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8082b-90ab-4d45-8c39-ad5976066501 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:44.515733 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8082b-90ab-4d45-8c39-ad5976066501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:44.516059 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8082b-90ab-4d45-8c39-ad5976066501 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:44.516868 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8082b-90ab-4d45-8c39-ad5976066501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:44.518387 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8082b-90ab-4d45-8c39-ad5976066501 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:44.532541 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1229/2472] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:34:44.537240 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce0f97-eadf-491a-a1c0-389054d9f242 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:44.548258 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce0f97-eadf-491a-a1c0-389054d9f242 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:44.553548 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297d19d-8179-44b0-b45b-eb1c4dfcdce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:44.554201 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297d19d-8179-44b0-b45b-eb1c4dfcdce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:44.554479 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297d19d-8179-44b0-b45b-eb1c4dfcdce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:44.554751 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297d19d-8179-44b0-b45b-eb1c4dfcdce4 admin admin] PATH_INFO: `/v3/projects/72290fa7b87640f8a51ee2aa659e31a3/users/3806049cdf4e42eeafe0685a57180f65/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:44.572441 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297d19d-8179-44b0-b45b-eb1c4dfcdce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72290fa7b87640f8a51ee2aa659e31a3, user_id=3806049cdf4e42eeafe0685a57180f65, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:44.576073 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297d19d-8179-44b0-b45b-eb1c4dfcdce4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:44.589644 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1244/2473] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:34:44 2022] PUT /identity/v3/projects/72290fa7b87640f8a51ee2aa659e31a3/users/3806049cdf4e42eeafe0685a57180f65/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:34:44.659036 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed597e3-ac25-41c1-a8b9-f0f0dedb97af None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:44.659319 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed597e3-ac25-41c1-a8b9-f0f0dedb97af None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:44.659595 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed597e3-ac25-41c1-a8b9-f0f0dedb97af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:44.688342 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-7ed597e3-ac25-41c1-a8b9-f0f0dedb97af None None] MFA Rules not processed for user `3806049cdf4e42eeafe0685a57180f65`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:34:44.689713 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-7ed597e3-ac25-41c1-a8b9-f0f0dedb97af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:44.759949 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1230/2474] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:34:44 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:34:44.770972 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297d19d-8179-44b0-b45b-eb1c4dfcdce4 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:44.772644 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9297d19d-8179-44b0-b45b-eb1c4dfcdce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:44.832127 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297d19d-8179-44b0-b45b-eb1c4dfcdce4 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:44.835799 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188a75d-5f58-4b43-9cbf-00d95b61c3a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:44.836432 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188a75d-5f58-4b43-9cbf-00d95b61c3a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:44.836715 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188a75d-5f58-4b43-9cbf-00d95b61c3a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:44.836990 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188a75d-5f58-4b43-9cbf-00d95b61c3a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:44.845754 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188a75d-5f58-4b43-9cbf-00d95b61c3a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:44.847225 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188a75d-5f58-4b43-9cbf-00d95b61c3a0 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:44.857364 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1245/2475] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:34:44 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:34:47.594165 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed597e3-ac25-41c1-a8b9-f0f0dedb97af None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:47.595610 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-7ed597e3-ac25-41c1-a8b9-f0f0dedb97af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:47.646549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:34:47.663853 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed597e3-ac25-41c1-a8b9-f0f0dedb97af None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:47.669916 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d20e9-791c-47c0-b621-384d9ec28706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:47.670574 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d20e9-791c-47c0-b621-384d9ec28706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:47.670855 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d20e9-791c-47c0-b621-384d9ec28706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:47.671170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d20e9-791c-47c0-b621-384d9ec28706 admin admin] PATH_INFO: `/v3/users/3e47fb7c117445c99f9584e31dfe98d7` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:47.672708 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d20e9-791c-47c0-b621-384d9ec28706 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e47fb7c117445c99f9584e31dfe98d7)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:47.674661 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d20e9-791c-47c0-b621-384d9ec28706 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:47.720917 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c05d20e9-791c-47c0-b621-384d9ec28706 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e47fb7c117445c99f9584e31dfe98d7'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:47.734545 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c05d20e9-791c-47c0-b621-384d9ec28706 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e47fb7c117445c99f9584e31dfe98d7'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:47.735224 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c05d20e9-791c-47c0-b621-384d9ec28706 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e47fb7c117445c99f9584e31dfe98d7'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:47.742176 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c05d20e9-791c-47c0-b621-384d9ec28706 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e47fb7c117445c99f9584e31dfe98d7'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:47.742772 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c05d20e9-791c-47c0-b621-384d9ec28706 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e47fb7c117445c99f9584e31dfe98d7'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:47.755745 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1231/2476] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:34:47 2022] DELETE /identity/v3/users/3e47fb7c117445c99f9584e31dfe98d7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:34:47.761083 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd61549-eaed-4d40-afe2-a04e7b08dac0 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:47.761568 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd61549-eaed-4d40-afe2-a04e7b08dac0 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:47.761684 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd61549-eaed-4d40-afe2-a04e7b08dac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:47.780847 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-5cd61549-eaed-4d40-afe2-a04e7b08dac0 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:34:47.782038 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5cd61549-eaed-4d40-afe2-a04e7b08dac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:47.841317 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1246/2477] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:34:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:34:47.850826 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d20e9-791c-47c0-b621-384d9ec28706 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:47.852309 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c05d20e9-791c-47c0-b621-384d9ec28706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:47.915160 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d20e9-791c-47c0-b621-384d9ec28706 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:47.919801 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78231863-8e82-49b6-a4f7-34c66d304ccd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:47.920621 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78231863-8e82-49b6-a4f7-34c66d304ccd service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:47.920922 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78231863-8e82-49b6-a4f7-34c66d304ccd service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:47.921231 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78231863-8e82-49b6-a4f7-34c66d304ccd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:47.932760 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78231863-8e82-49b6-a4f7-34c66d304ccd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:47.934167 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78231863-8e82-49b6-a4f7-34c66d304ccd service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:47.943679 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1232/2478] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:34:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:34:48.212481 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd61549-eaed-4d40-afe2-a04e7b08dac0 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:48.214290 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5cd61549-eaed-4d40-afe2-a04e7b08dac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:48.228582 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd61549-eaed-4d40-afe2-a04e7b08dac0 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:48.234592 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d15e30-bdf6-4c1b-b7ff-6ba8def3c0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:48.235277 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d15e30-bdf6-4c1b-b7ff-6ba8def3c0dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:48.235591 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d15e30-bdf6-4c1b-b7ff-6ba8def3c0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:48.247952 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d15e30-bdf6-4c1b-b7ff-6ba8def3c0dc admin admin] PATH_INFO: `/v3/projects/4820eaf85bfa45f4b749429889b38b85` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:48.247952 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d15e30-bdf6-4c1b-b7ff-6ba8def3c0dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4820eaf85bfa45f4b749429889b38b85)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:48.247952 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d15e30-bdf6-4c1b-b7ff-6ba8def3c0dc admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:48.289885 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:34:48.293053 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-80d15e30-bdf6-4c1b-b7ff-6ba8def3c0dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4820eaf85bfa45f4b749429889b38b85', 'request_id': 'req-80d15e30-bdf6-4c1b-b7ff-6ba8def3c0dc'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:48.302093 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-80d15e30-bdf6-4c1b-b7ff-6ba8def3c0dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4820eaf85bfa45f4b749429889b38b85', 'request_id': 'req-80d15e30-bdf6-4c1b-b7ff-6ba8def3c0dc'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:48.308830 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-80d15e30-bdf6-4c1b-b7ff-6ba8def3c0dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4820eaf85bfa45f4b749429889b38b85', 'request_id': 'req-80d15e30-bdf6-4c1b-b7ff-6ba8def3c0dc'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:48.320448 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-80d15e30-bdf6-4c1b-b7ff-6ba8def3c0dc admin admin] The token cache is being invalidate because project 4820eaf85bfa45f4b749429889b38b85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:34:48.320741 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-80d15e30-bdf6-4c1b-b7ff-6ba8def3c0dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:48.321403 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-80d15e30-bdf6-4c1b-b7ff-6ba8def3c0dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:48.323645 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1247/2479] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:34:48 2022] DELETE /identity/v3/projects/4820eaf85bfa45f4b749429889b38b85 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:34:54.900930 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78231863-8e82-49b6-a4f7-34c66d304ccd service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:54.902381 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-78231863-8e82-49b6-a4f7-34c66d304ccd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:54.914836 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78231863-8e82-49b6-a4f7-34c66d304ccd service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:54.971438 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ee1d7-8494-493c-90e3-608f2c6453a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:54.972095 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ee1d7-8494-493c-90e3-608f2c6453a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:54.972377 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ee1d7-8494-493c-90e3-608f2c6453a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:54.972653 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ee1d7-8494-493c-90e3-608f2c6453a4 admin admin] PATH_INFO: `/v3/users/3806049cdf4e42eeafe0685a57180f65` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:54.973776 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ee1d7-8494-493c-90e3-608f2c6453a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3806049cdf4e42eeafe0685a57180f65)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:54.975684 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ee1d7-8494-493c-90e3-608f2c6453a4 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:54.988156 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:34:55.024783 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b44ee1d7-8494-493c-90e3-608f2c6453a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3806049cdf4e42eeafe0685a57180f65'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:55.038148 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b44ee1d7-8494-493c-90e3-608f2c6453a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3806049cdf4e42eeafe0685a57180f65'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:55.038828 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b44ee1d7-8494-493c-90e3-608f2c6453a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3806049cdf4e42eeafe0685a57180f65'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:55.047114 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b44ee1d7-8494-493c-90e3-608f2c6453a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3806049cdf4e42eeafe0685a57180f65'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:55.047727 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b44ee1d7-8494-493c-90e3-608f2c6453a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3806049cdf4e42eeafe0685a57180f65'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:55.059922 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1233/2480] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:34:54 2022] DELETE /identity/v3/users/3806049cdf4e42eeafe0685a57180f65 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:34:55.064388 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd78c7-874a-4527-b42b-565cca0e7d50 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:55.064931 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd78c7-874a-4527-b42b-565cca0e7d50 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:55.064931 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd78c7-874a-4527-b42b-565cca0e7d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:55.083493 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-3fcd78c7-874a-4527-b42b-565cca0e7d50 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:34:55.084714 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3fcd78c7-874a-4527-b42b-565cca0e7d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:55.142935 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1248/2481] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:34:55.153316 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ee1d7-8494-493c-90e3-608f2c6453a4 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:55.154694 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b44ee1d7-8494-493c-90e3-608f2c6453a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:55.215144 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ee1d7-8494-493c-90e3-608f2c6453a4 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:55.219006 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49cfcf-a4f2-4539-9fd5-0e7e2d7cf7d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:55.219713 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49cfcf-a4f2-4539-9fd5-0e7e2d7cf7d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:55.220032 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49cfcf-a4f2-4539-9fd5-0e7e2d7cf7d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:55.220315 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49cfcf-a4f2-4539-9fd5-0e7e2d7cf7d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:55.229865 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba49cfcf-a4f2-4539-9fd5-0e7e2d7cf7d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:55.231566 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba49cfcf-a4f2-4539-9fd5-0e7e2d7cf7d0 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:55.241484 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1234/2482] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:34:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:34:55.515582 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd78c7-874a-4527-b42b-565cca0e7d50 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:34:55.517276 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3fcd78c7-874a-4527-b42b-565cca0e7d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:34:55.530213 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd78c7-874a-4527-b42b-565cca0e7d50 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:34:55.534893 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f6634-25d2-46d3-8e68-699a2c4ce323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:34:55.535732 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f6634-25d2-46d3-8e68-699a2c4ce323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:34:55.536060 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f6634-25d2-46d3-8e68-699a2c4ce323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:34:55.536343 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f6634-25d2-46d3-8e68-699a2c4ce323 admin admin] PATH_INFO: `/v3/projects/72290fa7b87640f8a51ee2aa659e31a3` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:34:55.537897 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f6634-25d2-46d3-8e68-699a2c4ce323 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72290fa7b87640f8a51ee2aa659e31a3)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:34:55.539802 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f6634-25d2-46d3-8e68-699a2c4ce323 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:34:55.599995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-732f6634-25d2-46d3-8e68-699a2c4ce323 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72290fa7b87640f8a51ee2aa659e31a3', 'request_id': 'req-732f6634-25d2-46d3-8e68-699a2c4ce323'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:55.609964 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-732f6634-25d2-46d3-8e68-699a2c4ce323 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72290fa7b87640f8a51ee2aa659e31a3', 'request_id': 'req-732f6634-25d2-46d3-8e68-699a2c4ce323'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:55.615868 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-732f6634-25d2-46d3-8e68-699a2c4ce323 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72290fa7b87640f8a51ee2aa659e31a3', 'request_id': 'req-732f6634-25d2-46d3-8e68-699a2c4ce323'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:55.627650 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-732f6634-25d2-46d3-8e68-699a2c4ce323 admin admin] The token cache is being invalidate because project 72290fa7b87640f8a51ee2aa659e31a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:34:55.627962 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-732f6634-25d2-46d3-8e68-699a2c4ce323 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:55.628615 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-732f6634-25d2-46d3-8e68-699a2c4ce323 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:34:55.630078 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1249/2483] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:34:55 2022] DELETE /identity/v3/projects/72290fa7b87640f8a51ee2aa659e31a3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:35:05.236894 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=48,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:35:05.248890 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49cfcf-a4f2-4539-9fd5-0e7e2d7cf7d0 service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:05.250303 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ba49cfcf-a4f2-4539-9fd5-0e7e2d7cf7d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:05.263401 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49cfcf-a4f2-4539-9fd5-0e7e2d7cf7d0 service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:05.319293 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a28d49-f9e2-4d66-a67b-ef476d737401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:05.319935 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a28d49-f9e2-4d66-a67b-ef476d737401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:05.320215 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a28d49-f9e2-4d66-a67b-ef476d737401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:05.320487 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a28d49-f9e2-4d66-a67b-ef476d737401 admin admin] PATH_INFO: `/v3/users/f6dbb44f7074407d81182312917a7d00` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:05.321608 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a28d49-f9e2-4d66-a67b-ef476d737401 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6dbb44f7074407d81182312917a7d00)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:05.323570 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a28d49-f9e2-4d66-a67b-ef476d737401 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:05.368144 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-d3a28d49-f9e2-4d66-a67b-ef476d737401 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6dbb44f7074407d81182312917a7d00'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:05.381679 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-d3a28d49-f9e2-4d66-a67b-ef476d737401 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6dbb44f7074407d81182312917a7d00'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:05.382568 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-d3a28d49-f9e2-4d66-a67b-ef476d737401 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6dbb44f7074407d81182312917a7d00'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:05.391105 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-d3a28d49-f9e2-4d66-a67b-ef476d737401 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6dbb44f7074407d81182312917a7d00'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:05.391727 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-d3a28d49-f9e2-4d66-a67b-ef476d737401 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6dbb44f7074407d81182312917a7d00'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:05.403593 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1235/2484] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:35:05 2022] DELETE /identity/v3/users/f6dbb44f7074407d81182312917a7d00 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:35:05.408138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39955b-505f-44fb-a2ca-a0de8889d070 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:05.408608 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39955b-505f-44fb-a2ca-a0de8889d070 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:05.408726 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39955b-505f-44fb-a2ca-a0de8889d070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:05.428085 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-af39955b-505f-44fb-a2ca-a0de8889d070 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:35:05.429414 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-af39955b-505f-44fb-a2ca-a0de8889d070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:05.479133 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:35:05.490675 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1250/2485] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:35:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:35:05.500673 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a28d49-f9e2-4d66-a67b-ef476d737401 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:05.502543 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-d3a28d49-f9e2-4d66-a67b-ef476d737401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:05.560190 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a28d49-f9e2-4d66-a67b-ef476d737401 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:05.563829 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a66547-6d3b-4c42-9a9d-c4308577e334 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:05.564461 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a66547-6d3b-4c42-9a9d-c4308577e334 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:05.564740 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a66547-6d3b-4c42-9a9d-c4308577e334 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:05.565012 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a66547-6d3b-4c42-9a9d-c4308577e334 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:05.573869 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a66547-6d3b-4c42-9a9d-c4308577e334 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:05.576188 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a66547-6d3b-4c42-9a9d-c4308577e334 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:05.585422 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1236/2486] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:35:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:35:05.851462 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39955b-505f-44fb-a2ca-a0de8889d070 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:05.852906 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-af39955b-505f-44fb-a2ca-a0de8889d070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:05.866142 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39955b-505f-44fb-a2ca-a0de8889d070 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:05.872911 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6236da-fd7c-45a6-a55d-24bf5ee59b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:05.873555 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6236da-fd7c-45a6-a55d-24bf5ee59b94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:05.873835 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6236da-fd7c-45a6-a55d-24bf5ee59b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:05.874176 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6236da-fd7c-45a6-a55d-24bf5ee59b94 admin admin] PATH_INFO: `/v3/projects/22991e98a7a342f3a48c0bb147b4ecf5` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:05.876004 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6236da-fd7c-45a6-a55d-24bf5ee59b94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22991e98a7a342f3a48c0bb147b4ecf5)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:05.878570 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6236da-fd7c-45a6-a55d-24bf5ee59b94 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:05.927426 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8f6236da-fd7c-45a6-a55d-24bf5ee59b94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22991e98a7a342f3a48c0bb147b4ecf5', 'request_id': 'req-8f6236da-fd7c-45a6-a55d-24bf5ee59b94'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:05.934805 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8f6236da-fd7c-45a6-a55d-24bf5ee59b94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22991e98a7a342f3a48c0bb147b4ecf5', 'request_id': 'req-8f6236da-fd7c-45a6-a55d-24bf5ee59b94'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:05.940434 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8f6236da-fd7c-45a6-a55d-24bf5ee59b94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22991e98a7a342f3a48c0bb147b4ecf5', 'request_id': 'req-8f6236da-fd7c-45a6-a55d-24bf5ee59b94'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:05.951700 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8f6236da-fd7c-45a6-a55d-24bf5ee59b94 admin admin] The token cache is being invalidate because project 22991e98a7a342f3a48c0bb147b4ecf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:35:05.952016 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8f6236da-fd7c-45a6-a55d-24bf5ee59b94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:05.952651 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8f6236da-fd7c-45a6-a55d-24bf5ee59b94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:05.954119 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1251/2487] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:35:05 2022] DELETE /identity/v3/projects/22991e98a7a342f3a48c0bb147b4ecf5 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:35:05.958069 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a66547-6d3b-4c42-9a9d-c4308577e334 service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:05.967581 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a66547-6d3b-4c42-9a9d-c4308577e334 service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:05.985178 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:35:06.025943 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0340d6-828c-471f-93de-e32ae88b92c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:06.026491 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0340d6-828c-471f-93de-e32ae88b92c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:06.026768 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0340d6-828c-471f-93de-e32ae88b92c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:06.027620 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0340d6-828c-471f-93de-e32ae88b92c8 admin admin] PATH_INFO: `/v3/users/9a150aed63a546aaba801a7a5075c898` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:06.028855 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0340d6-828c-471f-93de-e32ae88b92c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a150aed63a546aaba801a7a5075c898)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:06.030786 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0340d6-828c-471f-93de-e32ae88b92c8 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:06.076744 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ff0340d6-828c-471f-93de-e32ae88b92c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a150aed63a546aaba801a7a5075c898'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:06.088245 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ff0340d6-828c-471f-93de-e32ae88b92c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a150aed63a546aaba801a7a5075c898'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:06.088891 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ff0340d6-828c-471f-93de-e32ae88b92c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a150aed63a546aaba801a7a5075c898'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:06.096468 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ff0340d6-828c-471f-93de-e32ae88b92c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a150aed63a546aaba801a7a5075c898'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:06.097069 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ff0340d6-828c-471f-93de-e32ae88b92c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a150aed63a546aaba801a7a5075c898'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:06.109860 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1237/2488] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:35:05 2022] DELETE /identity/v3/users/9a150aed63a546aaba801a7a5075c898 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:35:06.377766 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6236da-fd7c-45a6-a55d-24bf5ee59b94 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:06.379216 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8f6236da-fd7c-45a6-a55d-24bf5ee59b94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:06.392516 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6236da-fd7c-45a6-a55d-24bf5ee59b94 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:06.451782 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ddbdf-3f28-4bd2-aaa7-2fbc252c8a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:06.452519 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ddbdf-3f28-4bd2-aaa7-2fbc252c8a9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:06.452756 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ddbdf-3f28-4bd2-aaa7-2fbc252c8a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:06.453030 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ddbdf-3f28-4bd2-aaa7-2fbc252c8a9b admin admin] PATH_INFO: `/v3/projects/06b3fb891a294fbb84784d0e3bfe31d3` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:06.454125 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ddbdf-3f28-4bd2-aaa7-2fbc252c8a9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=06b3fb891a294fbb84784d0e3bfe31d3)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:06.456050 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ddbdf-3f28-4bd2-aaa7-2fbc252c8a9b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:06.505746 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-cc3ddbdf-3f28-4bd2-aaa7-2fbc252c8a9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06b3fb891a294fbb84784d0e3bfe31d3', 'request_id': 'req-cc3ddbdf-3f28-4bd2-aaa7-2fbc252c8a9b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:06.513272 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-cc3ddbdf-3f28-4bd2-aaa7-2fbc252c8a9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06b3fb891a294fbb84784d0e3bfe31d3', 'request_id': 'req-cc3ddbdf-3f28-4bd2-aaa7-2fbc252c8a9b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:06.518915 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-cc3ddbdf-3f28-4bd2-aaa7-2fbc252c8a9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06b3fb891a294fbb84784d0e3bfe31d3', 'request_id': 'req-cc3ddbdf-3f28-4bd2-aaa7-2fbc252c8a9b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:06.530184 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-cc3ddbdf-3f28-4bd2-aaa7-2fbc252c8a9b admin admin] The token cache is being invalidate because project 06b3fb891a294fbb84784d0e3bfe31d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:35:06.530475 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-cc3ddbdf-3f28-4bd2-aaa7-2fbc252c8a9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:06.531100 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-cc3ddbdf-3f28-4bd2-aaa7-2fbc252c8a9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:06.532607 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1252/2489] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:35:06 2022] DELETE /identity/v3/projects/06b3fb891a294fbb84784d0e3bfe31d3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:35:06.537362 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b481aee-121b-47ae-ba2b-933054108ef9 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:06.537841 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b481aee-121b-47ae-ba2b-933054108ef9 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:06.537974 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b481aee-121b-47ae-ba2b-933054108ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:06.558010 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-3b481aee-121b-47ae-ba2b-933054108ef9 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:35:06.559806 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-3b481aee-121b-47ae-ba2b-933054108ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:06.616326 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1238/2490] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:35:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:35:06.625884 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d44dce-214b-4c6f-8986-565cc8462614 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:06.626169 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d44dce-214b-4c6f-8986-565cc8462614 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:06.626441 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d44dce-214b-4c6f-8986-565cc8462614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:06.645730 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-61d44dce-214b-4c6f-8986-565cc8462614 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:35:06.646913 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-61d44dce-214b-4c6f-8986-565cc8462614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:06.655051 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1253/2491] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:35:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:35:06.659162 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b481aee-121b-47ae-ba2b-933054108ef9 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:06.669275 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b481aee-121b-47ae-ba2b-933054108ef9 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:06.674010 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a88607-1b69-4888-a2d6-db2493337532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:06.674601 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a88607-1b69-4888-a2d6-db2493337532 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:06.674882 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a88607-1b69-4888-a2d6-db2493337532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:06.675154 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a88607-1b69-4888-a2d6-db2493337532 admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:06.675789 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a88607-1b69-4888-a2d6-db2493337532 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:35:06.676118 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a88607-1b69-4888-a2d6-db2493337532 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:06.677704 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a88607-1b69-4888-a2d6-db2493337532 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:06.689592 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1239/2492] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:35:06.693801 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d44dce-214b-4c6f-8986-565cc8462614 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:06.699382 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:35:06.703399 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d44dce-214b-4c6f-8986-565cc8462614 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:06.709308 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80800ad1-b837-4f0b-b043-89aeea45cffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:06.710114 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80800ad1-b837-4f0b-b043-89aeea45cffa admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:06.710543 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80800ad1-b837-4f0b-b043-89aeea45cffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:06.711047 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80800ad1-b837-4f0b-b043-89aeea45cffa admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:06.711995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80800ad1-b837-4f0b-b043-89aeea45cffa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:06.714083 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80800ad1-b837-4f0b-b043-89aeea45cffa admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:06.743137 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1254/2493] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:35:06 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:35:06.747495 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a88607-1b69-4888-a2d6-db2493337532 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:06.757407 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a88607-1b69-4888-a2d6-db2493337532 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:06.783794 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:35:06.815429 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e1a45-1389-46fd-918c-91cab6daa0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:06.815987 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e1a45-1389-46fd-918c-91cab6daa0fb admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:06.816266 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e1a45-1389-46fd-918c-91cab6daa0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:06.816537 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e1a45-1389-46fd-918c-91cab6daa0fb admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:06.817162 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e1a45-1389-46fd-918c-91cab6daa0fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:06.819077 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e1a45-1389-46fd-918c-91cab6daa0fb admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:06.839430 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1240/2494] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:35:06 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:35:06.844115 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80800ad1-b837-4f0b-b043-89aeea45cffa admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:06.854510 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80800ad1-b837-4f0b-b043-89aeea45cffa admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:06.859751 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd69837-ddba-4546-85df-ff2d047ea08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:06.860372 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd69837-ddba-4546-85df-ff2d047ea08f admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:06.860655 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd69837-ddba-4546-85df-ff2d047ea08f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:06.860924 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd69837-ddba-4546-85df-ff2d047ea08f admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:06.861579 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd69837-ddba-4546-85df-ff2d047ea08f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:06.863142 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd69837-ddba-4546-85df-ff2d047ea08f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:06.873153 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1255/2495] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:35:06.877277 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e1a45-1389-46fd-918c-91cab6daa0fb admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:06.887251 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e1a45-1389-46fd-918c-91cab6daa0fb admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:06.891826 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4b36e-d20c-4610-a331-69a119555fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:06.892439 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4b36e-d20c-4610-a331-69a119555fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:06.892718 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4b36e-d20c-4610-a331-69a119555fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:06.892989 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4b36e-d20c-4610-a331-69a119555fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:06.893625 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4b36e-d20c-4610-a331-69a119555fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:06.895186 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4b36e-d20c-4610-a331-69a119555fd2 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:06.906402 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1241/2496] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:35:06.910390 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd69837-ddba-4546-85df-ff2d047ea08f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:06.921225 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd69837-ddba-4546-85df-ff2d047ea08f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:06.926186 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b34d6c-4bf1-4931-a361-20002ce19439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:06.926827 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b34d6c-4bf1-4931-a361-20002ce19439 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:06.927106 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b34d6c-4bf1-4931-a361-20002ce19439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:06.927446 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b34d6c-4bf1-4931-a361-20002ce19439 admin admin] PATH_INFO: `/v3/projects/d93176841b444821ae15131af9648874/users/d2be7c552974432f8cb496998a22c203/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:06.942483 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b34d6c-4bf1-4931-a361-20002ce19439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d93176841b444821ae15131af9648874, user_id=d2be7c552974432f8cb496998a22c203, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:06.945149 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b34d6c-4bf1-4931-a361-20002ce19439 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:06.958236 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1256/2497] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:35:06 2022] PUT /identity/v3/projects/d93176841b444821ae15131af9648874/users/d2be7c552974432f8cb496998a22c203/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:35:06.969104 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bda40-f619-44c6-90d1-5d246af18371 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:06.969376 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bda40-f619-44c6-90d1-5d246af18371 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:06.969658 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bda40-f619-44c6-90d1-5d246af18371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:06.998220 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-4c6bda40-f619-44c6-90d1-5d246af18371 None None] MFA Rules not processed for user `d2be7c552974432f8cb496998a22c203`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:35:06.999411 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-4c6bda40-f619-44c6-90d1-5d246af18371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:07.064091 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1242/2498] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:35:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:35:07.068607 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b34d6c-4bf1-4931-a361-20002ce19439 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:07.129911 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b34d6c-4bf1-4931-a361-20002ce19439 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:07.134540 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19d4db-4f26-489a-b92f-c35548fe7277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:07.135131 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19d4db-4f26-489a-b92f-c35548fe7277 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:07.135409 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19d4db-4f26-489a-b92f-c35548fe7277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:07.135681 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19d4db-4f26-489a-b92f-c35548fe7277 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:07.136329 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19d4db-4f26-489a-b92f-c35548fe7277 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:07.138305 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19d4db-4f26-489a-b92f-c35548fe7277 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:07.164191 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1257/2499] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:35:07 2022] POST /identity/v3/projects => generated 371 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:35:07.168713 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6bda40-f619-44c6-90d1-5d246af18371 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:07.179300 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6bda40-f619-44c6-90d1-5d246af18371 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:07.234251 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3fa91c-60aa-4006-aa10-058661a5e091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:07.234924 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fa91c-60aa-4006-aa10-058661a5e091 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:07.235215 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fa91c-60aa-4006-aa10-058661a5e091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:07.235532 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fa91c-60aa-4006-aa10-058661a5e091 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:07.236166 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3fa91c-60aa-4006-aa10-058661a5e091 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:07.238068 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3fa91c-60aa-4006-aa10-058661a5e091 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:07.258556 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1243/2500] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:35:07 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:35:07.262946 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19d4db-4f26-489a-b92f-c35548fe7277 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:07.272981 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19d4db-4f26-489a-b92f-c35548fe7277 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:07.278086 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a945c5b-4464-40ac-86e4-adbdd4c567ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:07.278669 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a945c5b-4464-40ac-86e4-adbdd4c567ee admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:07.278944 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a945c5b-4464-40ac-86e4-adbdd4c567ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:07.279212 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a945c5b-4464-40ac-86e4-adbdd4c567ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:07.279834 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a945c5b-4464-40ac-86e4-adbdd4c567ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:07.281442 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a945c5b-4464-40ac-86e4-adbdd4c567ee admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:07.291816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1258/2501] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:35:07.295836 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3fa91c-60aa-4006-aa10-058661a5e091 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:07.305912 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3fa91c-60aa-4006-aa10-058661a5e091 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:07.310551 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b649580-ca85-4917-839d-26f82b80ed26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:07.311185 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b649580-ca85-4917-839d-26f82b80ed26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:07.311466 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b649580-ca85-4917-839d-26f82b80ed26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:07.311744 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b649580-ca85-4917-839d-26f82b80ed26 admin admin] PATH_INFO: `/v3/projects/10f10048dbb74d38bf4ea003e357176c/users/098b0f3cd8734ad086e04f79c793162d/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:07.328358 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b649580-ca85-4917-839d-26f82b80ed26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10f10048dbb74d38bf4ea003e357176c, user_id=098b0f3cd8734ad086e04f79c793162d, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:07.331325 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b649580-ca85-4917-839d-26f82b80ed26 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:07.344710 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1244/2502] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:35:07 2022] PUT /identity/v3/projects/10f10048dbb74d38bf4ea003e357176c/users/098b0f3cd8734ad086e04f79c793162d/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:35:07.348636 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a945c5b-4464-40ac-86e4-adbdd4c567ee admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:07.359048 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a945c5b-4464-40ac-86e4-adbdd4c567ee admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:07.414299 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adda432-2bea-4b88-b28f-2aea19e9582e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:07.414901 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adda432-2bea-4b88-b28f-2aea19e9582e admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:07.415183 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adda432-2bea-4b88-b28f-2aea19e9582e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:07.415461 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adda432-2bea-4b88-b28f-2aea19e9582e admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:07.416118 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adda432-2bea-4b88-b28f-2aea19e9582e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:07.418199 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adda432-2bea-4b88-b28f-2aea19e9582e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:07.428146 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1259/2503] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:35:07.433281 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b649580-ca85-4917-839d-26f82b80ed26 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:07.439210 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:35:07.445640 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b649580-ca85-4917-839d-26f82b80ed26 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:07.450710 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db739db0-8142-4613-8431-0b9328e2713a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:07.451357 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db739db0-8142-4613-8431-0b9328e2713a admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:07.451635 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db739db0-8142-4613-8431-0b9328e2713a admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:07.451927 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db739db0-8142-4613-8431-0b9328e2713a admin admin] PATH_INFO: `/v3/projects/10f10048dbb74d38bf4ea003e357176c/users/098b0f3cd8734ad086e04f79c793162d/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:07.453835 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db739db0-8142-4613-8431-0b9328e2713a admin admin] RBAC: Authorizing `identity:create_grant(project_id=10f10048dbb74d38bf4ea003e357176c, user_id=098b0f3cd8734ad086e04f79c793162d, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:07.456760 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db739db0-8142-4613-8431-0b9328e2713a admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:07.467690 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1245/2504] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:35:07 2022] PUT /identity/v3/projects/10f10048dbb74d38bf4ea003e357176c/users/098b0f3cd8734ad086e04f79c793162d/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:35:07.478235 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d71de-7c0a-4eba-b70b-fbf9751376a2 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:07.478712 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d71de-7c0a-4eba-b70b-fbf9751376a2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:07.478821 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d71de-7c0a-4eba-b70b-fbf9751376a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:07.506361 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-834d71de-7c0a-4eba-b70b-fbf9751376a2 None None] MFA Rules not processed for user `098b0f3cd8734ad086e04f79c793162d`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:35:07.507545 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-834d71de-7c0a-4eba-b70b-fbf9751376a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:07.512745 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:35:07.576958 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1260/2505] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:35:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:35:07.588073 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db739db0-8142-4613-8431-0b9328e2713a admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:07.590341 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-db739db0-8142-4613-8431-0b9328e2713a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:07.648087 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db739db0-8142-4613-8431-0b9328e2713a admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:07.651632 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc8331-d939-45be-a81a-188292ff9239 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:07.653328 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc8331-d939-45be-a81a-188292ff9239 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:07.653617 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc8331-d939-45be-a81a-188292ff9239 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:07.653887 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc8331-d939-45be-a81a-188292ff9239 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:07.662562 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc8331-d939-45be-a81a-188292ff9239 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:07.664007 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc8331-d939-45be-a81a-188292ff9239 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:07.674448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1246/2506] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:35:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:35:08.064191 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d71de-7c0a-4eba-b70b-fbf9751376a2 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:08.126772 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d71de-7c0a-4eba-b70b-fbf9751376a2 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:08.131251 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba70ebb-26a9-4517-b98e-0c3d25928c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:08.131878 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba70ebb-26a9-4517-b98e-0c3d25928c83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:08.132190 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba70ebb-26a9-4517-b98e-0c3d25928c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:08.132468 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba70ebb-26a9-4517-b98e-0c3d25928c83 admin admin] PATH_INFO: `/v3/users/d2be7c552974432f8cb496998a22c203` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:08.133846 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba70ebb-26a9-4517-b98e-0c3d25928c83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2be7c552974432f8cb496998a22c203)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:08.135855 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba70ebb-26a9-4517-b98e-0c3d25928c83 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:08.180430 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9ba70ebb-26a9-4517-b98e-0c3d25928c83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2be7c552974432f8cb496998a22c203'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:08.181081 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9ba70ebb-26a9-4517-b98e-0c3d25928c83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2be7c552974432f8cb496998a22c203'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:08.193372 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9ba70ebb-26a9-4517-b98e-0c3d25928c83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2be7c552974432f8cb496998a22c203'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:08.200585 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9ba70ebb-26a9-4517-b98e-0c3d25928c83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2be7c552974432f8cb496998a22c203'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:08.207966 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9ba70ebb-26a9-4517-b98e-0c3d25928c83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2be7c552974432f8cb496998a22c203'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:08.213948 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1261/2507] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:35:08 2022] DELETE /identity/v3/users/d2be7c552974432f8cb496998a22c203 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:35:08.219125 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4599c9-066e-4f2e-8963-22cbb69b943c None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:08.219446 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4599c9-066e-4f2e-8963-22cbb69b943c None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:08.219726 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4599c9-066e-4f2e-8963-22cbb69b943c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:08.238743 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-3c4599c9-066e-4f2e-8963-22cbb69b943c None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:35:08.239961 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-3c4599c9-066e-4f2e-8963-22cbb69b943c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:08.297772 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1247/2508] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:35:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:35:08.307416 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba70ebb-26a9-4517-b98e-0c3d25928c83 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:08.308804 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9ba70ebb-26a9-4517-b98e-0c3d25928c83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:08.334859 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:35:08.366803 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba70ebb-26a9-4517-b98e-0c3d25928c83 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:08.370368 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00991d-9ad9-4816-8dbc-49b7718e291c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:08.371110 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00991d-9ad9-4816-8dbc-49b7718e291c service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:08.371220 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00991d-9ad9-4816-8dbc-49b7718e291c service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:08.371492 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00991d-9ad9-4816-8dbc-49b7718e291c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:08.380661 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00991d-9ad9-4816-8dbc-49b7718e291c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:08.382023 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00991d-9ad9-4816-8dbc-49b7718e291c service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:08.391461 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1262/2509] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:35:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 13:35:08.662444 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4599c9-066e-4f2e-8963-22cbb69b943c None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:08.664039 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-3c4599c9-066e-4f2e-8963-22cbb69b943c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:08.677443 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4599c9-066e-4f2e-8963-22cbb69b943c None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:08.682140 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e895f-6fec-4ecd-9c97-5122aeb4ce31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:08.682766 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e895f-6fec-4ecd-9c97-5122aeb4ce31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:08.683048 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e895f-6fec-4ecd-9c97-5122aeb4ce31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:08.683325 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e895f-6fec-4ecd-9c97-5122aeb4ce31 admin admin] PATH_INFO: `/v3/projects/d93176841b444821ae15131af9648874` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:08.684466 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e895f-6fec-4ecd-9c97-5122aeb4ce31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d93176841b444821ae15131af9648874)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:08.687024 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e895f-6fec-4ecd-9c97-5122aeb4ce31 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:08.735523 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f44e895f-6fec-4ecd-9c97-5122aeb4ce31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd93176841b444821ae15131af9648874', 'request_id': 'req-f44e895f-6fec-4ecd-9c97-5122aeb4ce31'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:08.741717 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f44e895f-6fec-4ecd-9c97-5122aeb4ce31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd93176841b444821ae15131af9648874', 'request_id': 'req-f44e895f-6fec-4ecd-9c97-5122aeb4ce31'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:08.748784 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f44e895f-6fec-4ecd-9c97-5122aeb4ce31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd93176841b444821ae15131af9648874', 'request_id': 'req-f44e895f-6fec-4ecd-9c97-5122aeb4ce31'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:08.759057 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f44e895f-6fec-4ecd-9c97-5122aeb4ce31 admin admin] The token cache is being invalidate because project d93176841b444821ae15131af9648874 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:35:08.759339 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f44e895f-6fec-4ecd-9c97-5122aeb4ce31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:08.759980 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f44e895f-6fec-4ecd-9c97-5122aeb4ce31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:08.761477 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1248/2510] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:35:08 2022] DELETE /identity/v3/projects/d93176841b444821ae15131af9648874 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:35:08.766053 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00991d-9ad9-4816-8dbc-49b7718e291c service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:08.775413 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00991d-9ad9-4816-8dbc-49b7718e291c service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:08.831793 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c6477-3e88-4c3e-8e7b-e2ea28b637cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:08.832445 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c6477-3e88-4c3e-8e7b-e2ea28b637cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:08.832727 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c6477-3e88-4c3e-8e7b-e2ea28b637cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:08.832999 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c6477-3e88-4c3e-8e7b-e2ea28b637cf admin admin] PATH_INFO: `/v3/users/098b0f3cd8734ad086e04f79c793162d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:08.834094 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c6477-3e88-4c3e-8e7b-e2ea28b637cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=098b0f3cd8734ad086e04f79c793162d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:08.836020 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c6477-3e88-4c3e-8e7b-e2ea28b637cf admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:08.880883 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-eb1c6477-3e88-4c3e-8e7b-e2ea28b637cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '098b0f3cd8734ad086e04f79c793162d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:08.881524 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-eb1c6477-3e88-4c3e-8e7b-e2ea28b637cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '098b0f3cd8734ad086e04f79c793162d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:08.893655 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-eb1c6477-3e88-4c3e-8e7b-e2ea28b637cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '098b0f3cd8734ad086e04f79c793162d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:08.900876 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-eb1c6477-3e88-4c3e-8e7b-e2ea28b637cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '098b0f3cd8734ad086e04f79c793162d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:08.908037 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-eb1c6477-3e88-4c3e-8e7b-e2ea28b637cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '098b0f3cd8734ad086e04f79c793162d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:08.913722 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1263/2511] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:35:08 2022] DELETE /identity/v3/users/098b0f3cd8734ad086e04f79c793162d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:35:09.182939 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e895f-6fec-4ecd-9c97-5122aeb4ce31 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:09.184918 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-f44e895f-6fec-4ecd-9c97-5122aeb4ce31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:09.199396 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e895f-6fec-4ecd-9c97-5122aeb4ce31 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:09.213334 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:35:09.260479 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d513462-f7a4-45fe-85be-c2efcb4b22b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:09.261109 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d513462-f7a4-45fe-85be-c2efcb4b22b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:09.261388 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d513462-f7a4-45fe-85be-c2efcb4b22b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:09.261664 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d513462-f7a4-45fe-85be-c2efcb4b22b2 admin admin] PATH_INFO: `/v3/projects/10f10048dbb74d38bf4ea003e357176c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:09.263459 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d513462-f7a4-45fe-85be-c2efcb4b22b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10f10048dbb74d38bf4ea003e357176c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:09.265437 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d513462-f7a4-45fe-85be-c2efcb4b22b2 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:09.311542 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-6d513462-f7a4-45fe-85be-c2efcb4b22b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10f10048dbb74d38bf4ea003e357176c', 'request_id': 'req-6d513462-f7a4-45fe-85be-c2efcb4b22b2'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:09.317551 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-6d513462-f7a4-45fe-85be-c2efcb4b22b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10f10048dbb74d38bf4ea003e357176c', 'request_id': 'req-6d513462-f7a4-45fe-85be-c2efcb4b22b2'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:09.324732 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-6d513462-f7a4-45fe-85be-c2efcb4b22b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10f10048dbb74d38bf4ea003e357176c', 'request_id': 'req-6d513462-f7a4-45fe-85be-c2efcb4b22b2'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:09.335755 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-6d513462-f7a4-45fe-85be-c2efcb4b22b2 admin admin] The token cache is being invalidate because project 10f10048dbb74d38bf4ea003e357176c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:35:09.336070 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-6d513462-f7a4-45fe-85be-c2efcb4b22b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:09.336687 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-6d513462-f7a4-45fe-85be-c2efcb4b22b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:09.338133 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1249/2512] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:35:09 2022] DELETE /identity/v3/projects/10f10048dbb74d38bf4ea003e357176c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:35:09.343033 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fe6b8-80e1-4b86-8ba1-2bd5ad2987c8 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:09.343316 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fe6b8-80e1-4b86-8ba1-2bd5ad2987c8 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:09.343588 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fe6b8-80e1-4b86-8ba1-2bd5ad2987c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:09.363069 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-072fe6b8-80e1-4b86-8ba1-2bd5ad2987c8 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:35:09.364350 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-072fe6b8-80e1-4b86-8ba1-2bd5ad2987c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:09.403701 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:35:09.425009 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1264/2513] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:35:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:35:09.433968 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37b741-09cb-4fbd-911d-97398fc8bf4a None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:09.434183 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37b741-09cb-4fbd-911d-97398fc8bf4a None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:09.434466 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37b741-09cb-4fbd-911d-97398fc8bf4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:09.454476 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-7e37b741-09cb-4fbd-911d-97398fc8bf4a None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:35:09.455673 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-7e37b741-09cb-4fbd-911d-97398fc8bf4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:09.463402 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1250/2514] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:35:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:35:09.467612 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072fe6b8-80e1-4b86-8ba1-2bd5ad2987c8 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:09.477991 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072fe6b8-80e1-4b86-8ba1-2bd5ad2987c8 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:09.483070 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf3e20-2a72-494a-8650-a074d175755e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:09.483660 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf3e20-2a72-494a-8650-a074d175755e admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:09.483968 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf3e20-2a72-494a-8650-a074d175755e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:09.484241 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf3e20-2a72-494a-8650-a074d175755e admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:09.484874 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf3e20-2a72-494a-8650-a074d175755e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:35:09.485173 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf3e20-2a72-494a-8650-a074d175755e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:09.486742 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf3e20-2a72-494a-8650-a074d175755e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:09.498434 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1265/2515] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:35:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 25 13:35:09.502885 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37b741-09cb-4fbd-911d-97398fc8bf4a None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:09.512038 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37b741-09cb-4fbd-911d-97398fc8bf4a None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:09.517373 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c170d26-a5de-42e8-a0dd-addfac4f6270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:09.517966 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c170d26-a5de-42e8-a0dd-addfac4f6270 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:09.518245 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c170d26-a5de-42e8-a0dd-addfac4f6270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:09.518517 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c170d26-a5de-42e8-a0dd-addfac4f6270 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:09.519151 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c170d26-a5de-42e8-a0dd-addfac4f6270 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:09.521097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c170d26-a5de-42e8-a0dd-addfac4f6270 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:09.547946 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1251/2516] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:35:09 2022] POST /identity/v3/projects => generated 355 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:35:09.552013 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf3e20-2a72-494a-8650-a074d175755e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:09.562688 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf3e20-2a72-494a-8650-a074d175755e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:09.619377 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a9529-67f3-4ad4-a48d-79ae9ac86480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:09.620015 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a9529-67f3-4ad4-a48d-79ae9ac86480 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:09.620293 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a9529-67f3-4ad4-a48d-79ae9ac86480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:09.620562 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a9529-67f3-4ad4-a48d-79ae9ac86480 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:09.621177 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a9529-67f3-4ad4-a48d-79ae9ac86480 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:09.623920 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a9529-67f3-4ad4-a48d-79ae9ac86480 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:09.645228 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1266/2517] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:35:09 2022] POST /identity/v3/users => generated 278 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:35:09.649023 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c170d26-a5de-42e8-a0dd-addfac4f6270 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:09.659050 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c170d26-a5de-42e8-a0dd-addfac4f6270 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:09.663547 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61483ba-f771-4455-97f2-7836c4fd40c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:09.664160 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61483ba-f771-4455-97f2-7836c4fd40c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:09.664423 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61483ba-f771-4455-97f2-7836c4fd40c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:09.664691 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61483ba-f771-4455-97f2-7836c4fd40c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:09.665321 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61483ba-f771-4455-97f2-7836c4fd40c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:09.666922 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61483ba-f771-4455-97f2-7836c4fd40c8 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:09.677319 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1252/2518] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:35:09.681057 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a9529-67f3-4ad4-a48d-79ae9ac86480 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:09.692063 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a9529-67f3-4ad4-a48d-79ae9ac86480 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:09.696692 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00225fc6-0792-4572-a482-67aafe0649c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:09.697287 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00225fc6-0792-4572-a482-67aafe0649c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:09.697572 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00225fc6-0792-4572-a482-67aafe0649c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:09.697848 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00225fc6-0792-4572-a482-67aafe0649c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:09.698485 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00225fc6-0792-4572-a482-67aafe0649c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:09.700217 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00225fc6-0792-4572-a482-67aafe0649c0 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:09.711061 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1267/2519] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:35:09.715236 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61483ba-f771-4455-97f2-7836c4fd40c8 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:09.726569 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61483ba-f771-4455-97f2-7836c4fd40c8 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:09.731240 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f14dc-42b9-4b74-9eac-f48657fce14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:09.733082 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f14dc-42b9-4b74-9eac-f48657fce14b admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:09.733391 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f14dc-42b9-4b74-9eac-f48657fce14b admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:09.733662 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f14dc-42b9-4b74-9eac-f48657fce14b admin admin] PATH_INFO: `/v3/projects/159b2ee4c90547bbb8480cc7da18fa4a/users/f058b196a5f6452d8522375e3cf4e5de/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:09.748774 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f14dc-42b9-4b74-9eac-f48657fce14b admin admin] RBAC: Authorizing `identity:create_grant(project_id=159b2ee4c90547bbb8480cc7da18fa4a, user_id=f058b196a5f6452d8522375e3cf4e5de, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:09.751459 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f14dc-42b9-4b74-9eac-f48657fce14b admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:09.763954 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1253/2520] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:35:09 2022] PUT /identity/v3/projects/159b2ee4c90547bbb8480cc7da18fa4a/users/f058b196a5f6452d8522375e3cf4e5de/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:35:09.774075 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b22264-c66a-4893-9f83-aa5a4f5493c6 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:09.774566 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b22264-c66a-4893-9f83-aa5a4f5493c6 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:09.774681 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b22264-c66a-4893-9f83-aa5a4f5493c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:09.803839 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e3b22264-c66a-4893-9f83-aa5a4f5493c6 None None] MFA Rules not processed for user `f058b196a5f6452d8522375e3cf4e5de`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:35:09.805063 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e3b22264-c66a-4893-9f83-aa5a4f5493c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:09.870128 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1268/2521] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:35:09 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:35:09.875404 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f14dc-42b9-4b74-9eac-f48657fce14b admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:09.919487 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:35:09.938592 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f14dc-42b9-4b74-9eac-f48657fce14b admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:09.943215 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005b862-ab02-4f95-ba02-df15a5b97ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:09.943749 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005b862-ab02-4f95-ba02-df15a5b97ddd admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:09.944127 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005b862-ab02-4f95-ba02-df15a5b97ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:09.944399 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005b862-ab02-4f95-ba02-df15a5b97ddd admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:09.945024 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005b862-ab02-4f95-ba02-df15a5b97ddd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:09.946923 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005b862-ab02-4f95-ba02-df15a5b97ddd admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:09.972677 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1254/2522] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:35:09 2022] POST /identity/v3/projects => generated 357 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:35:09.976761 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b22264-c66a-4893-9f83-aa5a4f5493c6 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:09.987292 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b22264-c66a-4893-9f83-aa5a4f5493c6 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:10.024919 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:35:10.044252 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc988ba-6606-41bd-8191-ae29691f761d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:10.044871 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc988ba-6606-41bd-8191-ae29691f761d admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:10.045156 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc988ba-6606-41bd-8191-ae29691f761d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:10.045429 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc988ba-6606-41bd-8191-ae29691f761d admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:10.046062 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc988ba-6606-41bd-8191-ae29691f761d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:10.048292 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc988ba-6606-41bd-8191-ae29691f761d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:10.069504 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1269/2523] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:35:09 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:35:10.073505 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005b862-ab02-4f95-ba02-df15a5b97ddd admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:10.084221 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005b862-ab02-4f95-ba02-df15a5b97ddd admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:10.088719 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438cabe-d266-486d-8b18-fb2de308ef1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:10.089307 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438cabe-d266-486d-8b18-fb2de308ef1c admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:10.089583 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438cabe-d266-486d-8b18-fb2de308ef1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:10.089853 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438cabe-d266-486d-8b18-fb2de308ef1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:10.090491 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f438cabe-d266-486d-8b18-fb2de308ef1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:10.092089 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f438cabe-d266-486d-8b18-fb2de308ef1c admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:10.103845 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1255/2524] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:35:10.108477 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc988ba-6606-41bd-8191-ae29691f761d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:10.118281 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc988ba-6606-41bd-8191-ae29691f761d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:10.123544 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c527b45-4660-45e1-89e4-0a9e3555f9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:10.124224 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c527b45-4660-45e1-89e4-0a9e3555f9b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:10.124510 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c527b45-4660-45e1-89e4-0a9e3555f9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:10.124785 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c527b45-4660-45e1-89e4-0a9e3555f9b6 admin admin] PATH_INFO: `/v3/projects/6921df6ca731433086b4c81a778aed8b/users/2b7ac0f7fb2e438780a0f06af5b63495/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:10.139381 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c527b45-4660-45e1-89e4-0a9e3555f9b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6921df6ca731433086b4c81a778aed8b, user_id=2b7ac0f7fb2e438780a0f06af5b63495, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:10.142130 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c527b45-4660-45e1-89e4-0a9e3555f9b6 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:10.154830 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1270/2525] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:35:10 2022] PUT /identity/v3/projects/6921df6ca731433086b4c81a778aed8b/users/2b7ac0f7fb2e438780a0f06af5b63495/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:35:10.158666 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438cabe-d266-486d-8b18-fb2de308ef1c admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:10.168508 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438cabe-d266-486d-8b18-fb2de308ef1c admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:10.224577 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942d917-b17c-4b12-8ea1-3d7e0c48dada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:10.225103 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942d917-b17c-4b12-8ea1-3d7e0c48dada admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:10.225380 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942d917-b17c-4b12-8ea1-3d7e0c48dada admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:10.225652 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942d917-b17c-4b12-8ea1-3d7e0c48dada admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:10.226302 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942d917-b17c-4b12-8ea1-3d7e0c48dada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:10.227880 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942d917-b17c-4b12-8ea1-3d7e0c48dada admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:10.238119 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1256/2526] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:35:10.242223 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c527b45-4660-45e1-89e4-0a9e3555f9b6 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:10.252955 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c527b45-4660-45e1-89e4-0a9e3555f9b6 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:10.257553 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a805ee-2ce5-4d17-bcc0-50dac44b2ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:10.258202 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a805ee-2ce5-4d17-bcc0-50dac44b2ad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:10.258483 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a805ee-2ce5-4d17-bcc0-50dac44b2ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:10.258758 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a805ee-2ce5-4d17-bcc0-50dac44b2ad3 admin admin] PATH_INFO: `/v3/projects/6921df6ca731433086b4c81a778aed8b/users/2b7ac0f7fb2e438780a0f06af5b63495/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:10.260690 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a805ee-2ce5-4d17-bcc0-50dac44b2ad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6921df6ca731433086b4c81a778aed8b, user_id=2b7ac0f7fb2e438780a0f06af5b63495, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:10.264024 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a805ee-2ce5-4d17-bcc0-50dac44b2ad3 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:10.274021 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1271/2527] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:35:10 2022] PUT /identity/v3/projects/6921df6ca731433086b4c81a778aed8b/users/2b7ac0f7fb2e438780a0f06af5b63495/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:35:10.285613 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd212c99-9da3-4154-9847-22029780824d None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:10.285898 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd212c99-9da3-4154-9847-22029780824d None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:10.286172 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd212c99-9da3-4154-9847-22029780824d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:10.313625 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-dd212c99-9da3-4154-9847-22029780824d None None] MFA Rules not processed for user `2b7ac0f7fb2e438780a0f06af5b63495`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:35:10.314805 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-dd212c99-9da3-4154-9847-22029780824d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:10.381064 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1257/2528] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:35:10 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:35:10.392511 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a805ee-2ce5-4d17-bcc0-50dac44b2ad3 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:10.394216 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-94a805ee-2ce5-4d17-bcc0-50dac44b2ad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:10.452155 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a805ee-2ce5-4d17-bcc0-50dac44b2ad3 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:10.455698 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71020e71-fde6-4572-9154-14c9a5eaa467 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:10.456332 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71020e71-fde6-4572-9154-14c9a5eaa467 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:10.456608 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71020e71-fde6-4572-9154-14c9a5eaa467 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:10.456878 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71020e71-fde6-4572-9154-14c9a5eaa467 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:10.465605 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71020e71-fde6-4572-9154-14c9a5eaa467 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:10.467757 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71020e71-fde6-4572-9154-14c9a5eaa467 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:10.477047 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1272/2529] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:35:10 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:35:10.552035 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd212c99-9da3-4154-9847-22029780824d None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:10.562344 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd212c99-9da3-4154-9847-22029780824d None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:10.565914 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036cf4b6-0343-45fa-b4f7-7b04c4d593f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:10.566504 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cf4b6-0343-45fa-b4f7-7b04c4d593f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:10.566781 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cf4b6-0343-45fa-b4f7-7b04c4d593f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:10.567054 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cf4b6-0343-45fa-b4f7-7b04c4d593f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:10.599688 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:35:10.623000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036cf4b6-0343-45fa-b4f7-7b04c4d593f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:10.624450 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036cf4b6-0343-45fa-b4f7-7b04c4d593f5 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:10.633191 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1258/2530] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:35:10 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:35:20.472871 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=52,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:35:20.629260 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=11 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:35:25.400950 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71020e71-fde6-4572-9154-14c9a5eaa467 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:25.464172 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71020e71-fde6-4572-9154-14c9a5eaa467 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:25.469231 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff29830-58b8-43a7-a7bf-0d197e95219e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:25.469845 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff29830-58b8-43a7-a7bf-0d197e95219e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:25.470140 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff29830-58b8-43a7-a7bf-0d197e95219e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:25.470392 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff29830-58b8-43a7-a7bf-0d197e95219e admin admin] PATH_INFO: `/v3/users/f058b196a5f6452d8522375e3cf4e5de` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:25.471492 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff29830-58b8-43a7-a7bf-0d197e95219e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f058b196a5f6452d8522375e3cf4e5de)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:25.473404 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff29830-58b8-43a7-a7bf-0d197e95219e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:25.518079 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-dff29830-58b8-43a7-a7bf-0d197e95219e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f058b196a5f6452d8522375e3cf4e5de'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:25.518719 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-dff29830-58b8-43a7-a7bf-0d197e95219e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f058b196a5f6452d8522375e3cf4e5de'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:25.530582 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-dff29830-58b8-43a7-a7bf-0d197e95219e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f058b196a5f6452d8522375e3cf4e5de'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:25.537886 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-dff29830-58b8-43a7-a7bf-0d197e95219e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f058b196a5f6452d8522375e3cf4e5de'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:25.545720 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-dff29830-58b8-43a7-a7bf-0d197e95219e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f058b196a5f6452d8522375e3cf4e5de'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:25.551704 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1273/2531] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:35:25 2022] DELETE /identity/v3/users/f058b196a5f6452d8522375e3cf4e5de => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:35:25.556237 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49f76c-5208-4bf2-a576-75c9faf94ac8 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:25.556718 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49f76c-5208-4bf2-a576-75c9faf94ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:25.556816 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49f76c-5208-4bf2-a576-75c9faf94ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:25.576420 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-1b49f76c-5208-4bf2-a576-75c9faf94ac8 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:35:25.577258 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-1b49f76c-5208-4bf2-a576-75c9faf94ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:25.635697 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1259/2532] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:35:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:35:25.645815 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff29830-58b8-43a7-a7bf-0d197e95219e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:25.647202 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-dff29830-58b8-43a7-a7bf-0d197e95219e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:25.707749 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff29830-58b8-43a7-a7bf-0d197e95219e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:25.711338 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e348c8e-6ee3-4011-9525-b20d757a8d99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:25.711964 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e348c8e-6ee3-4011-9525-b20d757a8d99 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:25.712248 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e348c8e-6ee3-4011-9525-b20d757a8d99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:25.712520 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e348c8e-6ee3-4011-9525-b20d757a8d99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:25.722221 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e348c8e-6ee3-4011-9525-b20d757a8d99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:25.723660 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e348c8e-6ee3-4011-9525-b20d757a8d99 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:25.733303 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1274/2533] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:35:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:35:25.998015 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b49f76c-5208-4bf2-a576-75c9faf94ac8 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:25.999441 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-1b49f76c-5208-4bf2-a576-75c9faf94ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:26.011091 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b49f76c-5208-4bf2-a576-75c9faf94ac8 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:26.016708 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75084137-01cb-4c86-a997-47c137257c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:26.017701 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75084137-01cb-4c86-a997-47c137257c9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:26.017988 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75084137-01cb-4c86-a997-47c137257c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:26.018276 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75084137-01cb-4c86-a997-47c137257c9b admin admin] PATH_INFO: `/v3/projects/159b2ee4c90547bbb8480cc7da18fa4a` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:26.019397 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75084137-01cb-4c86-a997-47c137257c9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=159b2ee4c90547bbb8480cc7da18fa4a)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:26.022410 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75084137-01cb-4c86-a997-47c137257c9b admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:26.070308 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-75084137-01cb-4c86-a997-47c137257c9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '159b2ee4c90547bbb8480cc7da18fa4a', 'request_id': 'req-75084137-01cb-4c86-a997-47c137257c9b'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:26.076593 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-75084137-01cb-4c86-a997-47c137257c9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '159b2ee4c90547bbb8480cc7da18fa4a', 'request_id': 'req-75084137-01cb-4c86-a997-47c137257c9b'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:26.083822 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-75084137-01cb-4c86-a997-47c137257c9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '159b2ee4c90547bbb8480cc7da18fa4a', 'request_id': 'req-75084137-01cb-4c86-a997-47c137257c9b'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:26.095294 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-75084137-01cb-4c86-a997-47c137257c9b admin admin] The token cache is being invalidate because project 159b2ee4c90547bbb8480cc7da18fa4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:35:26.095584 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-75084137-01cb-4c86-a997-47c137257c9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:26.096229 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-75084137-01cb-4c86-a997-47c137257c9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:26.097704 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1260/2534] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:35:25 2022] DELETE /identity/v3/projects/159b2ee4c90547bbb8480cc7da18fa4a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:35:26.101696 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e348c8e-6ee3-4011-9525-b20d757a8d99 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:26.111973 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e348c8e-6ee3-4011-9525-b20d757a8d99 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:26.129418 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:35:26.168924 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3652e-5b3f-450d-8bcc-6ecea2c344d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:26.170094 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3652e-5b3f-450d-8bcc-6ecea2c344d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:26.170372 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3652e-5b3f-450d-8bcc-6ecea2c344d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:26.170642 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3652e-5b3f-450d-8bcc-6ecea2c344d6 admin admin] PATH_INFO: `/v3/users/2b7ac0f7fb2e438780a0f06af5b63495` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:26.171735 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a3652e-5b3f-450d-8bcc-6ecea2c344d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b7ac0f7fb2e438780a0f06af5b63495)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:26.173913 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a3652e-5b3f-450d-8bcc-6ecea2c344d6 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:26.218666 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-64a3652e-5b3f-450d-8bcc-6ecea2c344d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b7ac0f7fb2e438780a0f06af5b63495'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:26.219306 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-64a3652e-5b3f-450d-8bcc-6ecea2c344d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b7ac0f7fb2e438780a0f06af5b63495'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:26.230926 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-64a3652e-5b3f-450d-8bcc-6ecea2c344d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b7ac0f7fb2e438780a0f06af5b63495'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:26.238479 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-64a3652e-5b3f-450d-8bcc-6ecea2c344d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b7ac0f7fb2e438780a0f06af5b63495'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:26.245554 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-64a3652e-5b3f-450d-8bcc-6ecea2c344d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b7ac0f7fb2e438780a0f06af5b63495'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:26.251723 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1275/2535] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:35:26 2022] DELETE /identity/v3/users/2b7ac0f7fb2e438780a0f06af5b63495 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:35:26.527465 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75084137-01cb-4c86-a997-47c137257c9b admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:26.529534 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-75084137-01cb-4c86-a997-47c137257c9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:26.542926 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75084137-01cb-4c86-a997-47c137257c9b admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:26.600143 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f94ed5-00cd-41b3-b537-57d0f3d6ea03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:26.600794 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f94ed5-00cd-41b3-b537-57d0f3d6ea03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:26.601035 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f94ed5-00cd-41b3-b537-57d0f3d6ea03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:26.601309 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f94ed5-00cd-41b3-b537-57d0f3d6ea03 admin admin] PATH_INFO: `/v3/projects/6921df6ca731433086b4c81a778aed8b` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:26.602425 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f94ed5-00cd-41b3-b537-57d0f3d6ea03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6921df6ca731433086b4c81a778aed8b)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:26.604367 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f94ed5-00cd-41b3-b537-57d0f3d6ea03 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:26.634432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:35:26.652083 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-50f94ed5-00cd-41b3-b537-57d0f3d6ea03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6921df6ca731433086b4c81a778aed8b', 'request_id': 'req-50f94ed5-00cd-41b3-b537-57d0f3d6ea03'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:26.658411 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-50f94ed5-00cd-41b3-b537-57d0f3d6ea03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6921df6ca731433086b4c81a778aed8b', 'request_id': 'req-50f94ed5-00cd-41b3-b537-57d0f3d6ea03'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:26.666490 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-50f94ed5-00cd-41b3-b537-57d0f3d6ea03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6921df6ca731433086b4c81a778aed8b', 'request_id': 'req-50f94ed5-00cd-41b3-b537-57d0f3d6ea03'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:26.677081 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-50f94ed5-00cd-41b3-b537-57d0f3d6ea03 admin admin] The token cache is being invalidate because project 6921df6ca731433086b4c81a778aed8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:35:26.677369 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-50f94ed5-00cd-41b3-b537-57d0f3d6ea03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:26.677989 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-50f94ed5-00cd-41b3-b537-57d0f3d6ea03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:26.679461 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1261/2536] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:35:26 2022] DELETE /identity/v3/projects/6921df6ca731433086b4c81a778aed8b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:35:26.684260 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef48d09-bd98-4bfd-b66e-921370ef811d None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:26.685244 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef48d09-bd98-4bfd-b66e-921370ef811d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:26.685602 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef48d09-bd98-4bfd-b66e-921370ef811d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:26.705525 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-aef48d09-bd98-4bfd-b66e-921370ef811d None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:35:26.706668 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-aef48d09-bd98-4bfd-b66e-921370ef811d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:26.765970 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1276/2537] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:35:26.773869 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4076b-cab3-418c-b290-759affca66a3 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:26.774185 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4076b-cab3-418c-b290-759affca66a3 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:26.774466 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4076b-cab3-418c-b290-759affca66a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:26.795053 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-feb4076b-cab3-418c-b290-759affca66a3 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:35:26.796289 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-feb4076b-cab3-418c-b290-759affca66a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:26.804616 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1262/2538] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:35:26.808833 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef48d09-bd98-4bfd-b66e-921370ef811d None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:26.818482 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef48d09-bd98-4bfd-b66e-921370ef811d None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:26.822970 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8861a89-fbff-4c90-afba-95c1824085ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:26.823557 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8861a89-fbff-4c90-afba-95c1824085ed admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:26.823837 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8861a89-fbff-4c90-afba-95c1824085ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:26.824142 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8861a89-fbff-4c90-afba-95c1824085ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:26.824774 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8861a89-fbff-4c90-afba-95c1824085ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:35:26.825074 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8861a89-fbff-4c90-afba-95c1824085ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:26.826762 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8861a89-fbff-4c90-afba-95c1824085ed admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:26.838102 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1277/2539] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:35:26.842759 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4076b-cab3-418c-b290-759affca66a3 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:26.851962 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4076b-cab3-418c-b290-759affca66a3 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:26.857106 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1af612-c286-4c15-a75e-f4d44839e7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:26.857866 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1af612-c286-4c15-a75e-f4d44839e7c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:26.858142 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1af612-c286-4c15-a75e-f4d44839e7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:26.858411 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1af612-c286-4c15-a75e-f4d44839e7c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:26.859045 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1af612-c286-4c15-a75e-f4d44839e7c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:26.861252 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1af612-c286-4c15-a75e-f4d44839e7c4 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:26.888067 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1263/2540] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:35:26 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:35:26.892099 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8861a89-fbff-4c90-afba-95c1824085ed admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:26.901896 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8861a89-fbff-4c90-afba-95c1824085ed admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:26.928837 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:35:26.960534 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87902333-aaf8-45ab-96e2-d877c57a6dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:26.961074 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87902333-aaf8-45ab-96e2-d877c57a6dee admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:26.961363 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87902333-aaf8-45ab-96e2-d877c57a6dee admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:26.961638 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87902333-aaf8-45ab-96e2-d877c57a6dee admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:26.962266 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87902333-aaf8-45ab-96e2-d877c57a6dee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:26.964205 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87902333-aaf8-45ab-96e2-d877c57a6dee admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:26.985619 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1278/2541] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:35:26 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:35:26.989979 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1af612-c286-4c15-a75e-f4d44839e7c4 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:27.000549 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1af612-c286-4c15-a75e-f4d44839e7c4 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:27.005027 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddfa77d-3275-40cd-93d1-1466d56ac818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:27.005611 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddfa77d-3275-40cd-93d1-1466d56ac818 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:27.005885 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddfa77d-3275-40cd-93d1-1466d56ac818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:27.006153 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddfa77d-3275-40cd-93d1-1466d56ac818 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:27.006783 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddfa77d-3275-40cd-93d1-1466d56ac818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:27.008390 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddfa77d-3275-40cd-93d1-1466d56ac818 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:27.019151 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1264/2542] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:35:27.022968 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87902333-aaf8-45ab-96e2-d877c57a6dee admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:27.033554 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87902333-aaf8-45ab-96e2-d877c57a6dee admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:27.038133 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a609bf-4b73-4b50-a3b3-ab504fa55b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:27.038727 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a609bf-4b73-4b50-a3b3-ab504fa55b0e admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:27.039008 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a609bf-4b73-4b50-a3b3-ab504fa55b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:27.039287 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a609bf-4b73-4b50-a3b3-ab504fa55b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:27.039949 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a609bf-4b73-4b50-a3b3-ab504fa55b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:27.041526 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a609bf-4b73-4b50-a3b3-ab504fa55b0e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:27.052479 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1279/2543] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:35:27.056451 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddfa77d-3275-40cd-93d1-1466d56ac818 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:27.067270 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddfa77d-3275-40cd-93d1-1466d56ac818 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:27.071887 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296aa35-f7a7-4907-a4f9-d176319fe85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:27.072555 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296aa35-f7a7-4907-a4f9-d176319fe85e admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:27.072830 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296aa35-f7a7-4907-a4f9-d176319fe85e admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:27.073102 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296aa35-f7a7-4907-a4f9-d176319fe85e admin admin] PATH_INFO: `/v3/projects/0c5372bbe9784bf48fe5606b46f2b667/users/8443ea142e354e17b2bdac63f33f8f39/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:27.089536 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2296aa35-f7a7-4907-a4f9-d176319fe85e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c5372bbe9784bf48fe5606b46f2b667, user_id=8443ea142e354e17b2bdac63f33f8f39, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:27.092728 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2296aa35-f7a7-4907-a4f9-d176319fe85e admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:27.105199 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1265/2544] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:35:27 2022] PUT /identity/v3/projects/0c5372bbe9784bf48fe5606b46f2b667/users/8443ea142e354e17b2bdac63f33f8f39/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:35:27.116106 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2855c27-173b-48b6-aae5-25e396ca2990 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:27.116401 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2855c27-173b-48b6-aae5-25e396ca2990 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:27.116681 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2855c27-173b-48b6-aae5-25e396ca2990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:27.144670 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f2855c27-173b-48b6-aae5-25e396ca2990 None None] MFA Rules not processed for user `8443ea142e354e17b2bdac63f33f8f39`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:35:27.145895 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f2855c27-173b-48b6-aae5-25e396ca2990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:27.209546 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1280/2545] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:35:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:35:27.214260 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296aa35-f7a7-4907-a4f9-d176319fe85e admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:27.274722 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296aa35-f7a7-4907-a4f9-d176319fe85e admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:27.280358 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f22ed-c6ca-4077-b939-e5415e514550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:27.280951 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f22ed-c6ca-4077-b939-e5415e514550 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:27.281224 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f22ed-c6ca-4077-b939-e5415e514550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:27.281490 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f22ed-c6ca-4077-b939-e5415e514550 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:27.282105 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f22ed-c6ca-4077-b939-e5415e514550 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:27.283994 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f22ed-c6ca-4077-b939-e5415e514550 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:27.309787 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1266/2546] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:35:27 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:35:27.314107 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2855c27-173b-48b6-aae5-25e396ca2990 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:27.324589 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2855c27-173b-48b6-aae5-25e396ca2990 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:27.381349 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946604d3-7824-4a17-8d01-5c5834fe388c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:27.381941 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946604d3-7824-4a17-8d01-5c5834fe388c admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:27.382220 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946604d3-7824-4a17-8d01-5c5834fe388c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:27.382491 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946604d3-7824-4a17-8d01-5c5834fe388c admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:27.383110 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946604d3-7824-4a17-8d01-5c5834fe388c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:27.385021 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946604d3-7824-4a17-8d01-5c5834fe388c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:27.409512 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1281/2547] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:35:27 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:35:27.410655 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f22ed-c6ca-4077-b939-e5415e514550 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:27.421022 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f22ed-c6ca-4077-b939-e5415e514550 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:27.425833 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954a97d-76f3-47ce-982d-410c2ab398f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:27.426423 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954a97d-76f3-47ce-982d-410c2ab398f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:27.426700 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954a97d-76f3-47ce-982d-410c2ab398f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:27.426974 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954a97d-76f3-47ce-982d-410c2ab398f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:27.427633 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4954a97d-76f3-47ce-982d-410c2ab398f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:27.429241 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4954a97d-76f3-47ce-982d-410c2ab398f0 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:27.440422 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1267/2548] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:35:27.444531 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946604d3-7824-4a17-8d01-5c5834fe388c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:27.454424 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946604d3-7824-4a17-8d01-5c5834fe388c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:27.459019 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce15cf9-fc8b-4960-986a-9d612df19fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:27.459664 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce15cf9-fc8b-4960-986a-9d612df19fbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:27.459982 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce15cf9-fc8b-4960-986a-9d612df19fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:27.460261 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce15cf9-fc8b-4960-986a-9d612df19fbb admin admin] PATH_INFO: `/v3/projects/47372020a98c4135b60bc5d412a828cf/users/dd31da6be83a4216800103d1a4411a81/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:27.476636 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce15cf9-fc8b-4960-986a-9d612df19fbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=47372020a98c4135b60bc5d412a828cf, user_id=dd31da6be83a4216800103d1a4411a81, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:27.479214 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce15cf9-fc8b-4960-986a-9d612df19fbb admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:27.493012 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1282/2549] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:35:27 2022] PUT /identity/v3/projects/47372020a98c4135b60bc5d412a828cf/users/dd31da6be83a4216800103d1a4411a81/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:35:27.497034 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954a97d-76f3-47ce-982d-410c2ab398f0 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:27.507227 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954a97d-76f3-47ce-982d-410c2ab398f0 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:27.526519 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:35:27.565356 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18764dd1-6514-433b-8b4d-50425738b43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:27.565947 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18764dd1-6514-433b-8b4d-50425738b43e admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:27.566222 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18764dd1-6514-433b-8b4d-50425738b43e admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:27.566492 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18764dd1-6514-433b-8b4d-50425738b43e admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:27.567118 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18764dd1-6514-433b-8b4d-50425738b43e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:27.568728 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18764dd1-6514-433b-8b4d-50425738b43e admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:27.578327 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1268/2550] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:35:27.582451 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce15cf9-fc8b-4960-986a-9d612df19fbb admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:27.587800 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:35:27.594950 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce15cf9-fc8b-4960-986a-9d612df19fbb admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:27.600049 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc606f-bcca-45d6-8791-09a86ebe7b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:27.600723 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc606f-bcca-45d6-8791-09a86ebe7b4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:27.601035 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc606f-bcca-45d6-8791-09a86ebe7b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:27.601330 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc606f-bcca-45d6-8791-09a86ebe7b4e admin admin] PATH_INFO: `/v3/projects/47372020a98c4135b60bc5d412a828cf/users/dd31da6be83a4216800103d1a4411a81/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:27.603213 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bc606f-bcca-45d6-8791-09a86ebe7b4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=47372020a98c4135b60bc5d412a828cf, user_id=dd31da6be83a4216800103d1a4411a81, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:27.605826 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bc606f-bcca-45d6-8791-09a86ebe7b4e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:27.616411 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1283/2551] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:35:27 2022] PUT /identity/v3/projects/47372020a98c4135b60bc5d412a828cf/users/dd31da6be83a4216800103d1a4411a81/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:35:27.627615 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29328f-7703-4136-b93b-9c9d4bd45ef2 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:27.628138 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29328f-7703-4136-b93b-9c9d4bd45ef2 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:27.628245 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29328f-7703-4136-b93b-9c9d4bd45ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:27.655784 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-5d29328f-7703-4136-b93b-9c9d4bd45ef2 None None] MFA Rules not processed for user `dd31da6be83a4216800103d1a4411a81`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:35:27.657013 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-5d29328f-7703-4136-b93b-9c9d4bd45ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:27.726418 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1269/2552] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:35:27 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:35:27.737721 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc606f-bcca-45d6-8791-09a86ebe7b4e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:27.739488 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-67bc606f-bcca-45d6-8791-09a86ebe7b4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:27.796248 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc606f-bcca-45d6-8791-09a86ebe7b4e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:27.800177 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179b6a6-3928-46f6-b014-4b96a736f364 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:27.800774 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179b6a6-3928-46f6-b014-4b96a736f364 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:27.801053 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179b6a6-3928-46f6-b014-4b96a736f364 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:27.801324 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179b6a6-3928-46f6-b014-4b96a736f364 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:27.856301 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f179b6a6-3928-46f6-b014-4b96a736f364 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:27.857763 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f179b6a6-3928-46f6-b014-4b96a736f364 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:27.866418 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1284/2553] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:35:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:35:29.233622 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29328f-7703-4136-b93b-9c9d4bd45ef2 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:29.235012 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-5d29328f-7703-4136-b93b-9c9d4bd45ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:29.247014 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29328f-7703-4136-b93b-9c9d4bd45ef2 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:29.251302 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16bde0-8b33-4977-87e9-1945666c9c79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:29.251919 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16bde0-8b33-4977-87e9-1945666c9c79 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:29.252204 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16bde0-8b33-4977-87e9-1945666c9c79 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:29.252478 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16bde0-8b33-4977-87e9-1945666c9c79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:29.261273 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a16bde0-8b33-4977-87e9-1945666c9c79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:29.262693 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a16bde0-8b33-4977-87e9-1945666c9c79 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:29.272081 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1270/2554] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:35:29 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:35:33.021711 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179b6a6-3928-46f6-b014-4b96a736f364 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:33.082611 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179b6a6-3928-46f6-b014-4b96a736f364 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:33.087023 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420b2a8-4853-4ee0-a402-2e7a6b95fc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:33.087636 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420b2a8-4853-4ee0-a402-2e7a6b95fc5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:33.087919 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420b2a8-4853-4ee0-a402-2e7a6b95fc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:33.088202 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420b2a8-4853-4ee0-a402-2e7a6b95fc5c admin admin] PATH_INFO: `/v3/users/8443ea142e354e17b2bdac63f33f8f39` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:33.089294 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420b2a8-4853-4ee0-a402-2e7a6b95fc5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8443ea142e354e17b2bdac63f33f8f39)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:33.091266 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420b2a8-4853-4ee0-a402-2e7a6b95fc5c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:33.135502 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:35:33.137131 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7420b2a8-4853-4ee0-a402-2e7a6b95fc5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8443ea142e354e17b2bdac63f33f8f39'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:33.137941 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7420b2a8-4853-4ee0-a402-2e7a6b95fc5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8443ea142e354e17b2bdac63f33f8f39'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:33.152026 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7420b2a8-4853-4ee0-a402-2e7a6b95fc5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8443ea142e354e17b2bdac63f33f8f39'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:33.159180 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7420b2a8-4853-4ee0-a402-2e7a6b95fc5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8443ea142e354e17b2bdac63f33f8f39'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:33.165999 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7420b2a8-4853-4ee0-a402-2e7a6b95fc5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8443ea142e354e17b2bdac63f33f8f39'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:33.172671 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1285/2555] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:35:33 2022] DELETE /identity/v3/users/8443ea142e354e17b2bdac63f33f8f39 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:35:33.177085 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49ba27-f77f-4957-97ee-f6326c593c87 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:33.177561 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49ba27-f77f-4957-97ee-f6326c593c87 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:33.177662 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49ba27-f77f-4957-97ee-f6326c593c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:33.196876 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-be49ba27-f77f-4957-97ee-f6326c593c87 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:35:33.198061 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-be49ba27-f77f-4957-97ee-f6326c593c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:33.255428 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1271/2556] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:35:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:35:33.265310 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420b2a8-4853-4ee0-a402-2e7a6b95fc5c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:33.266736 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7420b2a8-4853-4ee0-a402-2e7a6b95fc5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:33.323594 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420b2a8-4853-4ee0-a402-2e7a6b95fc5c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:33.327384 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cca8e6-e2c0-4b66-9980-c192b3d9bbdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:33.328015 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cca8e6-e2c0-4b66-9980-c192b3d9bbdf service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:33.328297 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cca8e6-e2c0-4b66-9980-c192b3d9bbdf service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:33.328571 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cca8e6-e2c0-4b66-9980-c192b3d9bbdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:33.337403 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cca8e6-e2c0-4b66-9980-c192b3d9bbdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:33.338807 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cca8e6-e2c0-4b66-9980-c192b3d9bbdf service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:33.348773 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1286/2557] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:35:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:35:33.614798 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49ba27-f77f-4957-97ee-f6326c593c87 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:33.616299 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-be49ba27-f77f-4957-97ee-f6326c593c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:33.628497 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49ba27-f77f-4957-97ee-f6326c593c87 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:33.633118 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebfaf2-3d8a-4fe7-b83b-44906c910de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:33.633771 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebfaf2-3d8a-4fe7-b83b-44906c910de4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:33.634055 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebfaf2-3d8a-4fe7-b83b-44906c910de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:33.634324 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebfaf2-3d8a-4fe7-b83b-44906c910de4 admin admin] PATH_INFO: `/v3/projects/0c5372bbe9784bf48fe5606b46f2b667` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:33.635436 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ebfaf2-3d8a-4fe7-b83b-44906c910de4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c5372bbe9784bf48fe5606b46f2b667)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:33.637393 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ebfaf2-3d8a-4fe7-b83b-44906c910de4 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:33.670640 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:35:33.686839 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-72ebfaf2-3d8a-4fe7-b83b-44906c910de4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c5372bbe9784bf48fe5606b46f2b667', 'request_id': 'req-72ebfaf2-3d8a-4fe7-b83b-44906c910de4'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:33.692951 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-72ebfaf2-3d8a-4fe7-b83b-44906c910de4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c5372bbe9784bf48fe5606b46f2b667', 'request_id': 'req-72ebfaf2-3d8a-4fe7-b83b-44906c910de4'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:33.700214 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-72ebfaf2-3d8a-4fe7-b83b-44906c910de4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c5372bbe9784bf48fe5606b46f2b667', 'request_id': 'req-72ebfaf2-3d8a-4fe7-b83b-44906c910de4'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:33.711796 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-72ebfaf2-3d8a-4fe7-b83b-44906c910de4 admin admin] The token cache is being invalidate because project 0c5372bbe9784bf48fe5606b46f2b667 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:35:33.712125 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-72ebfaf2-3d8a-4fe7-b83b-44906c910de4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:33.712746 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-72ebfaf2-3d8a-4fe7-b83b-44906c910de4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:33.714249 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1272/2558] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:35:33 2022] DELETE /identity/v3/projects/0c5372bbe9784bf48fe5606b46f2b667 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:35:33.718792 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cca8e6-e2c0-4b66-9980-c192b3d9bbdf service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:33.728464 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cca8e6-e2c0-4b66-9980-c192b3d9bbdf service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:33.785858 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835434ad-a2b8-46d6-a582-b88c7a02e242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:33.786492 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835434ad-a2b8-46d6-a582-b88c7a02e242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:33.786767 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835434ad-a2b8-46d6-a582-b88c7a02e242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:33.787043 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835434ad-a2b8-46d6-a582-b88c7a02e242 admin admin] PATH_INFO: `/v3/users/dd31da6be83a4216800103d1a4411a81` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:33.788192 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835434ad-a2b8-46d6-a582-b88c7a02e242 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd31da6be83a4216800103d1a4411a81)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:33.790176 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835434ad-a2b8-46d6-a582-b88c7a02e242 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:33.834591 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-835434ad-a2b8-46d6-a582-b88c7a02e242 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd31da6be83a4216800103d1a4411a81'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:33.835231 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-835434ad-a2b8-46d6-a582-b88c7a02e242 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd31da6be83a4216800103d1a4411a81'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:33.847182 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-835434ad-a2b8-46d6-a582-b88c7a02e242 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd31da6be83a4216800103d1a4411a81'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:33.849669 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:35:33.854594 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-835434ad-a2b8-46d6-a582-b88c7a02e242 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd31da6be83a4216800103d1a4411a81'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:33.864721 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-835434ad-a2b8-46d6-a582-b88c7a02e242 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd31da6be83a4216800103d1a4411a81'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:33.870873 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1287/2559] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:35:33 2022] DELETE /identity/v3/users/dd31da6be83a4216800103d1a4411a81 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:35:34.141623 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebfaf2-3d8a-4fe7-b83b-44906c910de4 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:34.143107 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-72ebfaf2-3d8a-4fe7-b83b-44906c910de4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:34.159758 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebfaf2-3d8a-4fe7-b83b-44906c910de4 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:34.218292 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b114f-44b4-457c-bf8d-3187d2b97594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:34.218921 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b114f-44b4-457c-bf8d-3187d2b97594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:34.219193 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b114f-44b4-457c-bf8d-3187d2b97594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:34.219444 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b114f-44b4-457c-bf8d-3187d2b97594 admin admin] PATH_INFO: `/v3/projects/47372020a98c4135b60bc5d412a828cf` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:34.220583 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b114f-44b4-457c-bf8d-3187d2b97594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47372020a98c4135b60bc5d412a828cf)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:34.222457 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b114f-44b4-457c-bf8d-3187d2b97594 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:34.269956 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-944b114f-44b4-457c-bf8d-3187d2b97594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47372020a98c4135b60bc5d412a828cf', 'request_id': 'req-944b114f-44b4-457c-bf8d-3187d2b97594'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:34.276311 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-944b114f-44b4-457c-bf8d-3187d2b97594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47372020a98c4135b60bc5d412a828cf', 'request_id': 'req-944b114f-44b4-457c-bf8d-3187d2b97594'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:34.285875 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-944b114f-44b4-457c-bf8d-3187d2b97594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47372020a98c4135b60bc5d412a828cf', 'request_id': 'req-944b114f-44b4-457c-bf8d-3187d2b97594'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:34.296446 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-944b114f-44b4-457c-bf8d-3187d2b97594 admin admin] The token cache is being invalidate because project 47372020a98c4135b60bc5d412a828cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:35:34.296735 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-944b114f-44b4-457c-bf8d-3187d2b97594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:34.297613 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-944b114f-44b4-457c-bf8d-3187d2b97594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:34.299097 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1273/2560] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:35:34 2022] DELETE /identity/v3/projects/47372020a98c4135b60bc5d412a828cf => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:35:34.303925 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8f800-4a2a-4ed3-a4ee-c8421d01a6e2 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:34.304405 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8f800-4a2a-4ed3-a4ee-c8421d01a6e2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:34.304512 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8f800-4a2a-4ed3-a4ee-c8421d01a6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:34.324255 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d1b8f800-4a2a-4ed3-a4ee-c8421d01a6e2 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:35:34.325380 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d1b8f800-4a2a-4ed3-a4ee-c8421d01a6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:34.384420 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1288/2561] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:35:34.392703 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8d742-c257-4515-ac79-86817bc3690d None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:34.392988 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8d742-c257-4515-ac79-86817bc3690d None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:34.393272 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8d742-c257-4515-ac79-86817bc3690d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:34.412935 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-7ec8d742-c257-4515-ac79-86817bc3690d None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:35:34.414133 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-7ec8d742-c257-4515-ac79-86817bc3690d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:34.422120 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1274/2562] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:35:34.426480 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8f800-4a2a-4ed3-a4ee-c8421d01a6e2 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:34.437040 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8f800-4a2a-4ed3-a4ee-c8421d01a6e2 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:34.441637 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89385b1b-9677-48ba-94c4-28175005493b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:34.442232 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89385b1b-9677-48ba-94c4-28175005493b admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:34.442512 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89385b1b-9677-48ba-94c4-28175005493b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:34.442786 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89385b1b-9677-48ba-94c4-28175005493b admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:34.443421 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89385b1b-9677-48ba-94c4-28175005493b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:35:34.443723 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89385b1b-9677-48ba-94c4-28175005493b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:34.445345 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89385b1b-9677-48ba-94c4-28175005493b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:34.457263 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1289/2563] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:35:34.461508 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8d742-c257-4515-ac79-86817bc3690d None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:34.471161 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8d742-c257-4515-ac79-86817bc3690d None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:34.475803 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23382cc-9389-44e9-bbff-0d9f88e2cff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:34.476432 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23382cc-9389-44e9-bbff-0d9f88e2cff4 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:34.476714 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23382cc-9389-44e9-bbff-0d9f88e2cff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:34.476994 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23382cc-9389-44e9-bbff-0d9f88e2cff4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:34.477627 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23382cc-9389-44e9-bbff-0d9f88e2cff4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:34.479511 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23382cc-9389-44e9-bbff-0d9f88e2cff4 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:34.508939 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1275/2564] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:35:34 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:35:34.513573 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89385b1b-9677-48ba-94c4-28175005493b admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:34.523451 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89385b1b-9677-48ba-94c4-28175005493b admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:34.580079 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ee072-96d2-49f5-92fe-8657f3f60f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:34.580607 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ee072-96d2-49f5-92fe-8657f3f60f41 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:34.580889 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ee072-96d2-49f5-92fe-8657f3f60f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:34.581165 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ee072-96d2-49f5-92fe-8657f3f60f41 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:34.581799 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ee072-96d2-49f5-92fe-8657f3f60f41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:34.583701 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ee072-96d2-49f5-92fe-8657f3f60f41 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:34.604573 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1290/2565] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:35:34 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:35:34.608839 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23382cc-9389-44e9-bbff-0d9f88e2cff4 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:34.618946 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23382cc-9389-44e9-bbff-0d9f88e2cff4 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:34.624027 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90274ccc-9a3c-43dc-9bfd-aee456c8a34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:34.624611 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90274ccc-9a3c-43dc-9bfd-aee456c8a34d admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:34.624883 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90274ccc-9a3c-43dc-9bfd-aee456c8a34d admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:34.625150 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90274ccc-9a3c-43dc-9bfd-aee456c8a34d admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:34.625805 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90274ccc-9a3c-43dc-9bfd-aee456c8a34d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:34.627370 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90274ccc-9a3c-43dc-9bfd-aee456c8a34d admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:34.637025 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1276/2566] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:35:34.641330 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ee072-96d2-49f5-92fe-8657f3f60f41 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:34.650986 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ee072-96d2-49f5-92fe-8657f3f60f41 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:34.656839 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b3dae-9355-4c60-9e88-83a265e379ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:34.657427 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b3dae-9355-4c60-9e88-83a265e379ce admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:34.657701 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b3dae-9355-4c60-9e88-83a265e379ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:34.657971 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b3dae-9355-4c60-9e88-83a265e379ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:34.658679 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b3dae-9355-4c60-9e88-83a265e379ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:34.660405 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b3dae-9355-4c60-9e88-83a265e379ce admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:34.672702 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1291/2567] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:35:34.676715 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90274ccc-9a3c-43dc-9bfd-aee456c8a34d admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:34.686867 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90274ccc-9a3c-43dc-9bfd-aee456c8a34d admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:34.691356 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b3ab0-8ffe-4e49-8c20-c2986638880b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:34.692022 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b3ab0-8ffe-4e49-8c20-c2986638880b admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:34.692298 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b3ab0-8ffe-4e49-8c20-c2986638880b admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:34.692593 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b3ab0-8ffe-4e49-8c20-c2986638880b admin admin] PATH_INFO: `/v3/projects/09f6622650a348f29cbbfb4ba3df28de/users/e5be6099b9bc449dbf9017ff41f0591a/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:34.694735 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:35:34.710269 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b3ab0-8ffe-4e49-8c20-c2986638880b admin admin] RBAC: Authorizing `identity:create_grant(project_id=09f6622650a348f29cbbfb4ba3df28de, user_id=e5be6099b9bc449dbf9017ff41f0591a, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:34.712983 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b3ab0-8ffe-4e49-8c20-c2986638880b admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:34.725715 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1277/2568] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:35:34 2022] PUT /identity/v3/projects/09f6622650a348f29cbbfb4ba3df28de/users/e5be6099b9bc449dbf9017ff41f0591a/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:35:34.792219 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0bfd8-d575-4491-9c4f-224da2a3319a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:34.792507 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0bfd8-d575-4491-9c4f-224da2a3319a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:34.792787 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0bfd8-d575-4491-9c4f-224da2a3319a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:34.821227 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-95f0bfd8-d575-4491-9c4f-224da2a3319a None None] MFA Rules not processed for user `e5be6099b9bc449dbf9017ff41f0591a`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:35:34.822430 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-95f0bfd8-d575-4491-9c4f-224da2a3319a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:34.862598 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:35:34.889857 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1292/2569] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:35:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:35:34.894279 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b3ab0-8ffe-4e49-8c20-c2986638880b admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:34.955525 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b3ab0-8ffe-4e49-8c20-c2986638880b admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:34.960193 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f58ac-f6a7-46db-bd2a-2858054ea021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:34.960787 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f58ac-f6a7-46db-bd2a-2858054ea021 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:34.961064 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f58ac-f6a7-46db-bd2a-2858054ea021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:34.961332 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f58ac-f6a7-46db-bd2a-2858054ea021 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:34.961995 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f58ac-f6a7-46db-bd2a-2858054ea021 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:34.963934 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f58ac-f6a7-46db-bd2a-2858054ea021 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:34.990510 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1278/2570] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:35:34 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:35:34.994727 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0bfd8-d575-4491-9c4f-224da2a3319a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:35.005554 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0bfd8-d575-4491-9c4f-224da2a3319a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:35.062119 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823ca38-9baf-4dcc-ac6f-dbb47756f725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:35.062731 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823ca38-9baf-4dcc-ac6f-dbb47756f725 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:35.063013 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823ca38-9baf-4dcc-ac6f-dbb47756f725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:35.063290 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823ca38-9baf-4dcc-ac6f-dbb47756f725 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:35.063982 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823ca38-9baf-4dcc-ac6f-dbb47756f725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:35.065901 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823ca38-9baf-4dcc-ac6f-dbb47756f725 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:35.086435 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1293/2571] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:35:34 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:35:35.090732 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f58ac-f6a7-46db-bd2a-2858054ea021 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:35.102028 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f58ac-f6a7-46db-bd2a-2858054ea021 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:35.106643 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a128c-6f2b-451b-b321-4bf3bc3138bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:35.107839 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a128c-6f2b-451b-b321-4bf3bc3138bc admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:35.108142 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a128c-6f2b-451b-b321-4bf3bc3138bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:35.108410 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a128c-6f2b-451b-b321-4bf3bc3138bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:35.109037 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a128c-6f2b-451b-b321-4bf3bc3138bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:35.110610 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a128c-6f2b-451b-b321-4bf3bc3138bc admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:35.121087 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1279/2572] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:35:35.125444 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823ca38-9baf-4dcc-ac6f-dbb47756f725 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:35.135373 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823ca38-9baf-4dcc-ac6f-dbb47756f725 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:35.140183 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5e3d1-32c7-4570-84ad-a15b6e58d9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:35.140833 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5e3d1-32c7-4570-84ad-a15b6e58d9b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:35.141111 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5e3d1-32c7-4570-84ad-a15b6e58d9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:35.141386 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5e3d1-32c7-4570-84ad-a15b6e58d9b5 admin admin] PATH_INFO: `/v3/projects/7347bb5bff184c1faefa48cd6b202ff0/users/df45453aa78f4645a2c06c47a4cc2d1e/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:35.156753 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5e3d1-32c7-4570-84ad-a15b6e58d9b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7347bb5bff184c1faefa48cd6b202ff0, user_id=df45453aa78f4645a2c06c47a4cc2d1e, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:35.159478 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5e3d1-32c7-4570-84ad-a15b6e58d9b5 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:35.173131 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1294/2573] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:35:35 2022] PUT /identity/v3/projects/7347bb5bff184c1faefa48cd6b202ff0/users/df45453aa78f4645a2c06c47a4cc2d1e/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:35:35.177026 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a128c-6f2b-451b-b321-4bf3bc3138bc admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:35.187099 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a128c-6f2b-451b-b321-4bf3bc3138bc admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:35.242775 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eca7a4-1656-44f7-b9c2-790d8a4a1586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:35.243393 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eca7a4-1656-44f7-b9c2-790d8a4a1586 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:35.243634 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eca7a4-1656-44f7-b9c2-790d8a4a1586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:35.243927 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eca7a4-1656-44f7-b9c2-790d8a4a1586 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:35.244557 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eca7a4-1656-44f7-b9c2-790d8a4a1586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:35.246125 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eca7a4-1656-44f7-b9c2-790d8a4a1586 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:35.256323 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1280/2574] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:35:35.260796 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5e3d1-32c7-4570-84ad-a15b6e58d9b5 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:35.270996 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5e3d1-32c7-4570-84ad-a15b6e58d9b5 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:35.275646 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a535683-bd59-4124-9b94-bcb71e4a350f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:35.276335 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a535683-bd59-4124-9b94-bcb71e4a350f admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:35.276617 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a535683-bd59-4124-9b94-bcb71e4a350f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:35.276894 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a535683-bd59-4124-9b94-bcb71e4a350f admin admin] PATH_INFO: `/v3/projects/7347bb5bff184c1faefa48cd6b202ff0/users/df45453aa78f4645a2c06c47a4cc2d1e/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:35.278938 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a535683-bd59-4124-9b94-bcb71e4a350f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7347bb5bff184c1faefa48cd6b202ff0, user_id=df45453aa78f4645a2c06c47a4cc2d1e, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:35.281748 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a535683-bd59-4124-9b94-bcb71e4a350f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:35.298327 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1295/2575] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:35:35 2022] PUT /identity/v3/projects/7347bb5bff184c1faefa48cd6b202ff0/users/df45453aa78f4645a2c06c47a4cc2d1e/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:35:35.308373 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e996134-b798-4be5-9d8c-37e198480f75 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:35.308660 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e996134-b798-4be5-9d8c-37e198480f75 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:35.308932 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e996134-b798-4be5-9d8c-37e198480f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:35.336930 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-9e996134-b798-4be5-9d8c-37e198480f75 None None] MFA Rules not processed for user `df45453aa78f4645a2c06c47a4cc2d1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:35:35.338134 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-9e996134-b798-4be5-9d8c-37e198480f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:35.380729 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:35:35.407615 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1281/2576] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:35:35 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:35:35.418457 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a535683-bd59-4124-9b94-bcb71e4a350f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:35.421181 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5a535683-bd59-4124-9b94-bcb71e4a350f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:35.478932 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a535683-bd59-4124-9b94-bcb71e4a350f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:35.482727 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9f475-1a4e-4431-ade4-0e5ad121a45b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:35.483323 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9f475-1a4e-4431-ade4-0e5ad121a45b service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:35.483602 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9f475-1a4e-4431-ade4-0e5ad121a45b service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:35.483876 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9f475-1a4e-4431-ade4-0e5ad121a45b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:35.492738 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9f475-1a4e-4431-ade4-0e5ad121a45b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:35.494158 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9f475-1a4e-4431-ade4-0e5ad121a45b service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:35.503520 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1296/2577] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:35:35 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:35:36.040157 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e996134-b798-4be5-9d8c-37e198480f75 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:36.101329 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e996134-b798-4be5-9d8c-37e198480f75 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:36.105778 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a7d0a-eb87-4540-b480-1666eb0b0f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:36.106398 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a7d0a-eb87-4540-b480-1666eb0b0f17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:36.107167 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a7d0a-eb87-4540-b480-1666eb0b0f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:36.107439 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a7d0a-eb87-4540-b480-1666eb0b0f17 admin admin] PATH_INFO: `/v3/users/e5be6099b9bc449dbf9017ff41f0591a` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:36.108564 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980a7d0a-eb87-4540-b480-1666eb0b0f17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5be6099b9bc449dbf9017ff41f0591a)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:36.110446 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980a7d0a-eb87-4540-b480-1666eb0b0f17 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:36.156820 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-980a7d0a-eb87-4540-b480-1666eb0b0f17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5be6099b9bc449dbf9017ff41f0591a'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:36.168725 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-980a7d0a-eb87-4540-b480-1666eb0b0f17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5be6099b9bc449dbf9017ff41f0591a'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:36.169863 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-980a7d0a-eb87-4540-b480-1666eb0b0f17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5be6099b9bc449dbf9017ff41f0591a'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:36.177251 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-980a7d0a-eb87-4540-b480-1666eb0b0f17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5be6099b9bc449dbf9017ff41f0591a'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:36.177967 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-980a7d0a-eb87-4540-b480-1666eb0b0f17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5be6099b9bc449dbf9017ff41f0591a'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:36.190865 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1282/2578] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:35:36 2022] DELETE /identity/v3/users/e5be6099b9bc449dbf9017ff41f0591a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:35:36.195303 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbd932-4839-4f52-bdb6-4b8157b1bd44 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:36.195588 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbd932-4839-4f52-bdb6-4b8157b1bd44 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:36.195861 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbd932-4839-4f52-bdb6-4b8157b1bd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:36.214725 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-1fcbd932-4839-4f52-bdb6-4b8157b1bd44 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:35:36.215968 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1fcbd932-4839-4f52-bdb6-4b8157b1bd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:36.245753 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:35:36.274924 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1297/2579] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:35:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:35:36.284878 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a7d0a-eb87-4540-b480-1666eb0b0f17 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:36.286266 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-980a7d0a-eb87-4540-b480-1666eb0b0f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:36.344010 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a7d0a-eb87-4540-b480-1666eb0b0f17 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:36.347657 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c3595-72cd-44e0-808f-b460319b58c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:36.348298 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c3595-72cd-44e0-808f-b460319b58c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:36.348577 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c3595-72cd-44e0-808f-b460319b58c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:36.348850 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c3595-72cd-44e0-808f-b460319b58c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:36.357887 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c3595-72cd-44e0-808f-b460319b58c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:36.359333 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c3595-72cd-44e0-808f-b460319b58c2 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:36.364519 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:35:36.369916 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1283/2580] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:35:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:35:36.649109 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcbd932-4839-4f52-bdb6-4b8157b1bd44 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:36.650570 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1fcbd932-4839-4f52-bdb6-4b8157b1bd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:36.663449 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcbd932-4839-4f52-bdb6-4b8157b1bd44 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:36.668624 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820020c-2640-4c19-990a-f3667fd2ddce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:36.670738 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820020c-2640-4c19-990a-f3667fd2ddce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:36.671023 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820020c-2640-4c19-990a-f3667fd2ddce admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:36.671301 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820020c-2640-4c19-990a-f3667fd2ddce admin admin] PATH_INFO: `/v3/projects/09f6622650a348f29cbbfb4ba3df28de` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:36.672817 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820020c-2640-4c19-990a-f3667fd2ddce admin admin] RBAC: Authorizing `identity:delete_project(project_id=09f6622650a348f29cbbfb4ba3df28de)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:36.674781 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820020c-2640-4c19-990a-f3667fd2ddce admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:36.724936 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f820020c-2640-4c19-990a-f3667fd2ddce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09f6622650a348f29cbbfb4ba3df28de', 'request_id': 'req-f820020c-2640-4c19-990a-f3667fd2ddce'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:36.734037 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f820020c-2640-4c19-990a-f3667fd2ddce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09f6622650a348f29cbbfb4ba3df28de', 'request_id': 'req-f820020c-2640-4c19-990a-f3667fd2ddce'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:36.739731 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f820020c-2640-4c19-990a-f3667fd2ddce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09f6622650a348f29cbbfb4ba3df28de', 'request_id': 'req-f820020c-2640-4c19-990a-f3667fd2ddce'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:36.750918 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f820020c-2640-4c19-990a-f3667fd2ddce admin admin] The token cache is being invalidate because project 09f6622650a348f29cbbfb4ba3df28de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:35:36.751208 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f820020c-2640-4c19-990a-f3667fd2ddce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:36.751850 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f820020c-2640-4c19-990a-f3667fd2ddce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:36.753357 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1298/2581] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:35:36 2022] DELETE /identity/v3/projects/09f6622650a348f29cbbfb4ba3df28de => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:35:36.757748 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c3595-72cd-44e0-808f-b460319b58c2 service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:36.768028 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c3595-72cd-44e0-808f-b460319b58c2 service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:36.823754 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93924e-e38a-4b5e-b418-eb6b9b4542e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:36.824395 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93924e-e38a-4b5e-b418-eb6b9b4542e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:36.824674 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93924e-e38a-4b5e-b418-eb6b9b4542e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:36.824945 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93924e-e38a-4b5e-b418-eb6b9b4542e6 admin admin] PATH_INFO: `/v3/users/df45453aa78f4645a2c06c47a4cc2d1e` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:36.826667 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f93924e-e38a-4b5e-b418-eb6b9b4542e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df45453aa78f4645a2c06c47a4cc2d1e)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:36.828636 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f93924e-e38a-4b5e-b418-eb6b9b4542e6 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:36.874281 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0f93924e-e38a-4b5e-b418-eb6b9b4542e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df45453aa78f4645a2c06c47a4cc2d1e'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:36.886209 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0f93924e-e38a-4b5e-b418-eb6b9b4542e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df45453aa78f4645a2c06c47a4cc2d1e'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:36.886868 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0f93924e-e38a-4b5e-b418-eb6b9b4542e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df45453aa78f4645a2c06c47a4cc2d1e'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:36.894867 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0f93924e-e38a-4b5e-b418-eb6b9b4542e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df45453aa78f4645a2c06c47a4cc2d1e'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:36.895491 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0f93924e-e38a-4b5e-b418-eb6b9b4542e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df45453aa78f4645a2c06c47a4cc2d1e'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:36.908229 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1284/2582] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:35:36 2022] DELETE /identity/v3/users/df45453aa78f4645a2c06c47a4cc2d1e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:35:37.176564 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820020c-2640-4c19-990a-f3667fd2ddce admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:37.178048 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f820020c-2640-4c19-990a-f3667fd2ddce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:37.194230 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820020c-2640-4c19-990a-f3667fd2ddce admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:37.253128 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445e65d-5f58-4260-8e10-53fc47451e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:37.253674 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445e65d-5f58-4260-8e10-53fc47451e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:37.253953 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445e65d-5f58-4260-8e10-53fc47451e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:37.254221 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445e65d-5f58-4260-8e10-53fc47451e22 admin admin] PATH_INFO: `/v3/projects/7347bb5bff184c1faefa48cd6b202ff0` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:37.255310 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445e65d-5f58-4260-8e10-53fc47451e22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7347bb5bff184c1faefa48cd6b202ff0)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:37.257451 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445e65d-5f58-4260-8e10-53fc47451e22 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:37.303563 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5445e65d-5f58-4260-8e10-53fc47451e22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7347bb5bff184c1faefa48cd6b202ff0', 'request_id': 'req-5445e65d-5f58-4260-8e10-53fc47451e22'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:37.310781 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5445e65d-5f58-4260-8e10-53fc47451e22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7347bb5bff184c1faefa48cd6b202ff0', 'request_id': 'req-5445e65d-5f58-4260-8e10-53fc47451e22'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:37.314603 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:35:37.316988 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5445e65d-5f58-4260-8e10-53fc47451e22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7347bb5bff184c1faefa48cd6b202ff0', 'request_id': 'req-5445e65d-5f58-4260-8e10-53fc47451e22'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:37.329895 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5445e65d-5f58-4260-8e10-53fc47451e22 admin admin] The token cache is being invalidate because project 7347bb5bff184c1faefa48cd6b202ff0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:35:37.330180 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5445e65d-5f58-4260-8e10-53fc47451e22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:37.330808 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5445e65d-5f58-4260-8e10-53fc47451e22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:37.332302 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1299/2583] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:35:37 2022] DELETE /identity/v3/projects/7347bb5bff184c1faefa48cd6b202ff0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:35:37.337148 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0ab1c-feeb-4ab7-99a9-bb5447775a28 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:37.337642 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0ab1c-feeb-4ab7-99a9-bb5447775a28 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:37.337761 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0ab1c-feeb-4ab7-99a9-bb5447775a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:37.358706 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-c6d0ab1c-feeb-4ab7-99a9-bb5447775a28 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:35:37.359888 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c6d0ab1c-feeb-4ab7-99a9-bb5447775a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:37.418373 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1285/2584] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:35:37.427066 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da17100-f1ef-45fd-b0ab-0e1cd74af50b None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:37.427350 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da17100-f1ef-45fd-b0ab-0e1cd74af50b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:37.427626 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da17100-f1ef-45fd-b0ab-0e1cd74af50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:37.449169 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-5da17100-f1ef-45fd-b0ab-0e1cd74af50b None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:35:37.450871 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5da17100-f1ef-45fd-b0ab-0e1cd74af50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:37.458950 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1300/2585] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:35:37.463235 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0ab1c-feeb-4ab7-99a9-bb5447775a28 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:37.473724 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0ab1c-feeb-4ab7-99a9-bb5447775a28 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:37.478571 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca1a6b-ea4f-41d5-b012-f94fce074be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:37.479164 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca1a6b-ea4f-41d5-b012-f94fce074be0 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:37.479442 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca1a6b-ea4f-41d5-b012-f94fce074be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:37.479742 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca1a6b-ea4f-41d5-b012-f94fce074be0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:37.480414 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca1a6b-ea4f-41d5-b012-f94fce074be0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:35:37.480715 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca1a6b-ea4f-41d5-b012-f94fce074be0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:37.482522 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca1a6b-ea4f-41d5-b012-f94fce074be0 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:37.493910 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1286/2586] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:35:37.498200 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da17100-f1ef-45fd-b0ab-0e1cd74af50b None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:37.507288 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da17100-f1ef-45fd-b0ab-0e1cd74af50b None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:37.511772 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4d29d-12e2-422c-9478-293529249eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:37.512398 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4d29d-12e2-422c-9478-293529249eda admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:37.512676 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4d29d-12e2-422c-9478-293529249eda admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:37.513564 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4d29d-12e2-422c-9478-293529249eda admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:37.514223 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4d29d-12e2-422c-9478-293529249eda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:37.516133 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4d29d-12e2-422c-9478-293529249eda admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:37.542571 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1301/2587] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:35:37 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:35:37.546837 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca1a6b-ea4f-41d5-b012-f94fce074be0 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:37.556875 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca1a6b-ea4f-41d5-b012-f94fce074be0 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:37.560684 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:35:37.614843 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ddcf7-95cc-46d1-b8a9-2a406c8c730b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:37.615463 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ddcf7-95cc-46d1-b8a9-2a406c8c730b admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:37.615740 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ddcf7-95cc-46d1-b8a9-2a406c8c730b admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:37.616052 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ddcf7-95cc-46d1-b8a9-2a406c8c730b admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:37.616679 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ddcf7-95cc-46d1-b8a9-2a406c8c730b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:37.618618 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ddcf7-95cc-46d1-b8a9-2a406c8c730b admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:37.640562 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1287/2588] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:35:37 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:35:37.644620 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4d29d-12e2-422c-9478-293529249eda admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:37.654904 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4d29d-12e2-422c-9478-293529249eda admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:37.659639 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43251cf0-f446-4574-ac90-68c93563d263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:37.660266 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43251cf0-f446-4574-ac90-68c93563d263 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:37.660547 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43251cf0-f446-4574-ac90-68c93563d263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:37.660821 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43251cf0-f446-4574-ac90-68c93563d263 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:37.661456 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43251cf0-f446-4574-ac90-68c93563d263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:37.663030 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43251cf0-f446-4574-ac90-68c93563d263 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:37.674122 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1302/2589] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 25 13:35:37.678170 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ddcf7-95cc-46d1-b8a9-2a406c8c730b admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:37.688934 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ddcf7-95cc-46d1-b8a9-2a406c8c730b admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:37.693729 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533bb2d7-48b0-478f-a48c-5703f831f19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:37.694322 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bb2d7-48b0-478f-a48c-5703f831f19f admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:37.694601 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bb2d7-48b0-478f-a48c-5703f831f19f admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:37.695010 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bb2d7-48b0-478f-a48c-5703f831f19f admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:37.695819 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533bb2d7-48b0-478f-a48c-5703f831f19f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:37.697429 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533bb2d7-48b0-478f-a48c-5703f831f19f admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:37.708299 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1288/2590] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:35:37.712785 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43251cf0-f446-4574-ac90-68c93563d263 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:37.723475 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43251cf0-f446-4574-ac90-68c93563d263 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:37.728250 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d880df-d0dc-47ec-a74d-03f83d95f339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:37.728906 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d880df-d0dc-47ec-a74d-03f83d95f339 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:37.729186 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d880df-d0dc-47ec-a74d-03f83d95f339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:37.729460 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d880df-d0dc-47ec-a74d-03f83d95f339 admin admin] PATH_INFO: `/v3/projects/ed92dc443afd49cdab71e48f14e0544f/users/e8b6109e980a48cd92bd70764b3951dc/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:37.744547 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d880df-d0dc-47ec-a74d-03f83d95f339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed92dc443afd49cdab71e48f14e0544f, user_id=e8b6109e980a48cd92bd70764b3951dc, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:37.747174 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d880df-d0dc-47ec-a74d-03f83d95f339 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:37.760654 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1303/2591] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:35:37 2022] PUT /identity/v3/projects/ed92dc443afd49cdab71e48f14e0544f/users/e8b6109e980a48cd92bd70764b3951dc/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:35:37.772318 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa386547-aeb7-49aa-882f-8ecc0fed3b2e None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:37.772611 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa386547-aeb7-49aa-882f-8ecc0fed3b2e None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:37.772894 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa386547-aeb7-49aa-882f-8ecc0fed3b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:37.801354 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-aa386547-aeb7-49aa-882f-8ecc0fed3b2e None None] MFA Rules not processed for user `e8b6109e980a48cd92bd70764b3951dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:35:37.802588 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-aa386547-aeb7-49aa-882f-8ecc0fed3b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:37.866220 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1289/2592] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:35:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:35:37.877979 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d880df-d0dc-47ec-a74d-03f83d95f339 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:37.879669 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-48d880df-d0dc-47ec-a74d-03f83d95f339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:37.938529 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d880df-d0dc-47ec-a74d-03f83d95f339 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:37.942142 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51aec0-c6df-4bd4-97d1-7bdd88b26e67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:37.942744 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51aec0-c6df-4bd4-97d1-7bdd88b26e67 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:37.943018 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51aec0-c6df-4bd4-97d1-7bdd88b26e67 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:37.943286 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51aec0-c6df-4bd4-97d1-7bdd88b26e67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:37.951821 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c51aec0-c6df-4bd4-97d1-7bdd88b26e67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:37.953259 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c51aec0-c6df-4bd4-97d1-7bdd88b26e67 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:37.961835 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1304/2593] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:35:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:35:37.985785 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa386547-aeb7-49aa-882f-8ecc0fed3b2e None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:38.048126 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa386547-aeb7-49aa-882f-8ecc0fed3b2e None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:38.052566 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3bf95-d0bd-4c41-97fe-ce2963572fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:38.053185 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3bf95-d0bd-4c41-97fe-ce2963572fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:38.053462 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3bf95-d0bd-4c41-97fe-ce2963572fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:38.053732 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3bf95-d0bd-4c41-97fe-ce2963572fa3 admin admin] PATH_INFO: `/v3/users/e8b6109e980a48cd92bd70764b3951dc` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:38.054846 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de3bf95-d0bd-4c41-97fe-ce2963572fa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8b6109e980a48cd92bd70764b3951dc)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:38.056824 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de3bf95-d0bd-4c41-97fe-ce2963572fa3 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:38.072270 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:35:38.104397 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1de3bf95-d0bd-4c41-97fe-ce2963572fa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8b6109e980a48cd92bd70764b3951dc'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:38.116910 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1de3bf95-d0bd-4c41-97fe-ce2963572fa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8b6109e980a48cd92bd70764b3951dc'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:38.117595 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1de3bf95-d0bd-4c41-97fe-ce2963572fa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8b6109e980a48cd92bd70764b3951dc'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:38.124937 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1de3bf95-d0bd-4c41-97fe-ce2963572fa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8b6109e980a48cd92bd70764b3951dc'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:38.125564 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1de3bf95-d0bd-4c41-97fe-ce2963572fa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8b6109e980a48cd92bd70764b3951dc'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:38.137819 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1290/2594] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:35:37 2022] DELETE /identity/v3/users/e8b6109e980a48cd92bd70764b3951dc => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:35:38.142303 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5fd914-e16b-4cd1-89b8-59ba8ad4ad17 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:38.142590 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5fd914-e16b-4cd1-89b8-59ba8ad4ad17 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:38.142886 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5fd914-e16b-4cd1-89b8-59ba8ad4ad17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:38.162385 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-3c5fd914-e16b-4cd1-89b8-59ba8ad4ad17 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:35:38.163573 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3c5fd914-e16b-4cd1-89b8-59ba8ad4ad17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:38.221770 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1305/2595] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:35:38.231311 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3bf95-d0bd-4c41-97fe-ce2963572fa3 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:38.232782 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-1de3bf95-d0bd-4c41-97fe-ce2963572fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:38.289110 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3bf95-d0bd-4c41-97fe-ce2963572fa3 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:38.292809 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e804b-9cac-407a-aa2e-b77072d5664f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:38.293406 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e804b-9cac-407a-aa2e-b77072d5664f service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:38.293684 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e804b-9cac-407a-aa2e-b77072d5664f service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:38.293957 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e804b-9cac-407a-aa2e-b77072d5664f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:38.303491 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e804b-9cac-407a-aa2e-b77072d5664f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:38.304920 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e804b-9cac-407a-aa2e-b77072d5664f service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:38.314379 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1291/2596] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:35:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:35:38.579152 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5fd914-e16b-4cd1-89b8-59ba8ad4ad17 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:38.580604 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3c5fd914-e16b-4cd1-89b8-59ba8ad4ad17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:38.595431 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5fd914-e16b-4cd1-89b8-59ba8ad4ad17 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:38.600765 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5b31b-3252-438a-86a4-b9f868138595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:38.601729 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5b31b-3252-438a-86a4-b9f868138595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:38.602106 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5b31b-3252-438a-86a4-b9f868138595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:38.602265 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5b31b-3252-438a-86a4-b9f868138595 admin admin] PATH_INFO: `/v3/projects/ed92dc443afd49cdab71e48f14e0544f` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:38.603421 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e5b31b-3252-438a-86a4-b9f868138595 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed92dc443afd49cdab71e48f14e0544f)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:38.605348 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e5b31b-3252-438a-86a4-b9f868138595 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:38.630504 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:35:38.654381 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-51e5b31b-3252-438a-86a4-b9f868138595 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed92dc443afd49cdab71e48f14e0544f', 'request_id': 'req-51e5b31b-3252-438a-86a4-b9f868138595'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:38.661773 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-51e5b31b-3252-438a-86a4-b9f868138595 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed92dc443afd49cdab71e48f14e0544f', 'request_id': 'req-51e5b31b-3252-438a-86a4-b9f868138595'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:38.667566 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-51e5b31b-3252-438a-86a4-b9f868138595 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed92dc443afd49cdab71e48f14e0544f', 'request_id': 'req-51e5b31b-3252-438a-86a4-b9f868138595'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:38.678716 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-51e5b31b-3252-438a-86a4-b9f868138595 admin admin] The token cache is being invalidate because project ed92dc443afd49cdab71e48f14e0544f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:35:38.679007 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-51e5b31b-3252-438a-86a4-b9f868138595 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:38.679640 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-51e5b31b-3252-438a-86a4-b9f868138595 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:35:38.681130 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1306/2597] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:35:38 2022] DELETE /identity/v3/projects/ed92dc443afd49cdab71e48f14e0544f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:35:38.687835 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4320ed-e796-48aa-83dc-9780af393671 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:38.688324 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4320ed-e796-48aa-83dc-9780af393671 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:38.688430 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4320ed-e796-48aa-83dc-9780af393671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:38.708192 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-8f4320ed-e796-48aa-83dc-9780af393671 None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:35:38.709387 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-8f4320ed-e796-48aa-83dc-9780af393671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:38.774584 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1292/2598] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:35:38.783252 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47101e58-3085-41e7-9926-8b52b3d4b8bd None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:38.783538 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47101e58-3085-41e7-9926-8b52b3d4b8bd None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:38.783813 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47101e58-3085-41e7-9926-8b52b3d4b8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:38.804122 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-47101e58-3085-41e7-9926-8b52b3d4b8bd None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:35:38.805345 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-47101e58-3085-41e7-9926-8b52b3d4b8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:38.813123 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1307/2599] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 25 13:35:38.817506 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4320ed-e796-48aa-83dc-9780af393671 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:38.827231 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4320ed-e796-48aa-83dc-9780af393671 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:38.831688 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4021f33-c78f-49b0-9d6d-a4300ba51244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:38.832318 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4021f33-c78f-49b0-9d6d-a4300ba51244 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:38.832599 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4021f33-c78f-49b0-9d6d-a4300ba51244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:38.832872 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4021f33-c78f-49b0-9d6d-a4300ba51244 admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:38.833509 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4021f33-c78f-49b0-9d6d-a4300ba51244 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 25 13:35:38.833808 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4021f33-c78f-49b0-9d6d-a4300ba51244 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:38.835387 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4021f33-c78f-49b0-9d6d-a4300ba51244 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:38.847160 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1293/2600] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 25 13:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 25 13:35:38.851309 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47101e58-3085-41e7-9926-8b52b3d4b8bd None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:38.860731 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47101e58-3085-41e7-9926-8b52b3d4b8bd None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:38.865340 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5a52a-3fd0-4f0e-b2fb-5efd203d468d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:38.865933 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5a52a-3fd0-4f0e-b2fb-5efd203d468d admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:38.866207 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5a52a-3fd0-4f0e-b2fb-5efd203d468d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:38.866477 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5a52a-3fd0-4f0e-b2fb-5efd203d468d admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:38.867097 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b5a52a-3fd0-4f0e-b2fb-5efd203d468d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:38.869057 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b5a52a-3fd0-4f0e-b2fb-5efd203d468d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:38.896279 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1308/2601] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:35:38 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 25 13:35:38.900328 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4021f33-c78f-49b0-9d6d-a4300ba51244 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:38.910581 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4021f33-c78f-49b0-9d6d-a4300ba51244 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:38.931149 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:35:38.971586 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a83a5-062c-48ad-bfe8-e04545013cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:38.972235 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a83a5-062c-48ad-bfe8-e04545013cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:38.972531 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a83a5-062c-48ad-bfe8-e04545013cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:38.972792 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a83a5-062c-48ad-bfe8-e04545013cc8 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:38.973431 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a83a5-062c-48ad-bfe8-e04545013cc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:38.975341 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a83a5-062c-48ad-bfe8-e04545013cc8 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:38.999051 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1294/2602] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:35:38 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:35:39.003091 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5a52a-3fd0-4f0e-b2fb-5efd203d468d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:39.013864 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5a52a-3fd0-4f0e-b2fb-5efd203d468d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:39.018457 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7e618-7690-4530-87f4-763e34ae89f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:39.019065 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7e618-7690-4530-87f4-763e34ae89f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:39.019345 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7e618-7690-4530-87f4-763e34ae89f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:39.019618 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7e618-7690-4530-87f4-763e34ae89f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:39.020299 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f7e618-7690-4530-87f4-763e34ae89f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:39.021882 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f7e618-7690-4530-87f4-763e34ae89f9 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:39.031954 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1309/2603] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:35:39.036006 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a83a5-062c-48ad-bfe8-e04545013cc8 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:39.047084 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a83a5-062c-48ad-bfe8-e04545013cc8 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:39.051928 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b26e1-7111-48c4-bc19-97ab7d97c03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:39.052957 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b26e1-7111-48c4-bc19-97ab7d97c03b admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:39.053242 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b26e1-7111-48c4-bc19-97ab7d97c03b admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:39.053518 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b26e1-7111-48c4-bc19-97ab7d97c03b admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:39.054158 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b26e1-7111-48c4-bc19-97ab7d97c03b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:39.055778 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b26e1-7111-48c4-bc19-97ab7d97c03b admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:39.069110 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1295/2604] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:35:39.073553 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7e618-7690-4530-87f4-763e34ae89f9 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:39.084145 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7e618-7690-4530-87f4-763e34ae89f9 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:39.088731 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508dc71a-0f60-4045-b317-4144e8283b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:39.089383 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508dc71a-0f60-4045-b317-4144e8283b0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:39.089667 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508dc71a-0f60-4045-b317-4144e8283b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:39.089947 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508dc71a-0f60-4045-b317-4144e8283b0e admin admin] PATH_INFO: `/v3/projects/b8d513c37366461db0b71a3e4e4e035a/users/6c905e31cfef4b79b67bae0eaf4b6f9d/roles/9a3705eba27c47daad42ad874948996d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:39.104981 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508dc71a-0f60-4045-b317-4144e8283b0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8d513c37366461db0b71a3e4e4e035a, user_id=6c905e31cfef4b79b67bae0eaf4b6f9d, role_id=9a3705eba27c47daad42ad874948996d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:39.107665 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508dc71a-0f60-4045-b317-4144e8283b0e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:39.120507 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1310/2605] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:35:39 2022] PUT /identity/v3/projects/b8d513c37366461db0b71a3e4e4e035a/users/6c905e31cfef4b79b67bae0eaf4b6f9d/roles/9a3705eba27c47daad42ad874948996d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:35:39.125702 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504e8ff-a89a-4e06-87da-d5f91878820d None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:39.125993 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504e8ff-a89a-4e06-87da-d5f91878820d None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:39.126299 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504e8ff-a89a-4e06-87da-d5f91878820d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:39.145563 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-5504e8ff-a89a-4e06-87da-d5f91878820d None None] MFA Rules not processed for user `297f37c6bdb6496db9bb50ba9e5abd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:35:39.146751 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-5504e8ff-a89a-4e06-87da-d5f91878820d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:39.205458 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1296/2606] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:35:39.214887 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508dc71a-0f60-4045-b317-4144e8283b0e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:39.217165 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-508dc71a-0f60-4045-b317-4144e8283b0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:39.274207 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508dc71a-0f60-4045-b317-4144e8283b0e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:39.277829 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8020f9a-2e19-4f98-b0ed-e2c3bfefbcbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:39.278438 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8020f9a-2e19-4f98-b0ed-e2c3bfefbcbf service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:39.279293 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8020f9a-2e19-4f98-b0ed-e2c3bfefbcbf service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:39.279570 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8020f9a-2e19-4f98-b0ed-e2c3bfefbcbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:39.288467 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8020f9a-2e19-4f98-b0ed-e2c3bfefbcbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:39.289921 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8020f9a-2e19-4f98-b0ed-e2c3bfefbcbf service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:39.299777 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1311/2607] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:35:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:35:43.284971 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246dad66-7af8-4b3b-87ad-9cca29d42cd3 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:43.285464 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246dad66-7af8-4b3b-87ad-9cca29d42cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:43.285578 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246dad66-7af8-4b3b-87ad-9cca29d42cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:43.316234 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-246dad66-7af8-4b3b-87ad-9cca29d42cd3 None None] MFA Rules not processed for user `6c905e31cfef4b79b67bae0eaf4b6f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:35:43.317458 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-246dad66-7af8-4b3b-87ad-9cca29d42cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:43.385664 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1297/2608] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:35:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:35:43.390715 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8020f9a-2e19-4f98-b0ed-e2c3bfefbcbf service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:43.401835 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8020f9a-2e19-4f98-b0ed-e2c3bfefbcbf service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:43.407012 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d70ab-4d4f-4f4c-9835-d1b3db2a1733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:43.407630 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d70ab-4d4f-4f4c-9835-d1b3db2a1733 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:43.407934 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d70ab-4d4f-4f4c-9835-d1b3db2a1733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:43.408214 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d70ab-4d4f-4f4c-9835-d1b3db2a1733 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:43.408854 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d70ab-4d4f-4f4c-9835-d1b3db2a1733 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:43.410762 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d70ab-4d4f-4f4c-9835-d1b3db2a1733 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:43.444034 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1312/2609] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 25 13:35:43 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:35:43.448146 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246dad66-7af8-4b3b-87ad-9cca29d42cd3 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:43.461201 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246dad66-7af8-4b3b-87ad-9cca29d42cd3 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:43.494727 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:35:43.525238 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b2ec7-a16f-43d3-8309-1ea56bc21ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:43.525875 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b2ec7-a16f-43d3-8309-1ea56bc21ba3 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:43.526154 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b2ec7-a16f-43d3-8309-1ea56bc21ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:43.526411 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b2ec7-a16f-43d3-8309-1ea56bc21ba3 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:43.527047 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b2ec7-a16f-43d3-8309-1ea56bc21ba3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:43.529525 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b2ec7-a16f-43d3-8309-1ea56bc21ba3 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:43.558075 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1298/2610] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 25 13:35:43 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 25 13:35:43.563513 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d70ab-4d4f-4f4c-9835-d1b3db2a1733 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:43.577699 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d70ab-4d4f-4f4c-9835-d1b3db2a1733 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:43.582544 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0b1b3-dd39-4582-96ef-b3732f313b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:43.583274 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0b1b3-dd39-4582-96ef-b3732f313b94 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:43.583627 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0b1b3-dd39-4582-96ef-b3732f313b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:43.584002 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0b1b3-dd39-4582-96ef-b3732f313b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:43.584731 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0b1b3-dd39-4582-96ef-b3732f313b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:43.586833 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0b1b3-dd39-4582-96ef-b3732f313b94 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:43.598859 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1313/2611] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:35:43.602742 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b2ec7-a16f-43d3-8309-1ea56bc21ba3 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:43.614031 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b2ec7-a16f-43d3-8309-1ea56bc21ba3 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:43.619105 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d214283-3866-4b60-bbf7-aceefc021a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:43.619770 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d214283-3866-4b60-bbf7-aceefc021a9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:43.620105 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d214283-3866-4b60-bbf7-aceefc021a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:43.620448 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d214283-3866-4b60-bbf7-aceefc021a9a admin admin] PATH_INFO: `/v3/projects/41aa6230f6d749b0bbdbedbb38156fa8/users/2502034b82004b0c8b831872b78c80fe/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:43.637458 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d214283-3866-4b60-bbf7-aceefc021a9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=41aa6230f6d749b0bbdbedbb38156fa8, user_id=2502034b82004b0c8b831872b78c80fe, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:43.640348 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d214283-3866-4b60-bbf7-aceefc021a9a admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:43.655993 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1299/2612] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:35:43 2022] PUT /identity/v3/projects/41aa6230f6d749b0bbdbedbb38156fa8/users/2502034b82004b0c8b831872b78c80fe/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:35:43.659721 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0b1b3-dd39-4582-96ef-b3732f313b94 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:43.672926 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0b1b3-dd39-4582-96ef-b3732f313b94 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:43.688648 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:35:43.747006 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a85793-8c23-4009-ad4e-3c86faf85929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:43.747755 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a85793-8c23-4009-ad4e-3c86faf85929 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:43.748138 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a85793-8c23-4009-ad4e-3c86faf85929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:43.748416 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a85793-8c23-4009-ad4e-3c86faf85929 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:43.749071 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a85793-8c23-4009-ad4e-3c86faf85929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:43.750699 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a85793-8c23-4009-ad4e-3c86faf85929 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:43.761671 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1314/2613] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 25 13:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 25 13:35:43.766759 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d214283-3866-4b60-bbf7-aceefc021a9a admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:43.779738 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d214283-3866-4b60-bbf7-aceefc021a9a admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:43.784415 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909caf9-815b-4050-b1a3-a31cda91eaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:43.785068 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909caf9-815b-4050-b1a3-a31cda91eaf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:43.785352 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909caf9-815b-4050-b1a3-a31cda91eaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:43.785624 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909caf9-815b-4050-b1a3-a31cda91eaf4 admin admin] PATH_INFO: `/v3/projects/41aa6230f6d749b0bbdbedbb38156fa8/users/2502034b82004b0c8b831872b78c80fe/roles/4c7114fda3ec4652abed55516b5f4315` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:43.787605 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8909caf9-815b-4050-b1a3-a31cda91eaf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41aa6230f6d749b0bbdbedbb38156fa8, user_id=2502034b82004b0c8b831872b78c80fe, role_id=4c7114fda3ec4652abed55516b5f4315)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:43.790263 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8909caf9-815b-4050-b1a3-a31cda91eaf4 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:43.804005 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1300/2614] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 25 13:35:43 2022] PUT /identity/v3/projects/41aa6230f6d749b0bbdbedbb38156fa8/users/2502034b82004b0c8b831872b78c80fe/roles/4c7114fda3ec4652abed55516b5f4315 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:35:48.315243 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a2a5a-08ae-4fc2-8544-ad45198065eb None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:48.315717 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a2a5a-08ae-4fc2-8544-ad45198065eb None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:48.315816 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a2a5a-08ae-4fc2-8544-ad45198065eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:48.355348 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e53a2a5a-08ae-4fc2-8544-ad45198065eb None None] MFA Rules not processed for user `2502034b82004b0c8b831872b78c80fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:35:48.356788 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e53a2a5a-08ae-4fc2-8544-ad45198065eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:48.473970 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1315/2615] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:35:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:35:48.498593 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909caf9-815b-4050-b1a3-a31cda91eaf4 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:35:48.500914 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-8909caf9-815b-4050-b1a3-a31cda91eaf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:48.607957 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909caf9-815b-4050-b1a3-a31cda91eaf4 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:35:48.613802 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b519c47-e725-4663-a8f3-eedc64973660 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:35:48.614434 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b519c47-e725-4663-a8f3-eedc64973660 service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:48.614711 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b519c47-e725-4663-a8f3-eedc64973660 service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:48.614981 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b519c47-e725-4663-a8f3-eedc64973660 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:48.689173 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b519c47-e725-4663-a8f3-eedc64973660 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:35:48.690812 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b519c47-e725-4663-a8f3-eedc64973660 service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:35:48.703299 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1301/2616] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:35:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:35:49.982897 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95382cca-f4c4-4660-a839-541a355469b7 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:35:49.983379 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95382cca-f4c4-4660-a839-541a355469b7 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:35:49.983379 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95382cca-f4c4-4660-a839-541a355469b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:35:50.003531 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-95382cca-f4c4-4660-a839-541a355469b7 None None] MFA Rules not processed for user `6c905e31cfef4b79b67bae0eaf4b6f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 25 13:35:50.004777 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-95382cca-f4c4-4660-a839-541a355469b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:35:50.011540 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1316/2617] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 25 13:35:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 25 13:35:58.696664 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=85,keystone:INSERT=5 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:35:59.997046 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=58 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:36:06.334164 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b519c47-e725-4663-a8f3-eedc64973660 service nova] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:36:06.335551 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2b519c47-e725-4663-a8f3-eedc64973660 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:36:06.392319 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b519c47-e725-4663-a8f3-eedc64973660 service nova] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:36:06.395878 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab64116-784a-4c21-b769-b834d98c9c61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858fa61f39fa4d3daf4125f6099e7721', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:36:06.396497 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab64116-784a-4c21-b769-b834d98c9c61 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:36:06.396772 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab64116-784a-4c21-b769-b834d98c9c61 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:36:06.397042 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab64116-784a-4c21-b769-b834d98c9c61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:36:06.398758 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-5ab64116-784a-4c21-b769-b834d98c9c61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:36:06.412821 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab64116-784a-4c21-b769-b834d98c9c61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:36:06.414289 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab64116-784a-4c21-b769-b834d98c9c61 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:36:06.425881 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1302/2618] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:36:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:36:06.708576 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95382cca-f4c4-4660-a839-541a355469b7 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:36:06.763126 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95382cca-f4c4-4660-a839-541a355469b7 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:36:06.767425 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97695693-6878-441a-94a0-a7af55ef2919 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:36:06.767995 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97695693-6878-441a-94a0-a7af55ef2919 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:36:06.768278 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97695693-6878-441a-94a0-a7af55ef2919 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:36:06.768552 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97695693-6878-441a-94a0-a7af55ef2919 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:36:06.770260 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-97695693-6878-441a-94a0-a7af55ef2919 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:36:06.780107 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97695693-6878-441a-94a0-a7af55ef2919 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:36:06.782119 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97695693-6878-441a-94a0-a7af55ef2919 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:36:06.790130 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1317/2619] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:36:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:36:07.236700 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab64116-784a-4c21-b769-b834d98c9c61 service cinder] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:36:07.238113 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-5ab64116-784a-4c21-b769-b834d98c9c61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:36:07.246502 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97695693-6878-441a-94a0-a7af55ef2919 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:36:07.248002 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-97695693-6878-441a-94a0-a7af55ef2919 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:36:07.258952 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97695693-6878-441a-94a0-a7af55ef2919 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:36:07.262668 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c4877-7e23-4791-85dc-eef735feb08d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:36:07.263272 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c4877-7e23-4791-85dc-eef735feb08d service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:36:07.263556 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c4877-7e23-4791-85dc-eef735feb08d service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:36:07.263833 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c4877-7e23-4791-85dc-eef735feb08d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:36:07.266300 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7a0c4877-7e23-4791-85dc-eef735feb08d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:36:07.279663 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c4877-7e23-4791-85dc-eef735feb08d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:36:07.281378 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c4877-7e23-4791-85dc-eef735feb08d service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:36:07.292717 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1318/2620] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:36:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 13:36:07.309920 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab64116-784a-4c21-b769-b834d98c9c61 service cinder] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:36:07.315451 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3fe1e0-cdc5-42e0-b557-64e24c9feafb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f10c161ef74c4a0d809346a5c4b53aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:36:07.316080 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fe1e0-cdc5-42e0-b557-64e24c9feafb service placement] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:36:07.316359 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fe1e0-cdc5-42e0-b557-64e24c9feafb service placement] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:36:07.316628 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fe1e0-cdc5-42e0-b557-64e24c9feafb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:36:07.318312 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-3b3fe1e0-cdc5-42e0-b557-64e24c9feafb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:36:07.330382 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3fe1e0-cdc5-42e0-b557-64e24c9feafb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:36:07.332011 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3fe1e0-cdc5-42e0-b557-64e24c9feafb service placement] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:36:07.342222 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1303/2621] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:36:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:36:09.138885 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c4877-7e23-4791-85dc-eef735feb08d service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:36:09.148355 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c4877-7e23-4791-85dc-eef735feb08d service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:36:09.152292 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c9009-dde9-4a44-b901-a0b576683606 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:36:09.152939 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c9009-dde9-4a44-b901-a0b576683606 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:36:09.153222 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c9009-dde9-4a44-b901-a0b576683606 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:36:09.153496 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c9009-dde9-4a44-b901-a0b576683606 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:36:09.155265 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7f3c9009-dde9-4a44-b901-a0b576683606 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:36:09.166333 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c9009-dde9-4a44-b901-a0b576683606 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:36:09.167689 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c9009-dde9-4a44-b901-a0b576683606 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:36:09.177874 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1319/2622] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:36:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:36:09.845894 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3fe1e0-cdc5-42e0-b557-64e24c9feafb service placement] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:36:09.847462 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-3b3fe1e0-cdc5-42e0-b557-64e24c9feafb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:36:09.864018 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3fe1e0-cdc5-42e0-b557-64e24c9feafb service placement] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:36:09.869683 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df6dc9-5675-49c8-9a2c-746b81e9771d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:36:09.870290 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df6dc9-5675-49c8-9a2c-746b81e9771d service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:36:09.870566 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df6dc9-5675-49c8-9a2c-746b81e9771d service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:36:09.870838 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df6dc9-5675-49c8-9a2c-746b81e9771d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:36:09.872582 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-d2df6dc9-5675-49c8-9a2c-746b81e9771d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:36:09.885301 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df6dc9-5675-49c8-9a2c-746b81e9771d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:36:09.886897 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df6dc9-5675-49c8-9a2c-746b81e9771d service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:36:09.900499 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1304/2623] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:36:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:36:16.940350 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c9009-dde9-4a44-b901-a0b576683606 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:36:16.953941 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c9009-dde9-4a44-b901-a0b576683606 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:36:16.960142 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556718a-4d37-4902-9086-adb41766d294 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:36:16.960749 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556718a-4d37-4902-9086-adb41766d294 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:36:16.961029 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556718a-4d37-4902-9086-adb41766d294 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:36:16.961305 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556718a-4d37-4902-9086-adb41766d294 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:36:16.963092 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d556718a-4d37-4902-9086-adb41766d294 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:36:16.976166 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d556718a-4d37-4902-9086-adb41766d294 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:36:16.977745 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d556718a-4d37-4902-9086-adb41766d294 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:36:16.988940 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1320/2624] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:36:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:36:19.894620 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=64 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:36:20.424810 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df6dc9-5675-49c8-9a2c-746b81e9771d service nova] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:36:20.434286 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df6dc9-5675-49c8-9a2c-746b81e9771d service nova] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:36:20.439275 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd858a7-1ffa-4c7a-b9c7-8b048894a502 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:36:20.439922 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd858a7-1ffa-4c7a-b9c7-8b048894a502 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:36:20.440207 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd858a7-1ffa-4c7a-b9c7-8b048894a502 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:36:20.440479 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd858a7-1ffa-4c7a-b9c7-8b048894a502 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:36:20.449276 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd858a7-1ffa-4c7a-b9c7-8b048894a502 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:36:20.450685 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd858a7-1ffa-4c7a-b9c7-8b048894a502 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:36:20.459915 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1305/2625] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:36:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:36:22.006105 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556718a-4d37-4902-9086-adb41766d294 service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:36:22.018492 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556718a-4d37-4902-9086-adb41766d294 service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:36:22.024647 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b599eec-b63a-4eb6-973b-bf4d6d1dfb41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e73c00cadb4deea934db6111ed76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:36:22.025264 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b599eec-b63a-4eb6-973b-bf4d6d1dfb41 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:36:22.025550 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b599eec-b63a-4eb6-973b-bf4d6d1dfb41 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:36:22.025829 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b599eec-b63a-4eb6-973b-bf4d6d1dfb41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:36:22.027555 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1b599eec-b63a-4eb6-973b-bf4d6d1dfb41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:36:22.040449 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b599eec-b63a-4eb6-973b-bf4d6d1dfb41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:36:22.042022 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b599eec-b63a-4eb6-973b-bf4d6d1dfb41 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:36:22.053152 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1321/2626] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:36:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:36:30.455749 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=6 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:36:32.048354 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=50 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:37:40.576107 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd858a7-1ffa-4c7a-b9c7-8b048894a502 service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:37:40.577496 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ffd858a7-1ffa-4c7a-b9c7-8b048894a502 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:37:40.592658 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd858a7-1ffa-4c7a-b9c7-8b048894a502 service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:37:40.597658 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11e3e8-e43f-4727-b880-a8f7c706c691 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f10c161ef74c4a0d809346a5c4b53aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:37:40.598249 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11e3e8-e43f-4727-b880-a8f7c706c691 service placement] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:37:40.598527 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11e3e8-e43f-4727-b880-a8f7c706c691 service placement] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:37:40.598799 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11e3e8-e43f-4727-b880-a8f7c706c691 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:37:40.600491 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ac11e3e8-e43f-4727-b880-a8f7c706c691 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:37:40.611522 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac11e3e8-e43f-4727-b880-a8f7c706c691 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:37:40.613268 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac11e3e8-e43f-4727-b880-a8f7c706c691 service placement] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:37:40.623067 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1306/2627] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:37:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:37:50.618771 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=6 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:38:58.034706 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b599eec-b63a-4eb6-973b-bf4d6d1dfb41 service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:38:58.045535 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b599eec-b63a-4eb6-973b-bf4d6d1dfb41 service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:38:58.049800 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3dc6bf-ff62-43cb-950a-cf9cd645b7b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:38:58.050386 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dc6bf-ff62-43cb-950a-cf9cd645b7b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:38:58.050668 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dc6bf-ff62-43cb-950a-cf9cd645b7b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:38:58.050946 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dc6bf-ff62-43cb-950a-cf9cd645b7b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:38:58.052733 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3c3dc6bf-ff62-43cb-950a-cf9cd645b7b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:38:58.063349 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3dc6bf-ff62-43cb-950a-cf9cd645b7b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:38:58.064879 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3dc6bf-ff62-43cb-950a-cf9cd645b7b0 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:38:58.073967 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1322/2628] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:38:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:38:58.153099 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11e3e8-e43f-4727-b880-a8f7c706c691 service placement] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:38:58.162680 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11e3e8-e43f-4727-b880-a8f7c706c691 service placement] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:38:58.167151 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0cb22c-ffe4-4d53-8201-e412ed8898af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:38:58.167851 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cb22c-ffe4-4d53-8201-e412ed8898af service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:38:58.168038 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cb22c-ffe4-4d53-8201-e412ed8898af service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:38:58.172464 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cb22c-ffe4-4d53-8201-e412ed8898af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:38:58.172464 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-6e0cb22c-ffe4-4d53-8201-e412ed8898af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:38:58.184640 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0cb22c-ffe4-4d53-8201-e412ed8898af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:38:58.186096 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0cb22c-ffe4-4d53-8201-e412ed8898af service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:38:58.197397 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1307/2629] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:38:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 13:39:08.070011 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=6 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:39:08.192098 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=6 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:40:44.626535 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3dc6bf-ff62-43cb-950a-cf9cd645b7b0 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:40:44.635303 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3dc6bf-ff62-43cb-950a-cf9cd645b7b0 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:40:44.638962 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a68d15-c50f-439e-9a93-6e4478441c7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec40e8c81fe4eafb474d40bc7bf38fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:40:44.639584 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a68d15-c50f-439e-9a93-6e4478441c7f service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:40:44.639860 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a68d15-c50f-439e-9a93-6e4478441c7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:40:44.640163 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a68d15-c50f-439e-9a93-6e4478441c7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:40:44.700780 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a68d15-c50f-439e-9a93-6e4478441c7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:40:44.702120 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a68d15-c50f-439e-9a93-6e4478441c7f service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:40:44.711526 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1323/2630] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:40:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:40:47.812234 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0cb22c-ffe4-4d53-8201-e412ed8898af service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:40:47.824523 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0cb22c-ffe4-4d53-8201-e412ed8898af service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:40:47.830181 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94db59-5fea-40a9-be22-bde3dba3511e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f10c161ef74c4a0d809346a5c4b53aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:40:47.830796 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94db59-5fea-40a9-be22-bde3dba3511e service placement] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:40:47.831213 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94db59-5fea-40a9-be22-bde3dba3511e service placement] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:40:47.831544 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94db59-5fea-40a9-be22-bde3dba3511e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:40:47.833424 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ea94db59-5fea-40a9-be22-bde3dba3511e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:40:47.846538 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94db59-5fea-40a9-be22-bde3dba3511e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:40:47.848844 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94db59-5fea-40a9-be22-bde3dba3511e service placement] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:40:47.860750 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1308/2631] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:40:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:40:51.060963 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a68d15-c50f-439e-9a93-6e4478441c7f service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:40:51.074706 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a68d15-c50f-439e-9a93-6e4478441c7f service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:40:51.079719 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89802ae-689b-4335-89c8-ff70035c5b60 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f10c161ef74c4a0d809346a5c4b53aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:40:51.080356 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89802ae-689b-4335-89c8-ff70035c5b60 service placement] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:40:51.080648 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89802ae-689b-4335-89c8-ff70035c5b60 service placement] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:40:51.080934 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89802ae-689b-4335-89c8-ff70035c5b60 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:40:51.082839 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b89802ae-689b-4335-89c8-ff70035c5b60 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:40:51.101032 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89802ae-689b-4335-89c8-ff70035c5b60 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:40:51.103171 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89802ae-689b-4335-89c8-ff70035c5b60 service placement] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:40:51.116385 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1324/2632] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:40:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 25 13:40:51.138908 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94db59-5fea-40a9-be22-bde3dba3511e service placement] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:40:51.152632 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94db59-5fea-40a9-be22-bde3dba3511e service placement] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:40:51.161362 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f975565-c521-44b1-887a-d02478b51994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:40:51.162080 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f975565-c521-44b1-887a-d02478b51994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:40:51.162358 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f975565-c521-44b1-887a-d02478b51994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:40:51.162852 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f975565-c521-44b1-887a-d02478b51994 admin admin] PATH_INFO: `/v3/users/6c905e31cfef4b79b67bae0eaf4b6f9d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:40:51.164245 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f975565-c521-44b1-887a-d02478b51994 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c905e31cfef4b79b67bae0eaf4b6f9d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:40:51.166945 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f975565-c521-44b1-887a-d02478b51994 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:40:51.225355 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-7f975565-c521-44b1-887a-d02478b51994 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c905e31cfef4b79b67bae0eaf4b6f9d'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:40:51.242800 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-7f975565-c521-44b1-887a-d02478b51994 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c905e31cfef4b79b67bae0eaf4b6f9d'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:40:51.243996 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-7f975565-c521-44b1-887a-d02478b51994 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c905e31cfef4b79b67bae0eaf4b6f9d'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:40:51.253664 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-7f975565-c521-44b1-887a-d02478b51994 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c905e31cfef4b79b67bae0eaf4b6f9d'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:40:51.254291 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-7f975565-c521-44b1-887a-d02478b51994 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c905e31cfef4b79b67bae0eaf4b6f9d'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:40:51.269506 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1309/2633] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:40:51 2022] DELETE /identity/v3/users/6c905e31cfef4b79b67bae0eaf4b6f9d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:40:51.479612 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89802ae-689b-4335-89c8-ff70035c5b60 service placement] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:40:51.494706 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89802ae-689b-4335-89c8-ff70035c5b60 service placement] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:40:51.564507 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2900f37-ea5f-40a0-87aa-912779a2d00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:40:51.565145 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2900f37-ea5f-40a0-87aa-912779a2d00e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:40:51.565424 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2900f37-ea5f-40a0-87aa-912779a2d00e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:40:51.565698 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2900f37-ea5f-40a0-87aa-912779a2d00e admin admin] PATH_INFO: `/v3/projects/b8d513c37366461db0b71a3e4e4e035a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:40:51.566812 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2900f37-ea5f-40a0-87aa-912779a2d00e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8d513c37366461db0b71a3e4e4e035a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:40:51.568839 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2900f37-ea5f-40a0-87aa-912779a2d00e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:40:51.621270 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d2900f37-ea5f-40a0-87aa-912779a2d00e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8d513c37366461db0b71a3e4e4e035a', 'request_id': 'req-d2900f37-ea5f-40a0-87aa-912779a2d00e'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:40:51.629745 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d2900f37-ea5f-40a0-87aa-912779a2d00e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8d513c37366461db0b71a3e4e4e035a', 'request_id': 'req-d2900f37-ea5f-40a0-87aa-912779a2d00e'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:40:51.636553 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d2900f37-ea5f-40a0-87aa-912779a2d00e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8d513c37366461db0b71a3e4e4e035a', 'request_id': 'req-d2900f37-ea5f-40a0-87aa-912779a2d00e'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:40:51.647394 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d2900f37-ea5f-40a0-87aa-912779a2d00e admin admin] The token cache is being invalidate because project b8d513c37366461db0b71a3e4e4e035a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:40:51.647685 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d2900f37-ea5f-40a0-87aa-912779a2d00e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:40:51.648329 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d2900f37-ea5f-40a0-87aa-912779a2d00e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:40:51.650515 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1325/2634] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:40:51 2022] DELETE /identity/v3/projects/b8d513c37366461db0b71a3e4e4e035a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:40:51.654562 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f975565-c521-44b1-887a-d02478b51994 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:40:51.656000 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-7f975565-c521-44b1-887a-d02478b51994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:40:51.668843 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f975565-c521-44b1-887a-d02478b51994 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:40:51.729760 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326d6ad-7e94-4f98-af83-efd425eeda6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:40:51.730393 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326d6ad-7e94-4f98-af83-efd425eeda6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:40:51.730672 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326d6ad-7e94-4f98-af83-efd425eeda6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:40:51.730944 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326d6ad-7e94-4f98-af83-efd425eeda6d admin admin] PATH_INFO: `/v3/users/2502034b82004b0c8b831872b78c80fe` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:40:51.732158 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326d6ad-7e94-4f98-af83-efd425eeda6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2502034b82004b0c8b831872b78c80fe)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:40:51.734088 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326d6ad-7e94-4f98-af83-efd425eeda6d admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:40:51.779624 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-8326d6ad-7e94-4f98-af83-efd425eeda6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2502034b82004b0c8b831872b78c80fe'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:40:51.789537 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:40:51.793160 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-8326d6ad-7e94-4f98-af83-efd425eeda6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2502034b82004b0c8b831872b78c80fe'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:40:51.794204 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-8326d6ad-7e94-4f98-af83-efd425eeda6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2502034b82004b0c8b831872b78c80fe'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:40:51.801408 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-8326d6ad-7e94-4f98-af83-efd425eeda6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2502034b82004b0c8b831872b78c80fe'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:40:51.802029 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-8326d6ad-7e94-4f98-af83-efd425eeda6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2502034b82004b0c8b831872b78c80fe'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:40:51.814377 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1310/2635] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 25 13:40:51 2022] DELETE /identity/v3/users/2502034b82004b0c8b831872b78c80fe => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 25 13:40:51.987768 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2900f37-ea5f-40a0-87aa-912779a2d00e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:40:51.989316 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d2900f37-ea5f-40a0-87aa-912779a2d00e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:40:52.002207 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2900f37-ea5f-40a0-87aa-912779a2d00e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:40:52.013963 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:40:52.067215 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b8f98-bd87-4e7b-8be4-d4737f701b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '297f37c6bdb6496db9bb50ba9e5abd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9835e5a39eb74917a1e872356cdbdeb5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:40:52.067867 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b8f98-bd87-4e7b-8be4-d4737f701b36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:40:52.068137 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b8f98-bd87-4e7b-8be4-d4737f701b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:40:52.068410 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b8f98-bd87-4e7b-8be4-d4737f701b36 admin admin] PATH_INFO: `/v3/projects/41aa6230f6d749b0bbdbedbb38156fa8` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:40:52.069515 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b8f98-bd87-4e7b-8be4-d4737f701b36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41aa6230f6d749b0bbdbedbb38156fa8)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:40:52.071919 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b8f98-bd87-4e7b-8be4-d4737f701b36 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:40:52.118101 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-844b8f98-bd87-4e7b-8be4-d4737f701b36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41aa6230f6d749b0bbdbedbb38156fa8', 'request_id': 'req-844b8f98-bd87-4e7b-8be4-d4737f701b36'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:40:52.126123 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-844b8f98-bd87-4e7b-8be4-d4737f701b36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41aa6230f6d749b0bbdbedbb38156fa8', 'request_id': 'req-844b8f98-bd87-4e7b-8be4-d4737f701b36'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:40:52.131587 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-844b8f98-bd87-4e7b-8be4-d4737f701b36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41aa6230f6d749b0bbdbedbb38156fa8', 'request_id': 'req-844b8f98-bd87-4e7b-8be4-d4737f701b36'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:40:52.142594 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-844b8f98-bd87-4e7b-8be4-d4737f701b36 admin admin] The token cache is being invalidate because project 41aa6230f6d749b0bbdbedbb38156fa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 25 13:40:52.142878 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-844b8f98-bd87-4e7b-8be4-d4737f701b36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:40:52.143497 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-844b8f98-bd87-4e7b-8be4-d4737f701b36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 25 13:40:52.144984 dv-cinder-862432-2-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1326/2636] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 25 13:40:51 2022] DELETE /identity/v3/projects/41aa6230f6d749b0bbdbedbb38156fa8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 25 13:41:01.810921 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:DELETE=2,keystone:SELECT=7,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:41:02.139619 dv-cinder-862432-2-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=46,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 13:42:46.561250 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326d6ad-7e94-4f98-af83-efd425eeda6d admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 25 13:42:46.562662 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-8326d6ad-7e94-4f98-af83-efd425eeda6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:42:46.701185 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326d6ad-7e94-4f98-af83-efd425eeda6d admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 25 13:42:46.760898 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156d99d-cb8d-4a5c-92fb-9afc5a397565 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f10c161ef74c4a0d809346a5c4b53aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '616ecfe8d2c74aad9386720718392e81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 25 13:42:46.762041 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156d99d-cb8d-4a5c-92fb-9afc5a397565 service placement] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 25 13:42:46.762493 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156d99d-cb8d-4a5c-92fb-9afc5a397565 service placement] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 25 13:42:46.762774 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156d99d-cb8d-4a5c-92fb-9afc5a397565 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 25 13:42:46.764545 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-9156d99d-cb8d-4a5c-92fb-9afc5a397565 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 25 13:42:46.775407 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9156d99d-cb8d-4a5c-92fb-9afc5a397565 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 25 13:42:46.777737 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9156d99d-cb8d-4a5c-92fb-9afc5a397565 service placement] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 25 13:42:46.787398 dv-cinder-862432-2-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1311/2637] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 25 13:42:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 25 13:42:56.783248 dv-cinder-862432-2-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}